A point-cloud-based multiview stereo algorithm for free-viewpoint video

IEEE Transactions on Visualization and Computer Graphics

Volumn 16, Issue 3, 2010, Pages 407-418

  Liu, Yebin ^a   Dai, Qionghai ^a   Xu, Wenli ^a  

^a TSINGHUA UNIVERSITY   (China)

Author keywords

Free viewpoint video; Multiview stereo; MVS; Point cloud

Indexed keywords

DATA SETS; FREE-VIEWPOINT VIDEO; FRONTIER POINT; MODEL RECONSTRUCTION; MULTI-VIEW STEREO; POINT CLOUD; RECONSTRUCTION ACCURACY; STEREO MATCHING; THREE STAGES; VISUAL HULLS;

MERGING;

ALGORITHM; ARTICLE; COMPUTER GRAPHICS; COMPUTER INTERFACE; METHODOLOGY; PHOTOGRAPHY; THREE DIMENSIONAL IMAGING; VIDEORECORDING;

ALGORITHMS; COMPUTER GRAPHICS; IMAGING, THREE-DIMENSIONAL; PHOTOGRAMMETRY; USER-COMPUTER INTERFACE; VIDEO RECORDING;

EID: 77949659056     PISSN: 10772626     EISSN: None     Source Type: Journal    
DOI: 10.1109/TVCG.2009.88     Document Type: Article

References (44)

1. E.D. Aguiar, C. Stoll, C. Theobalt, N. Ahmed, H.P. Seidel, and S. Thrun, "Performance Capture from Sparse Multi-View Video," Proc. ACM SIGGRAPH '08, vol.27, no.3, pp. 98:1-98:10, 2008.
2. D. Vlasic, I. Baran, W. Matusik, and J. Popovic, "Articulated Mesh Animation from Multi-View Silhouettes," Proc. ACM SIGGRAPH '08, vol.27, no.1, pp. 97-1-97-9, 2008.
3. S.M. Seitz, B. Curless, J. Diebel, D. Scharstein, and R. Szeliski, "A Vomparison and Evaluation of Multi-View Stereo Reconstruction Algorithms," Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition (CVPR '06), pp. 519-528, June 2006.
4. S. Roy and I. Cox, "A Maximum Flow Formulation of the Ncamera Stereo Correspondence Problem," Proc. IEEE Int'l Conf. Computer Vision (ICCV '98), pp. 492-499, Jan. 1998.
5. V. Kolmogorov and R. Zabih, "Multi-Camera Scene Reconstruction via Graph Cuts," Proc. European Conf. Computer Vision (ECCV '02), pp. 82-96, May 2002.
6. G. Vogiatzis, P. Torr, and R. Cipolla, "Multi-View Stereo via Volumetric Graph-Cuts," Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition (CVPR '05), pp. 391-398, 2005.
7. S. Tran and L. Davis, "3D Surface Reconstruction Using Graph Cuts with Surface Constraints," Proc. European Conf. Computer Vision (ECCV '06), May 2006.
8. S.N. Sinha, P. Mordohai, and M. Pollefeys, "Multi-View Stereo via Graph Cuts on the Dual of an Adaptive Tetrahedral Mesh," Proc. IEEE Int'l Conf. Computer Vision (ICCV '07), Oct. 2007.
9. G. Vogiatzis, C.H. Esteban, P.H.S. Torr, and R. Cipolla, "Multi- View Stereo via Volumetric Graph-Cuts and Occlusion Robust Photo-Consistency, " IEEE Trans. Pattern Analysis and Machine Intelligence, vol.29, no.12, pp. 2241-2246, Dec. 2007.
10. K. Kutulakos and S. Seitz, "A Theory of Shape by Space Carving," Int'l J. Computer Vision, vol.38, no.3, pp. 199-218, 2000.
11. G. Slabaugh, B. Culbertson, T. Malzbender, and M. Stevens, "Methods for Volumetric Reconstruction of Visual Scenes," Int'l J. Computer Vision, vol.57, no.3, pp. 179-199, 2004.
12. C.H. Esteban and F. Schmitt, "Silhouette and Stereo Fusion for 3D Object Modeling," Computer Vision and Image Understanding, vol.96, no.3, pp. 367-392, 2004.
13. G. Zeng, S. Paris, L. Quan, and F. Sillion, "Progressive Surface Reconstruction from Images Using a Local Prior," Proc. IEEE Int'l Conf. Computer Vision (ICCV '05), pp. 1230-1237, Oct. 2005.
14. J.-P. Pons, R. Keriven, and O. Faugeras, "Modelling Dynamic Scenes by Registering Multi-View Image Sequences," Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition (CVPR '05), June 2005.
15. A. Zaharescu, E. Boyer, and R. Horaud, "Transformesh: A Topology-Adaptive Mesh-Based Approach to Surface Evolution," Proc. Asian Conf. Computer Vision (ACCV '07), Nov. 2007.
16. Y. Liu, Q. Dai, and W. Xu, "Continuous Depth Estimation for Multi-View Stereo," Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition (CVPR '09), June 2009.
17. P. Gargallo and P. Sturm, "Bayesian 3D Modeling from Images Using Multiple Depth Maps," Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition (CVPR '05), pp. 885-891, June 2005.
18. C. Strecha, R. Fransens, and L.V. Gool, "Combined Depth and Outlier Estimation in Multi-View Stereo," Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition (CVPR '06), June 2006.
19. M. Goesele, B. Curless, and S.M. Seitz, "Multi-View Stereo Revisited," Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition (CVPR '06), June 2006.
20. P. Merrell, A. Akbarzadeh, L. Wang, P. Mordohai, J.-M. Frahm, R. Yang, D. Nister, and M. Pollefeys, "Real-Time Visibility-Based Fusion of Depth Maps," Proc. IEEE Int'l Conf. Computer Vision (ICCV '07), Oct. 2007.
21. C. Zach, T. Pock, and H. Bischof, "A Globally Optimal Algorithm for Robust Tv-l1 Range Image Integration," Proc. IEEE Int'l Conf. Computer Vision (ICCV '07), Oct. 2007.
22. D. Bradley, T. Boubekeur, and T. Berlin, "Accurate Multi-View Reconstruction Using Robust Binocular Stereo and Surface Meshing," Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition (CVPR '08), June 2008.
23. A. Manessis, A. Hilton, P. Palmer, P. McLauchlan, and X. Shen, "Reconstruction of Scene Models from Sparse 3D Structure," Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition (CVPR '00), pp. 666-673, June 2000.
24. Y. Furukawa and J. Ponce, "Accurate, Dense, and Robust Multiview Stereopsis," Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition (CVPR '07), June 2007.
25. M. Goesele, N. Snavely, B. Curless, H. Hoppe, and S.M. Seitz, "Multi-View Stereo for Community Photo Collections," Proc. IEEE Int'l Conf. Computer Vision (ICCV '07), Oct. 2007.
26. M. Habbecke and L. Kobbelt, "A Surface-Growing Approach to Multi-View Stereo Reconstruction," Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition (CVPR '07), June 2007.
27. P. Labatut, J.-P. Pons, and R. Keriven, "Efficient Multi-View Reconstruction of Large-Scale Scenes Using Interest Points, Delaunay Triangulation and Graph Cuts," Proc. IEEE Int'l Conf. Computer Vision (ICCV '07), Oct. 2007.
28. T. Kanade, P. Rander, and P. Narayanan, "Virtualized Reality: Constructing Virtual Worlds from Real Scenes," IEEE Trans. Multimedia, vol.4, no.1, pp. 34-47, Jan.-Mar. 1997.
29. J.-S. Franco, M. Lapierre, and E. Boyer, "Visual Shapes of Silhouette Sets," Proc. Int'l Symp. 3D Data Processing, Visualization and Transmission (3DPVT '06), pp. 397-404, 2006.
30. K. Tomiyama, Y. Orihara, M. Katayama, and Y. Iwadate, "Algorithm for Dynamic 3D Object Generation from Multi- Viewpoint Images," Proc. SPIE '04, pp. 153-161, 2004.
31. T. Matsuyama, X. Wu, T. Takai, and S. Nobuhara, "Real-Time 3D Shape Reconstruction, Dynamic 3D Mesh Deformation, and High Fidelity Visualization for 3D Video," Computer Vision and Image Understanding, vol.96, no.3, pp. 393-434, 2004.
32. J. Starck and A. Hilton, "Virtual View Synthesis of People from Multiple View Video Sequences," Graphical Models, vol.67, no.6, pp. 600-620, 2005.
33. B. Goldluecke and M. Magnor, "Space-Time Isosurface Evolution for Temporally Coherent 3D Reconstruction," Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition (CVPR '04), pp. 350-355, June 2004.
34. J. Starck, G. Miller, and A. Hilton, "Volumetric Stereo with Silhouette and Feature Constraints," Proc. British Machine Vision Conference (BMVC '06), Sept. 2006.
35. J. Starck and A. Hilton, "Surface Capture for Performance Based Animation," IEEE Computer Graphics and Applications, vol.27, no.3, pp. 21-31, July 2007.
36. M. Alexa, J. Behr, D. Cohen-Or, S. Fleishman, D. Levin, and C.T. Silva, "Point Set Surfaces," Proc. IEEE Conf. Visualization, pp. 21- 28, 2001.
37. O. Schall, A. Belyaev, and H-P. Seidel, "Robust Filtering of Noisy Scattered Point Data," Proc. IEEE Symp. Point-Based Graphics (SPG '05), pp. 71-77, 2005.
38. Y. Ohtake, A. Belyaev, M. Alexa, G. Turk, and H.P. Seidel, "Multi- Level Partition of Unity Implicits," ACM Trans. Graphics, vol.22, pp. 463-470, 2003.
39. M. Kazhdan, M. Bolitho, and H. Hoppe, "Poisson Surface Reconstruction," Proc. Fourth Eurographics Symp. Geometry Processing (SGP '06), June 2006.
40. N.D.F. Campbell, G. Vogiatzis, C. Hernandez, and R. Cipolla, "Using Multiple Hypotheses to Improve Depth-Maps for Multi- View Stereo," Proc. European Conf. Computer Vision (ECCV '08), Oct. 2008.
41. P. Merrell, A. Akbarzadeh, L. Wang, P. Mordohai, J.-M. Frahm, R. Yang, D. Nister, and M. Pollefeys, "Real-Time Visibility Based Fusion of Depth Maps," Proc. IEEE Int'l Conf. Computer Vision (ICCV '07), Oct. 2007.
42. Y. Furukawa and J. Ponce, "Carved Visual Hulls for Image-Based Modeling," Int'l J. Computer Vision, vol.81, no.1, pp. 53-67, Mar. 2009.
43. D. Bradley, T. Popa, A. Sheffer, W. Heidrich, and T. Boubekeur, "Markerless Garment Capture," Proc. ACM SIGGRAPH '08, vol.27, no.3, pp. 99-106, 2008.
44. Mview, http://vision.middlebury.edu/mview/, 2009.