Fast joint estimation of silhouettes and dense 3D geometry from multiple images

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 34, Issue 3, 2012, Pages 493-505

  Kolev, Kalin ^a   Brox, Thomas ^b   Cremers, Daniel ^a  

^a TECHNICAL UNIVERSITY OF MUNICH   (Germany)

^b UNIVERSITY OF FREIBURG   (Germany)

Author keywords

convex optimization; interactive segmentation; Shape from silhouettes

Indexed keywords

2D IMAGES; 2D SEGMENTATION; 3-D SHAPE; 3D GEOMETRY; 3D RECONSTRUCTION; 3D SURFACE; BACKGROUND CLUTTER; BACKGROUND REGION; BAYESIAN INFERENCE; BEST FIT; CAMERA SENSOR; CLASSICAL METHODS; COLOR INFORMATION; COMPUTATIONAL EFFORT; CONVEX RELAXATION; CORRESPONDING COLORS; GAUSSIANS; GPU IMPLEMENTATION; IMAGE-BASED MODELING; INTERACTIVE SEGMENTATION; JOINT ESTIMATION; MAXIMUM A POSTERIORI; MODEL ASSUMPTIONS; MULTI-VIEW RECONSTRUCTION; MULTI-VIEWS; MULTIPLE IMAGE; PROBABILISTIC FORMULATION; PROBABILISTIC FRAMEWORK; REAL WORLD DATA; SHAPE FROM SILHOUETTES; SHAPE INFERENCE; SILHOUETTE EXTRACTION; SPECULAR REFLECTIONS; USER INPUT; VISUAL HULLS;

BAYESIAN NETWORKS; CONVEX OPTIMIZATION; IMAGE SEGMENTATION; INFERENCE ENGINES; OPTIMIZATION; PARALLEL ARCHITECTURES; RELAXATION PROCESSES; THREE DIMENSIONAL COMPUTER GRAPHICS; VIRTUAL REALITY;

THREE DIMENSIONAL;

EID: 84856158859     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2011.150     Document Type: Article

References (36)

1. X. Bai and G. Sapiro, "A Geodesic Framework for Fast Interactive Image and Video Segmentation and Matting," Proc. IEEE Int'l Conf. Computer Vision, 2007.
2. B. Baumgart, "Geometric Modeling for Computer Vision," PhD thesis, Dept. of Computer Science, Stanford Univ., 1974.
3. A. Blake, C. Rother, M. Brown, P. Perez, and P. Torr, "Interactive Image Segmentation Using an Adaptive GMMRF Model," Proc. European Conf. Computer Vision, pp. 428-441, 2004.
4. Y. Boykov and V. Kolmogorov, "Computing Geodesics and Minimal Surfaces via Graph Cuts," Proc. IEEE Int'l Conf. Computer Vision, pp. 26-33, 2003.
5. Y.Y. Boykov and M.P. Jolly, "Interactive Graph Cuts for Optimal Boundary & Region Segmentation of Objects in N-D Images," Proc. IEEE Int'l Conf. Computer Vision, vol. 1, pp. 105-112, 2001. (Pubitemid 32794944)
6. N.D.F. Campbell, G. Vogiatzis, C. Hernández, and R. Cipolla, "Automatic 3D Object Segmentation in Multiple Views Using Volumetric Graph-Cuts," Proc. 18th British Machine Vision Conf., vol. 1, pp. 530-539, 2007.
7. T. Chan, S. Esedolu, and M. Nikolova, "Algorithms for Finding Global Minimizers of Image Segmentation and Denoising Models," SIAM J. Applied Math., vol. 66, no. 5, pp. 1632-1648, 2006. (Pubitemid 44599935)
8. A.X. Falcao, J. Stolfi, and R.A. Lotufo, "The Image Foresting Transform: Theory, Algorithms, and Applications," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 26, no. 1, pp. 19-29, Jan. 2004.
9. J.-S. Franco and E. Boyer, "Fusion of Multi-View Silhouette Cues Using a Space Occupancy Grid," Proc. IEEE Int'l Conf. Computer Vision, 2005.
10. Y. Furukawa and J. Ponce, "Accurate, Dense, and Robust Multi-View Stereopsis," Proc. IEEE Conf. Computer Vision and Pattern Recognition, June 2007.
11. L.M. Goldschlager, R.A. Shaw, and J. Staples, "The Maximum Flow Problem Is Log Space Complete for p," Theoretical Computer Science, vol. 21, pp. 105-111, 1982.
12. L. Grady, "Random Walks for Image Segmentation," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 11, pp. 1768-1783, Nov. 2006. (Pubitemid 46405425)
13. L. Guan, J.S. Franco, and M. Pollefeys, "3D Occlusion Inference from Silhouette Cues," Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, 2007.
14. C. Hernandez and F. Schmitt, "Silhouette and Stereo Fusion for 3D Object Modeling," Computer Vision and Image Understanding, vol. 96, no. 3, pp. 367-392, 2004.
15. R. Keriven, "A Variational Framework to Shape from Contours," Technical Report 2002-221, CERMICS, 2002.
16. M. Klodt, T. Schoenemann, K. Kolev, M. Schikora, and D. Cremers, "An Experimental Comparison of Discrete and Continuous Shape Optimization Methods," Proc. European Conf. Computer Vision, Oct. 2008.
17. K. Kolev, T. Brox, and D. Cremers, "Robust Variational Segmentation of 3D Objects from Multiple Views," Proc. DAGM Symp. Pattern Recognition, K. Franke et al., eds., pp. 688-697, Sept. 2006. (Pubitemid 44608914)
18. K. Kolev and D. Cremers, "Integration of Multiview Stereo and Silhouettes via Convex Functionals on Convex Domains," Proc. European Conf. Computer Vision, Oct. 2008.
19. K. Kolev, M. Klodt, T. Brox, and D. Cremers, "Continuous Global Optimization in Multiview 3D Reconstruction," Int'l J. Computer Vision, vol. 84, no. 1, pp. 80-96, Aug. 2009.
20. A. Laurentini, "The Visual Hull Concept for Visual-Based Image Understanding," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 16, no. 2, pp. 150-162, Feb. 1994.
21. Y. Li, J. Sun, and H.-Y. Shum, "Video Object Cut and Paste," ACM Trans. Graphics, vol. 24, no. 3, pp. 595-600, 2005.
22. J. Liu and J. Sun, "Parallel Graph-Cuts by Adaptive Bottom-Up Merging," Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, 2010.
23. W.N. Martin and J.K. Aggarwal, "Volumetric Descriptions of Objects from Multiple Views," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 5, no. 2, pp. 150-158, Mar. 1983. (Pubitemid 13555900)
24. D. Mumford and J. Shah, "Optimal Approximations by Piecewise Smooth Functions and Associated Variational Problems," Comm. Pure and Applied Math., vol. 42, pp. 577-685, 1989.
25. T. Pock, D. Cremers, H. Bischof, and A. Chambolle, "An Algorithm for Minimizing the Piecewise Smooth Mumford-Shah Functional," Proc. IEEE Int'l Conf. Computer Vision, 2009.
26. M. Potmesil, "Generating Octree Models of 3D Objects from Their Silhouettes from a Sequence of Images," Computer Vision, Graphics, and Image Processing, vol. 40, no. 1, pp. 1-29, 1987.
27. C. Rother, V. Kolmogorov, and A. Blake, "GrabCut: Interactive Foreground Extraction Using Iterated Graph Cuts," ACM Trans. Graphics, vol. 23, no. 3, pp. 309-314, 2004.
28. C. Rother, V. Kolmogorov, T. Minka, and A. Blake, "Cosegmentation of Image Pairs by Histogram Matching-Incorporating a Global Constraint into MRFs," Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, pp. 993-1000, 2006.
29. D. Snow, P. Viola, and R. Zabih, "Exact Voxel Occupancy with Graph Cuts," Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 345-353, 2000.
30. P. Strandmark and F. Kahl, "Parallel and Distributed Graph Cuts by Dual Decomposition," Proc. Int'l Conf. Computer Vision and Pattern Recognition, 2010.
31. R. Szeliski, "Rapid Octree Construction from Image Sequences," Computer Vision, Graphics, and Image Processing, vol. 58, no. 1, pp. 23-32, 1993.
32. J.K. Udupa and P.K. Saha, "Fuzzy Connectedness and Image Segmentation," Proc. IEEE, vol. 91, no. 10, pp. 1649-1669, Oct. 2003. (Pubitemid 40890809)
33. M. Unger, T. Pock, D. Cremers, and H. Bischof, "TVSeg-Interactive Total Variation Based Image Segmentation," Proc. British Machine Vision Conf., Sept. 2008.
34. V. Vineet and P.J. Narayanan, "Cuda Cuts: Fast Graph Cuts on the Gpu," Proc. Computer Vision and Pattern Recognition Workshop, pp. 1-8, 2008.
35. J. Wang, P. Bhat, R.A. Colburn, M. Agrawala, and M.F. Cohen, "Interactive Video Cutout," ACM Trans. Graphics, vol. 24, no. 3, pp. 585-594, 2005.
36. A. Yezzi and S. Soatto, "Stereoscopic Segmentation," Proc. Eighth IEEE Int'l Conf. Computer Vision, vol. 1, pp. 59-66, July 2001. (Pubitemid 32794938)