Gradient flows for optimizing triangular mesh-based surfaces: Applications to 3D reconstruction problems dealing with visibility

International Journal of Computer Vision

Volumn 95, Issue 2, 2011, Pages 100-123

  Delaunoy, Amaël ^a   Prados, Emmanuel ^a  

^a INRIA RHÔNE ALPES   (France)

Author keywords

3D reconstruction; Gradient descent flow; Multi view stereovision; Shape gradient; Surface evolution; Triangle mesh based surface; Variational methods; Visibility

Indexed keywords

3D RECONSTRUCTION; GRADIENT DESCENT FLOW; MULTI-VIEWS; SHAPE GRADIENT; SURFACE EVOLUTION; TRIANGLE MESH-BASED SURFACE; VARIATIONAL METHODS;

COMPUTER GRAPHICS; COMPUTER VISION; MESH GENERATION; OPTIMIZATION; VISIBILITY;

THREE DIMENSIONAL;

EID: 80052666180     PISSN: 09205691     EISSN: 15731405     Source Type: Journal    
DOI: 10.1007/s11263-010-0408-9     Document Type: Article

References (49)

1. Bertalmio, M., Sapiro, G., Cheng, L.-T., & Osher, S. (2001). Variational problems and pdes on implicit surfaces. Variational and Level Set Methods in Computer Vision.
2. Birkbeck, N., Cobzas, D., Sturm, P., & Jägersand, M. (2006). Variational shape and reflectance estimation under changing light and viewpoints. In Proceedings of European conference on computer vision (Vol. 1, pp. 536-549). (Pubitemid 44029805)
3. Chang, J. Y., Lee, K. M., & Lee, S. U. (2007). Multiview normal field integration using level set methods. In IEEE conference in computer vision and pattern recognition. Washington: IEEE Computer Society.
4. G. Charpiat P. Maurel J.-P. Pons R. Keriven O. Faugeras 2007 Generalized gradients: Priors on minimization flows International Journal of Computer Vision 73 3 325 344 10.1007/s11263-006-9966-2 (Pubitemid 46227278)
5. Debreuve, É., Gastaud, M., Barlaud, M., & Aubert, G. (2007). Using the shape gradient for active contour segmentation: from the continuous to the discrete formulation. Journal of Mathematical Imaging and Vision.
6. Delaunoy, A., Prados, E., Gargallo, P., Pons, J.-P., & Sturm, P. (2008). Minimizing the multi-view stereo reprojection error for triangular surface meshes. In British machine and vision conference, Leeds, UK, 2008.
7. Desbrun, M., Meyerm, M., Schröder, P., & Barr, A. (1999). Implicit fairing of irregular meshes using diffusion and curvature flow. In SIGGRAPH '99 (pp. 317-324).
8. Duan, Y., Yang, L., Qin, H., & Samaras, D. (2004). Shape reconstruction from 3d and 2d data using pde-based deformable surfaces. In European conference on computer vision, Prague, Czech Republic (pp. 238-251).
9. G. Dziuk C. M. Elliott 2007 Finite elements on evolving surfaces IMA Journal of Numerical Analysis 27 2 262 292 2317005 1120.65102 10.1093/imanum/drl023
10. Eckstein, I., Pons, J.-P., Tong, Y., Kuo, C.-C. J., & Desbrun, M. (2007). Generalized surface flows for mesh processing. In Eurographics symposium on geometry processing.
11. O. D. Faugeras R. Keriven 1998 Variational-principles, surface evolution, pdes, level set methods, and the stereo problem IEEE Transactions on Image Processing 7 3 336 344 1669532 0973.94004 10.1109/83.661183 (Pubitemid 128745351)
12. Gargallo, P. (2008). Contributions to the Bayesian approach to Multi-view Stereo. PhD thesis, Institut National Polytechique de Grenoble, France, February.
13. Gargallo, P., Prados, E., & Sturm, P. (2007). Minimizing the reprojection error in surface reconstruction from images. In Proceedings of the international conference on computer vision, Rio de Janeiro, Brazil. Los Alamitos: IEEE Computer Society Press.
14. B. Goldlucke I. Ihrke C. Linz M. Magnor 2007 Weighted minimal hypersurface reconstruction IEEE Transactions on Pattern Analysis and Machine Intelligence 29 7 1194 1208 10.1109/TPAMI.2007.1146 (Pubitemid 46825069)
15. Goldlücke, B., & Magnor, M. A. (2004). Weighted minimal hypersurfaces and their applications in computer vision. In T. Pajdla & J. Matas (Eds.), Lecture notes in computer science: Vol. 3022. European conference on computer vision (pp. 366-378). Berlin: Springer.
16. R. Gupta R. I. Hartley 1997 Linear pushbroom cameras IEEE Transactions on Pattern Analysis and Machine Intelligence 19 9 963 975 10.1109/34.615446 (Pubitemid 127762287)
17. C. Hernandez F. Schmitt 2004 Silhouette and stereo fusion for 3d object modeling Computer Vision and Image Understanding 96 3 367 392 10.1016/j.cviu.2004.03.016
18. C. Hernandez G. Vogiatzis R. Cipolla 2008 Multiview photometric stereo IEEE Transactions on Pattern Analysis and Machine Intelligence 30 3 548 554 10.1109/TPAMI.2007.70820 (Pubitemid 351280061)
19. Jin, H., Yezzi, A. J., & Soatto, S. (2002). Variational multiframe stereo in the presence of specular reflections. In 3DPVT (pp. 626-630).
20. H. Jin S. Soatto A. J. Yezzi 2005 Multi-view stereo reconstruction of dense shape and complex appearance International Journal of Computer Vision 63 3 175 189 10.1007/s11263-005-6876-7 (Pubitemid 41217745)
21. Jin, H., Cremers, D., Wang, D., Prados, E., Yezzi, A., & Soatto, S. (2008). 3-d reconstruction of shaded objects from multiple images under unknown illumination. International Journal of Computer Vision, 76(3).
22. Kolev, K., & Cremers, D. (2008). Integration of multiview stereo and silhouettes via convex functionals on convex domains. In European conference on computer vision, Oct 2008.
23. Kolev, K., & Cremers, D. (2009). Continuous ratio optimization via convex relaxation with applications 3D multiview reconstruction. In IEEE conference on computer vision and pattern recognition.
24. Kolev, K., Klodt, M., Brox, T., & Cremers, D. (2009). Continuous global optimization in multiview 3D reconstruction. In International Journal of Computer Vision.
25. Kolev, K., Pock, T., & Cremers, D. (2010) Anisotropic minimal surfaces integrating photoconsistency and normal information for multiview stereo. In European conference on computer vision 2010.
26. Kolmogorov, & Zabih (2004). What energy functions can be minimized via graph cuts. IEEETPAMI: IEEE Transactions on Pattern Analysis and Machine Intelligence, 26.
27. Labatut, P., Keriven, R., & Pons, J.-P. (2006). Fast level set multi-view stereo on graphics hardware. In 3DPVT '06: Proceedings of the third international symposium on 3d data processing, visualization, and transmission (3DPVT'06), Washington, DC, USA (pp. 774-781). Washington: IEEE Computer Society.
28. Meyer, M., Desbrun, M., Schröder, P., & Barr, A. H. (2002). Discrete differential-geometry operators for triangulated 2-manifolds.
29. Nehab, D., Rusinkiewicz, S., Davis, J., & Ramamoorthi, R. (2005). Efficiently combining positions and normals for precise 3D geometry. In SIGGRAPH (pp. 536-543).
30. S. Osher J. A. Sethian 1988 Fronts propagating with curvature-dependent speed: Algorithms based on Hamilton-Jacobi formulations Journal of Computational Physics 79 12 49 965860 0659.65132 10.1016/0021-9991(88)90002-2
31. J.-P. Pons J.-D. Boissonnat 2007 A Lagrangian approach to dynamic interfaces through kinetic triangulation of the ambient space Computer Graphics Forum 26 2 227 239 10.1111/j.1467-8659.2007.01029.x (Pubitemid 46792074)
32. Pons, J.-P., Keriven, R., & Faugeras, O. (2005). Modelling dynamic scenes by registering multi-view image sequences. In IEEE conference on computer vision and pattern recognition, San Diego, USA (pp. 822-827).
33. J.-P. Pons R. Keriven O. Faugeras 2007 Multi-view stereo reconstruction and scene flow estimation with a global image-based matching score The International Journal of Computer Vision 72 2 179 193 10.1007/s11263-006-8671-5 (Pubitemid 46094759)
34. Seitz, S. M., Curless, B., Diebel, J., Scharstein, D., & Szeliski, R. (2006). A comparison and evaluation of multi-view stereo reconstruction algorithms. In IEEE conference on computer vision and pattern recognition (pp. 519-528).
35. Sinha, S. N., & Pollefeys, M. (2005). Multi-view reconstruction using photo-consistency and exact silhouette constraints: a maximum-flow formulation. In IEEE international conference on computer vision (pp. 349-356). (Pubitemid 44054979)
36. Slabaugh, G., & Unal, G. (2005). Active polyhedron: surface evolution theory applied to deformable meshes. In IEEE conference on computer vision and pattern recognition (Vol. 2, pp. 84-91).
37. Soatto, S., Yezzi, A. J., & Jin, H. (2003). Tales of shape and radiance in multi-view stereo. In IEEE international conference on computer vision (pp. 974-981).
38. J. E. Solem A. Heyden 2006 Reconstructing open surfaces from image data Int. J. Comput. Vision 69 3 267 275 10.1007/s11263-006-7068-9 (Pubitemid 43847172)
39. Solem, J. E., & Overgaard, N. Chr. (2005). A geometric formulation of gradient descent for variational problems with moving surfaces. In R. Kimmel, N. Sochen, & J. Weickert (Eds.), LNCS: Vol. 3459. Scale-Space 2005 (pp. 419-430). Berlin: Springer. (Pubitemid 41274243)
40. Solem, J. E., Aanaes, H., & Heyden, A. (2004). A variational analysis of shape from specularities using sparse data. In 3DPVT '04: Proceedings of the 3D data processing, visualization, and transmission, 2nd international symposium, Washington, DC, USA, 2004 (pp. 26-33). Washington: IEEE Computer Society. (Pubitemid 40456273)
41. D. Vlasic P. Peers I. Baran P. Debevec J. Popović S. Rusinkiewicz W. Matusik 2009 Dynamic shape capture using multi-view photometric stereo ACM Transactions on Graphics 28 5 174 10.1145/1618452.1618520
42. G. Vogiatzis C. Hernández Esteban P. H. S. Torr R. Cipolla 2007 Multiview stereo via volumetric graph-cuts and occlusion robust photo-consistency IEEE Transactions on Pattern Analysis and Machine Intelligence 29 12 2241 2246 10.1109/TPAMI.2007.70712 (Pubitemid 350124071)
43. Vu, H., Keriven, R., Labatut, P., & Pons, J.-P. (2009). Towards high-resolution large-scale multi-view stereo. In IEEE conference on computer vision and pattern recognition, Jun 2009.
44. R. T. Whitaker 1998 A level-set approach to 3d reconstruction from range data International Journal of Computer Vision 29 3 203 231 10.1023/A: 1008036829907 (Pubitemid 128517911)
45. Yezzi, A. J., & Soatto, S. (2001). Stereoscopic segmentation. In IEEE international conference on computer vision.
46. A. Yezzi S. Soatto 2003 Stereoscopic segmentation International Journal of Computer Vision 53 1 31 43 2028845 10.1023/A:1023079624234
47. Yoon, K.-J., Prados, E., & Sturm, P. (2009, to appear). Joint estimation of shape and reflectance using multiple images with known illumination conditions. International Journal of Computer Vision.
48. T. Yu N. Xu N. Ahuja 2007 Shape and view independent reflectance map from multiple views International Journal of Computer Vision 73 2 123 138 10.1007/s11263-006-9373-8 (Pubitemid 46181620)
49. Zaharescu, A., Boyer, E., & Horaud, R. P. (2007). Transformesh: a topology-adaptive mesh-based approach to surface evolution. In Proceedings Asian conference on computer vision, Tokyo, Japan, November 2007.