Multi-view stereo reconstruction of dense shape and complex appearance

International Journal of Computer Vision

Volumn 63, Issue 3, 2005, Pages 175-189

  Jin, Hailin ^a   Soatto, Stefano ^b   Yezzi, Anthony J ^c  

^a ADOBE RESEARCH   (United States)

^b University of California   (United States)

^c GEORGIA INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

3 D shape reconstruction; Appearance models; Image based modeling and rendering; Level set methods; Multi view stereo; Non Lambertian reflection; Variational methods

Indexed keywords

APPEARANCE MODELS; LEVEL SET METHODS; NON-LAMBERTIAN REFLECTION; STEREO RECONSTRUCTION;

CONSTRAINT THEORY; FUNCTIONS; IMAGE ANALYSIS;

STEREO VISION;

EID: 24044529420     PISSN: 09205691     EISSN: 15731405     Source Type: Journal    
DOI: 10.1007/s11263-005-6876-7     Document Type: Review

References (33)

1. Bhat, D.N. and Nayar, S.K. 1995. Stereo in the presence of specular reflection. In Proc. Int. Conf. on Computer Vision, pp. 1086-1092.
2. Blake, A. 1985. Specular stereo. In Proc. Int. J. Conf. on Artificial Intell., pp. 973-976.
3. Brelstaff, G. and Blake, A. 1988. Detecting specular reflections using Lambertian constraints. In Proc. Int. Conf. on Computer Vision, pp. 297-302.
4. Chan, T.F. and Vese, L.A. 2001. Active contours without edges. IEEE Trans. on Image Processing, 10(2):266-277.
5. Chen, W., Bouguet, J.-Y., Chu, M., and Grzeszczuk, R. 2002. Light field mapping: Efficient representation and hardware rendering of surface light fields. In Proc. ACM SIGGRAPH.
6. Epstein, C.L. and Gage, M. 1987. The curve shortening flow. Wave motion: Theory, modelling, and computation (Berkeley, Calif., 1986), Math. Sci. Res. Inst. Publ., 7:15-59.
7. Faugeras, O. 1993. Three-Dimensional Computer Vision. MIT Press.
8. Faugeras, O. and Keriven, R. 1998. Variational principles, surface evolution, pde's, level set methods and the stereo problem. IEEE Trans. on Image Processing, 7(3):336-344.
9. Gortler, S., Grzeszczuk, R., Szeliski, R., and Cohen, M. 1996. The lumigraph. In Proc. ACM SIGGRAPH, pp. 43-54.
10. Hartley, R. and Zisserman, A. 2000. Multiple View Geometry in Computer Vision. Cambridge University Press.
11. Hertzmann, A. and Seitz, S.M. 2003. Shape and materials by example: A photometric stereo approach. In Proc. IEEE Conf on Comp Vision and Pattern Recogn.
12. Horn, B.K.P. 1986. Robot Vision. MIT Press.
13. Ikeuchi, K. 1981. Determining surface orientations of specular surfaces by using the photometric stereo method. IEEE Trans. on Pattern Analysis and Machine Intell., 3(6):661-669.
14. Jin, H. 2003. Variational methods for shape reconstruction in computer vision. Ph.D. thesis, Washington University, Saint Louis, Missouri.
15. Jin, H., Soatto, S., and Yezzi, A.J. 2004. Multi-view stereo reconstruction of Dense shape and complex Appearance. UCLA CAM Report 04-53, Department of Mathematics, University of California at Los Angeles.
16. Jin, H., Yezzi, A.J., and Soatto, S. 2002. Variational multiframe stereo in the presence of specular reflections. In Proc. of the First Intl. Symp. on 3D Data Processing Visual, and Trans.
17. Jin, H., Yezzi, A.J., and Soatto, S. 2004. Region-based Segmentation on Evolving Surfaces with Application to 3D Reconstruction of Shape and Piecewise Constant Radiance. In Proc. of Euro. Conf. on Computer Vision.
18. Jin, H., Yezzi, A.J., Tsai, Y.-H., Cheng, L.-T., and Soatto, S. 2003. Estimation of 3D surface shape and smooth radiance from 2D images: A level set approach. J. of Scientific Computing, 19(1-3): 267-292.
19. Keriven, R. 1997. Equations aux Dérivées Partielles, Evolutions de Courbes et de Surfaces et Espaces d'Echelle: Applications à la Vision par Ordinateur. Ph.D. thesis. ENPC, France.
20. Kim, J., Kolmogorov, V., and Zabih, R. 2003. Visual correspondence using energy minimization and mutual information. In Proc. of Intl. Conf. on Computer Vision.
21. Kutulakos, K.N. and Seitz, S.M. 2000. A theory of shape by space carving. Int. J. of Computer Vision, 38(3): 199-218.
22. Ma, Y., Soatto, S., Kosecka, J., and Sastry, S. 2003. An Invitation to 3-D Vision. Springer-Verlag.
23. Magda, S., Zickler, T., Kriegman, D.J., and Belhumeur, P.N. 2001. Beyond Lambert: Reconstructing surfaces with arbitrary BRDFs. In Proc. Intl. Conf. on Computer Vision.
24. Nayar, S.K., Fang, X.S., and Boult, T. 1993. Removal of specularities using color and polarization. In Proc. IEEE Conf. on Comp. Vision and Pattern Recogn, pp. 585-590.
25. Nishino, K., Sato, Y., and Ikeuchi, K. 1999. Eigen-texture method: Appearance compression based on 3D model In Proc. IEEE Conf on Comp Vision and Pattern Recogn.
26. Okutomi, M. and Kanade, T. 1993. A multiple baseline stereo. IEEE Trans. on Pattern Analysis and Machine Intell., 15(4):353-363.
27. Osher, S.J. and Sethian, J.A. 1988. Fronts propagating with curvature-dependent speed: algorithms based on hamilton-jacobi equations. J. of Comp. Physics, 79:12-49.
28. Soatto, S., Yezzi, A.J., and Jin, H. 2003. Tales of shape and radiance in multi-view stereo. In Proc. Intl. Conf. on Computer Vision, pp. 171-178.
29. Tsin, Y., Kang, S.B., and Szeliski, R. 2003. Stereo Matching with Reflections and Translucency. In Proc. IEEE Conf. on Comp. Vis. and Patt. Recog.
30. Ward, G. 1992. Measuring and modeling anisotropic reflection. In Proc. ACM SIGGRAPH, pp. 265-272.
31. Yezzi, A.J., and Soatto, S. 2003. Stereoscopic segmentation. Intl. J. of Computer Vision, 53(1):31-43.
32. Yu, Y., Debevec, P., Malik, J., and Hawkins, T. 1999. Inverse global illumination: Recovering reflectance models of real scenes from photographs. In Proc. ACM SIGGRAPH.
33. Zickler, T., Belhumeur, P.N., and Kriegman, D.J. 2002. Helmholtz stereopsis: Exploiting reciprocity for surface reconstruction. Intl. J. of Computer Vision, 49(2/3):215-227.