Multi-view stereo reconstruction and scene flow estimation with a global image-based matching score

International Journal of Computer Vision

Volumn 72, Issue 2, 2007, Pages 179-193

  Pons, Jean Philippe ^a   Keriven, Renaud ^a   Faugeras, Olivier ^b  

^a UNIVERSITÉ PARIS EST   (France)

^b INRIA   (France)

Author keywords

Cross correlation; Global image based matching score; Level sets; Mutual information; Non Lambertian surface; Non rigid 3D motion; Prediction error; Registration; Reprojection error; Scene flow; Stereovision; Variational method

Indexed keywords

ALGORITHMS; ERROR DETECTION; GRAPHIC METHODS; IMAGE RECONSTRUCTION; MOTION ESTIMATION; PROBLEM SOLVING; ROBUSTNESS (CONTROL SYSTEMS); SIGNAL FILTERING AND PREDICTION; VARIATIONAL TECHNIQUES;

CROSS CORRELATION; DATASETS; GLOBAL IMAGE-BASED MATCHING SCORE; GRAPHICS PROCESSOR; LAMBERTIAN MATERIALS; LEVEL SETS; MULTIPLE VIDEO SEQUENCES; MUTUAL INFORMATION; REPROJECTION ERROR; SCENE FLOW ESTIMATION;

STEREO VISION;

EID: 33846218708     PISSN: 09205691     EISSN: 15731405     Source Type: Journal    
DOI: 10.1007/s11263-006-8671-5     Document Type: Article

References (39)

1. Barron, J., Fleet, D., and Beauchemin, S. 1994. Performance of optical flow techniques. The International Journal of Computer Vision, 12(1):43-77.
2. Boykov, Y. and Kolmogorov, V. 2003. Computing geodesics and minimal surfaces via graph cuts. In International Conference on Computer Vision, 1:26-33.
3. Broadhurst, A., Drummond, T., and Cipolla, R. 2001. A probabilistic framework for space carving. In International Conference on Computer Vision, 1:388-393.
4. Carceroni, R. and Kutulakos, K. 2002. Multi-view scene capture by surfel sampling: From video streams to non-rigid 3 D motion, shape and reflectance. The International Journal of Computer Vision, 49(2-3):175-214.
5. Caselles, V., Kimmel, R., and Sapiro, G. 1997. Geodesic active contours. The International Journal of Computer Vision, 22(1):61-79.
6. Duan, Y., Yang, L., Qin, H., and Samaras, D. 2004. Shape reconstruction from 3D and 2D data using PDE-based deformable surfaces. In European Conference on Computer Vision, 3:238-251.
7. Faugeras, O. and Hermosillo, G. 2004. Well-posedness of two non-rigid multimodal image registration methods. Siam Journal of Applied Mathematics, 64(5):1550-1587.
8. Faugeras, O. and Keriven, R. 1998. Variational principles, surface evolution, PDE's, level set methods and the stereo problem. IEEE Transactions on Image Processing, 7(3):336-344.
9. Goldlücke, B. and Magnor, M. 2004a. Space-time isosurface evolution for temporally coherent 3D reconstruction. In International Conference on Computer Vision and Pattern Recognition, 1:350-355.
10. Goldlücke, B. and Magnor, M. 2004b. Weighted minimal hyper-surfaces and their applications in computer vision. In European Conference on Computer Vision, 2:366-378.
11. Hermosillo, G., Chefd'hotel, C., and Faugeras, O. 2002. Variational methods for multimodal image matching. The International Journal of Computer Vision, 50(3):329-343.
12. Hernández Esteban, C. and Schmitt, F. 2004. Silhouette and stereo fusion for 3D object modeling. Computer Vision and Image Understanding, 96(3):367-392.
13. Jin, H., Soatto, S., and Yezzi, A. 2005. Multi-view stereo reconstruction of dense shape and complex appearance. The International Journal of Computer Vision, 63(3):175-189.
14. Kanade, T. and Okutomi, M. 1994. A stereo matching algorithm with an adaptive window: Theory and experiment. IEEE Transactions on Pattern Analysis and Machine Intelligence, 16(9):920-932.
15. Kass, M., Witkin, A., and Terzopoulos, D. 1987. Snakes: Active contour models. The International Journal of Computer Vision, 1(4):321-331.
16. Kolmogorov, V. and Zabih, R. 2002. Multi-camera scene reconstruction via graph cuts. In European Conference on Computer Vision, 3:82-96.
17. Kolmogorov, V. and Zabih, R. 2004. What energy functions can be minimized via graph cuts? IEEE Transactions on Pattern Analysis and Machine Intelligence, 26(2):147-159.
18. Kutulakos, K. 2000. Approximate n-view stereo. In European Conference on Computer Vision, 1:67-83.
19. Kutulakos, K. and Seitz, S. 2000. A theory of shape by space carving. The International Journal of Computer Vision, 38(3):199-218.
20. Lhuillier, M. and Quan, L. 2003. Surface reconstruction by integrating 3D and 2D data of multiple views. In International Conference on Computer Vision, 2:1313-1320.
21. Neumann, J. and Aloimonos, Y 2002. Spatio-temporal stereo using multi-resolution subdivision surfaces. The International Journal of Computer Vision, 47:181-193.
22. Osher, S. and Sethian, J. 1988. Fronts propagating with curvature-dependent speed: Algorithms based on Hamilton-Jacobi formulations. Journal of Computational Physics, 79(1):12-49.
23. Parzen, E. 1962. On estimation of a probability density function and mode. Annals Mathematical Statistics, 33:1065-1076.
24. Roche, A., Malandain, G., Pennec, X., and Ayache, N. 1998. The correlation ratio as new similarity metric for multimodal image registration. In W. Wells, A. Colchester, and S. Delp (Eds.), Medical Image Computing and Computer-Assisted Intervention-MICCAI'98. Cambridge, MA, USA, pp. 1115-1124.
25. Scharstein, D. and Szeliski, R. 1998. Stereo matching with non-linear diffusion. The International Journal of Computer Vision, 28(2):155-174.
26. Scharstein, D. and Szeliski, R. 2002. A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. The International Journal of Computer Vision, 47(1):7-42.
27. Segal, M., Korobkin, C., van Widenfelt, R., Foran, J., and Haeberli P. 1992. Fast shadows and lighting effects using texture mapping. Computer Graphics, 26(2):249-252.
28. Seitz, S. and Dyer, C. 1999. Photorealistic scene reconstruction by voxel coloring. The International Journal of Computer Vision, 35(2):151-173.
29. Soatto, S., Yezzi, A., and Jin, H. 2003. Tales of shape and radiance in multi-view stereo. In International Conference on Computer Vision, 2:974-981.
30. Solem, J. and Overgaard, N. 2005. A geometric formulation of gradient descent for variational problems with moving surfaces. In International Conference on Scale Space and PDE Methods in Computer Vision, pp. 419-430.
31. Strecha, C., Fransens, R., and Van Gool, L. 2004. Wide-baseline stereo from multiple views: A probabilistic account. In International Conference on Computer Vision and Pattern Recognition, 2:552-559.
32. Strecha, C., Tuytelaars, T., and Van Gool, L. 2003. Dense matching of multiple wide-baseline views. In International Conference on Computer Vision, 2:1194-1201.
33. Szeliski, R. 1999. Prediction error as a quality metric for motion and stereo. In International Conference on Computer Vision, 2:781-788.
34. Treuille, A., Hertzmann, A., and Seitz, S. 2004. Example-based stereo with general brdfs. In European Conference on Computer Vision, 2:457-469.
35. Vedula, S., Baker, S., and Kanade, T. 2002. Spatio-temporal view interpolation. In ACM Eurographics Workshop on Rendering, pp. 65-76.
36. Vedula, S., Baker, S., Rander, P., Collins, R., and Kanade, T. 2005. Three-dimensional scene flow. IEEE Transactions on Pattern Analysis and Machine Intelligence, 27(3):475-480.
37. Viola, P. and Wells III, W M. 1997. Alignement by maximization of mutual information. The International Journal of Computer Vision, 24(2):137-154.
38. Yang, R., Pollefeys, M., and Welch, G. 2003. Dealing with texture-less regions and specular highlights: A progressive space carving scheme using a novel photo-consistency measure. In International Conference on Computer Vision, 1:576-584.
39. Zhang, Y. and Kambhamettu, C. 2001. On 3D scene flow and structure estimation. In International Conference on Computer Vision and Pattern Recognition, 2:778-785.