Multi-scale 3D scene flow from binocular stereo sequences

Computer Vision and Image Understanding

Volumn 110, Issue 1, 2008, Pages 75-90

  Li, Rui ^a   Sclaroff, Stan ^a  

^a BOSTON UNIVERSITY   (United States)

Author keywords

Discontinuity; Disparity; Optical flow; Over regularization; Scene flow; Stereo

Indexed keywords

CAMERAS; DATA VISUALIZATION; IMAGE RECONSTRUCTION; MOTION ESTIMATION; OPTICAL FLOWS; THREE DIMENSIONAL;

DISCONTINUITY; DISPARITY; OVER REGULARIZATION; SCENE FLOW;

BINOCULAR VISION;

EID: 40649125529     PISSN: 10773142     EISSN: 1090235X     Source Type: Journal    
DOI: 10.1016/j.cviu.2007.04.002     Document Type: Article

References (64)

1. Alvarez L., Deriche R., Weickert J., and Sánchez J. Dense disparity map estimation respecting image discontinuities: a PDE and scale-space based approach. International Journal of Visual Communication and Image Representation 13 (2001) 3-21
2. Alvarez L., Weickert J., and Sánchez J. Reliable estimation of dense optical flow fields with large displacements. IJCV 39 1 (2000) 41-56
3. S. Avidan, A. Shashua, Non-rigid parallax for 3D linear motion, in: CVPR, 1998, pp. 62-66.
4. N. Ayache, F. Lustman, Fast and reliable passive trinocular stereovision, in: Proc. ICCV, 1987, pp. 422-427.
5. Barron J., Fleet D., and Beauchemin S. Performance of optical flow techniques. IJCV 12 1 (1995) 43-77
6. Black M., and Jepson A. Estimating optical flow in segmented images using variable-order parametric models with local deformations. PAMI 18 10 (1996) 972-986
7. Brint A., and Brady M. Stereo matching of curves. Image and Vision Computing 8 1 (1990) 50-56
8. T. Brox, A. Bruhn, J. Wickert, Variational motion segmentation with level sets, in: ECCV, 2006, pp. 471-483.
9. Comaniciu D., and Meer P. Mean shift: a robust approach toward feature space analysis. PAMI 24 5 (2002) 603-619
10. Costeira J.P., and Kanade T. A multibody factorization method for independently moving objects. IJCV 29 3 (1998) 159-179
11. J. Davis, R. Ramamoorthi, S. Rusinkiewicz, Spacetime stereo: a unifying framework for depth from triangulation, in: CVPR, 2003.
12. F. Devernay, O. Faugeras, Computing differential properties of 3D shapes from stereoscopic image without 3D models, in: CVPR, 1994, pp. 208-213.
13. Fleet D., and Jepson A. Computation of component image velocity from local phase information. IJCV 5 (1990) 77-104
14. Fua P. A parallel stereo algorithm that produces dense depth maps and preserves image features. Machine Vision and Applications 6 1 (1993) 35-49
15. S.B. Gokturk, J.-Y. Bouguet, R. Grzeszczuk, A data-drive model for monocular face tracking, in: Proc. ICCV, 2001, pp. 701-708.
16. Grimson W. Computational experiments with a feature based stereo algorithm. PAMI 7 1 (1985) 17-34
17. Heeger D.J. Model for the extraction of image flow. Journal of the Optical Society of America A 4 8 (1987) 1455-1471
18. B. Heisele, U. Krebel, W. Ritter, Tracking non-rigid, moving objects based on color cluster flow, in: CVPR, 1997, pp. 253-257.
19. Heitz F., Pérez P., and Bouthemy P. Recovering local surface structure through local phase different methods. CVGIP: Image Understanding 59 1 (1994) 125-134
20. Horn B., and Schunck B. Determining optical flow. Artificial Intelligence 17 1-3 (1981) 185-203
21. Jenkin M., and Jepson A. Recovering local surface structure through local phase different methods. CVGIP: Image Understanding 59 (1994) 72-93
22. Jenkin M., Jepson A., and Tsotsos J. Techniques for disparity measurement. CVGIP: Image Understanding 53 1 (1991) 14-30
23. Kalivas D., and Sawchuk A. A region matching motion estimation algorithm. CVGIP: Image Understanding 54 2 (1991) 275-288
24. Langley K., Atherton T., Wilson R., and Lacombe M. Vertical and horizontal disparities from phase. Image and Vision Computing 9 4 (1991) 296-302
25. Liao W.-H., Aggrawal S.J., and Aggrawal J.K. The reconstruction of dynamic 3D structure of biological objects using stereo microscope images. Machine Vision and Applications 9 (1997) 166-178
26. Lin M., and Tomasi C. Surfaces with occlusions from layered stereo. PAMI 26 8 (2004) 710-717
27. J. Little, H. Butlhoff, T. Poggio, Parallel optical flow using local voting, in: Proc. ICCV, 1988, pp. 454-459.
28. B. Lucas, Generalized image matching by the method of differences, Ph.D. Thesis, Carnegie Mellon University, 1984.
29. B.D. Lucas, T. Kanade, An interactive image registration technique with an application to stereo vision, in: IJCAI, 1981, pp. 674-679.
30. Malassiotis S., and Strintzis M.G. Model-based joint motion and structure estimation from stereo images. CVIU 65 1 (1997) 79-94
31. Metaxas D., and Terzopoulos D. Shape and nonrigid motion estimation through physics-based synthesis. PAMI 15 6 (1993) 580-591
32. D. Mukherjee, Y. Deng, S. Mitra, Region based video coder using edge flow segmentation and hierarchical affine region matching, in: SPIE, Visual Communications and Image Processing, 1998, pp. 338-349.
33. H. Nagel, Extending the oriented smoothness constraint into the temporal domain and the estimation of derivatives of optic flow, in: ECCV, 1990, pp. 139-148.
34. Papenberg N., Bruhn A., Brox T., Didas S., and Weickert J. Highly accurate optic flow computation with theoretically justified warping. IJCV 67 2 (2006) 141-158
35. Pentland A.P., and Horowitz B. Recovery of nonrigid motion and structure. PAMI 13 7 (1991) 730-742
36. J. Pons, R. Keriven, O. Faugeras, G. Hermosillo, Variational stereovision and 3d scene flow estimation with statistical similarity measures, in: Proc. ICCV, 2003.
37. L. Robert, R. Deriche, Dense depth map reconstruction: a minimization and regularization approach which preserves discontinuities, in: ECCV, 1996, pp. 439-451.
38. Scharstein D., and Szeliski R. A taxonomy and evaluation of dense two-frame correspondence. IJCV 47 (2002) 7-42
39. Scharstein D., and Szeliski R. A taxonomy and evaluation of dense two-frame stereo correspondence algorithm. IJCV 47 1/2/3 (2002) 7-42
40. J. Shah, A nonlinear diffusion model for discontinuous disparity and half-occulusions in stereo, in: CVPR, 1993, pp. 34-40.
41. Shi Y.Q., Shu C.Q., and Pan J.N. Unified optical flow field approach to motion analysis from a sequence of stereo images. Pattern Recognition 27 12 (1994) 1577-1590
42. Simoncelli E.P. Bayesian multi-scale differential optical flow. In: Jahne B., Haussecker H., and Geissler P. (Eds). Handbook of Computer Vision and Applications (1999), Academic Press 397-422 (Chapter 14)
43. E.P. Simoncelli, E.H. Adelson, D.J. Heeger, Probability distributions of optical flow, in: CVPR, 1991.
44. Strang G. Introduction to Applied Mathematics (1986), Wellesley-Cambridge Press
45. H. Tao, H.S. Sawhney, R. Kumar, Dynamic depth recovery from multiple synchronized video sequences, in: CVPR, 2001, pp. 118-124.
46. L. Torresani, A. Hertzman, C. Bregler, Learning non-rigid 3D shape from 2D motion, in: Proc. NIPS, 2003, pp. 1555-1562.
47. Ullman S. The Interpretation of Visual Motion (1979), MIT Press
48. Ullman S. Maximizing the rigidity: the incremental recovery of 3-D shape and nonrigid motion. Perception 13 (1984) 730-742
49. http://www.cs.brown.edu/people/black/Sequences/yosemite.tar.gz.
50. http://www.middlebury.edu/stereo.
51. S. Vedula, S. Baker, P. Rander, R. Collins, T. Kanade, Three-dimensional scene flow, in: Proc. ICCV, vol. 2, 1999, pp. 722-729.
52. Wang J., and Adelson E.H. Representing moving images with layers. IEEE Transactions on Image Processing 3 5 (1994) 625-638
53. Waxman A.M., and Duncan J.H. Binocular image flows: steps toward stereo-motion fusion. PAMI 8 6 (1986) 715-729
54. J. Weng, A theory of image matching, in: Proc. ICCV, 1990, pp. 200-209.
55. J. Wiklund, C. Westelius, H. Knutsson, Hierachical phase based disparity estimation, in: Proc. ICIP, 1992, pp. 128-131.
56. J. Xiao, J. Chai, T. Kanade, A closed-form solution to non-rigid shape and motion recovery, in: ECCV, 2004, pp. 233-246.
57. Young G.S., and Chellappa R. 3-D motion estimation using a sequence of noisy stereo images: models, estimation, and uniqueness. PAMI 12 8 (1999) 735-759
58. L. Zhang, B. Curless, S.M. Seitz, Spacetime stereo: shape recovery for dynamic scenes, in: CVPR, 2003.
59. Y. Zhang, C. Kambhamettu, Integrated 3D scene flow and structure recovery from multiview image sequences, in: CVPR, 2000.
60. Y. Zhang, C. Kambhamettu, On 3D scene flow and structure estimation, in: CVPR, 2001.
61. Zhang Z., and Faugeras O. 3D Dynamic Scene Analysis (1992), Springer-Verlag
62. Zhang Z., and Faugeras O. Estimation of displacements from two 3-D frames obtained from stereo. PAMI 14 12 (1992) 1141-1156
63. C. Zitnick, N. Jojic, S. Kang, Consistent segmentation for optical flow estimation, in: Proc. ICCV, 2005, pp. 1308-1315.
64. Zitnick C., Kang S., Uyttendaele M., Winder S., and Szeliski R. High-quality video view interpolation using a layered representation. ACM Transactions on Graphics 23 3 (2004) 600-608