On 3-D scene flow and structure recovery from multiview image sequences

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 33, Issue 4, 2003, Pages 592-600

  Zhang, Ye ^a   Kambhamettu, Chandra ^a  

^a University of Delaware   (United States)

Author keywords

3 D affine motion model; Motion depth boundary; Nonrigid motion; Scene flow; Scene structure; Stereo

Indexed keywords

CAMERAS; COMPUTER VISION; CONSTRAINT THEORY; MOTION ESTIMATION; STEREO VISION; THREE DIMENSIONAL;

EXTENDED GRADIENT-BASED SYSTEM; MULTIVIEW IMAGE SEQUENCES; THREE DIMENSIONAL SCENE FLOW;

IMAGE SEGMENTATION;

EID: 0041765148     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2003.814284     Document Type: Article

References (46)

1. B. Horn and B. Schunk, "Determining optical flow," Artif. Intell., vol. 17, pp. 185-203, 1981.
2. P. Anandan, "A computational framework and an algorithm for the measurement of visual motion," Int. J. Comput. Vis., vol. 2, no. 3, pp. 283-310, Jan. 1989.
3. M. Black and P. Anandan, "The robust estimation of multiple motions: Parametric and piecewise-smooth flow-fields," Comput. Vis. Image Understand., vol. 63, no. 1, pp. 75-104, Jan. 1996.
4. J. Barron, D. Fleet, and S. Beauchemin, "Performance of optical flow techniques," Int. J. Comput. Vis., vol. 12, no. 1, pp. 43-77, Feb. 1994.
5. S. Vedula, S. Baker, P. Rander, R. Collins, and T. Kanade, "Three-dimensional scene flow," Proc. IEEE Computer Soc. Int. Conf. Computer Vision, pp. 722-729, 1999.
6. Y. Zhang and C. Kambhamettu, "Integrated 3-D scene flow and structure recovery from multiview image sequences," Proc. IEEE Conf. Computer Vision Pattern Recognition, pp. II:674-II:681, 2000.
7. ____, "On 3-D scene flow and structure estimation," Proc. IEEE Conf. Computer Vision Pattern Recognition, pp. II:778-II:785, 2001.
8. A. Pentland and B. Horowitz, "Recovery of nonrigid motion and structure," IEEE Trans. Pattern Anal. Machine Intell., vol. 13, pp. 730-742, July 1991.
9. M. Black, "Explaining optical flow events with parameterized spatio-temporal models," Proc. IEEE Conf. Computer Vision Pattern Recognition, pp. I:326-I:332, 1999.
10. L. Zhou, Z. Kambhamettu, and D. Goldgof, "Extracting nonrigid motion and 3-D structure of hurricanes from satellite image sequences without correspondences," Proc. IEEE Conf. Computer Vision Pattern Recognition, pp. II:280-II:285, 1999.
11. M. Penna, "The incremental approximation of nonrigid motion," Comput. Vis., Graph. Image Process., vol. 60, no. 2, pp. 141-156, Sept. 1994.
12. U. Dhond and J. Aggarwal, "Structure from stereo: A review," IEEE Trans. Syst., Man, Cybern., vol. 19, pp. 1489-1510, Nov. 1989.
13. D. Scharstein and R. Szeliski, "A taxonomy and evaluation of dense two-frame stereo correspondence algorithms," Int. J. Comput. Vis., vol. 47, no. 1-3, pp. 7-42, Apr. 2002.
14. S. Roy and I. Cox, "A maximum-flow formulation of the n-camera stereo correspondence problem," Proc. IEEE Computer Soc. Int. Conf. Computer Vision, pp. 492-499, 1998.
15. W. Richards, "Structure from stereo and motion," J. Op. Soc. Ameri. A, vol. 2, no. 2, pp. 343-349, Feb. 1985.
16. D. Ballard and O. Kimball, "Rigid body motion from depth and optic flow," Comput. Vis., Graph. Image Process., vol. 22, no. 1, pp. 95-115, Apr. 1983.
17. T. Huang and S. Blostein, "Robust algorithms for motion estimation based on two sequential stereo image pairs," Proc. IEEE Conf. Computer Vision Pattern Recognition, pp. 518-523, 1985.
18. K. Mutch, "Determining object translation information using stereoscopic motion," IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-8, pp. 750-755, Nov. 1986.
19. G. Young and R. Chellappa, "3-D motion estimation using a sequence of noisy stereo images: Models, estimation, and uniqueness results," IEEE Trans. Pattern Anal. Machine Intell., vol. 12, pp. 735-759, Aug. 1990.
20. P. Balasubramanyam, "Computation of motion in depth parameters: A first step in stereoscopic motion interpretation," in Proc. Image Understanding Workshop, 1988, pp. 907-920.
21. A. Waxman and J. Duncan, "Binocular image flows: Steps toward stereo-motion fusion," IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-8, pp. 715-729, Nov. 1986.
22. J. Barron, A. Jepson, and J. Tsotsos, "Determination of egomotion and environmental layout from noisy time-varying velocity in binocular image sequences," in Proc. Int. Joint Conf. Artificial Intelligence, 1987, pp. 822-825.
23. Y. Aloimonos and A. Basu, "Shape and 3-D motion from contour without point to point correspondences: General principles," Proc. IEEE Conf. Computer Vision Pattern Recognition, pp. 518-527, 1986.
24. F. Dornaika and R. Chung, "Stereo correspondence from motion correspondence," Proc. IEEE Conf. Computer Vision Pattern Recognition, pp. I:70-I:75, 1999.
25. L. Li and J. Duncan, "3-D translational motion and structure from binocular image flows," IEEE Trans. Pattern Anal. Machine Intell., vol. 15, pp. 657-667, July 1993.
26. J. Weng, N. Ahuja, and T. Huang, "Optimal motion and structure estimation," IEEE Trans. Pattern Anal. Machine Intell., vol. 15, pp. 864-884, Sept. 1993.
27. W. Liao, S. Aggarwal, and J. Aggarwal, "The reconstruction of dynamic 3-D structure of biological objects using stereo microscope images," Mach. Vis. Applicat., vol. 9, no. 4, pp. 166-178, 1997.
28. S. Malassiotis and M. Strintzis, "Model-based joint motion and structure estimation from stereo images," Comput. Vis. Image Understand., vol. 65, no. 1, pp. 79-94, Jan. 1997.
29. C. Kambhamettu, K. Palaniappan, and A. Hasler, "Coupled, multi-resolution stereo and motion analysis," Proc. IEEE Symp. Computer Vision, pp. 43-48, 1995.
30. J. Neumann and Y. Aloimonos, "Spatio-temporal stereo using multi-resolution subdivision surfaces," Int. J. Comput. Vis., vol. 47, no. 1-3, pp. 181-193, Apr. 2002.
31. I. Cox, S. Hingorani, S. Rao, and B. Maggs, "A maximum-likelihood stereo algorithm," Comput. Vis. Image Understand., vol. 63, no. 3, pp. 542-567, May 1996.
32. Handbook of Pattern Recognition and Image Processing: Computer Vision, Academic, San Diego, 1994, pp. 405-430, Nonrigid motion analysis.
33. J. Bergen, P. Anandan, K. Hanna, and R. Hingorani, "Hierarchical model-based motion estimation," in Proc. Eur. Conf. Computer Vision, 1992, pp. 237-252.
34. S. Ju, M. Black, and A. Jepson, "Skin and bones: Multi-layer, locally affine, optical flow and regularization with transparency," Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 307-314, 1996.
35. H. Li, P. Roivainen, and R. Forchheimer, "3-D motion estimation in model-based facial image coding," IEEE Trans. Pattern Anal. Machine Intell., vol. 15, no. 6, pp. 545-555, June 1993.
36. L. Zhou, C. Kambhamettu, D. Goldgof, K. Palaniappan, and A. Hasler, "Tracking nonrigid motion and structure from 2-D satellite cloud images without correspondences," IEEE Trans. Pattern Anal. Machine Intell., vol. 23, pp. 1330-1336, Nov. 2001.
37. L. Zhou and C. Kambhamettu, "Hierarchical structure and nonrigid motion recovery from 2-D monocular views," Proc. IEEE Conf. Computer Vision Pattern Recognition, pp. II:752-II:759, 2000.
38. Y. Huang, K. Palaniappan, X. Zhuang, and J. Cavanaugh, "Optic flow field segmentation and motion estimation using a robust genetic partitioning algorithm," IEEE Trans. Pattern Anal. Machine Intell., vol. 17, pp. 1177-1190, Dec. 1995.
39. R. Balasubramanian, D. Goldgof, and C. Kambhamettu, "Tracking of nonrigid motion and 3-D structure from 2-D image sequences without correspondences," in Proc. Int. Conf. Image Processing, 1998, pp. I:933-I:937.
40. W. Press, B. Flannery, S. Teukolsky, and W. Vetterling, Numerical Recipes in C. Cambridge, U.K.: Cambridge Univ. Press, 1988.
41. S. Ghosal and P. Vanek, "A fast scalable algorithm for discontinuous optical-flow estimation," IEEE Trans. Pattern Anal. Machine Intell., vol. 18, pp. 181-194, Feb. 1996.
42. P. Felzenszwalb and D. Huttenlocher, "Image segmentation using local variation," Proc. IEEE Conf. Computer Vision Pattern Recognition, pp. 98-104, 1998.
43. P. Fua, "Combining stereo and monocular information to compute dense depth maps that preserve depth discontinuities," in Proc. Int. Joint Conf. Artificial Intelligence, 1991, pp. 1292-1298.
44. H. Tao, H. Sawhney, and R. Kumar, "A global matching framework for stereo computation," Proc. IEEE Computer Soc. Int. Conf. Computer Vision, pp. I:532-I:539, 2001.
45. M. Black and A. Jepson, "Estimating optical-flow in segmented images using variable-order parametric models with local deformations," IEEE Trans. Pattern Anal. Machine Intell., vol. 18, pp. 972-986, Oct. 1996.
46. R. Szeliski, "Fast surface interpolation using hierarchical basis functions," IEEE Trans. Pattern Anal. Machine Intell., vol. 12, pp. 513-528, June 1990.