Three-dimensional scene flow

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 27, Issue 3, 2005, Pages 475-480

  Vedula, Sundar ^a   Baker, Simon ^b   Rander, Peter ^c   Collins, Robert ^b   Kanade, Takeo ^b  

^a Carnegie Mellon University ^*  (United States)

^b CARNEGIE MELLON UNIVERSITY   (United States)

^c National Robotics Engineering Center   (United States)

Author keywords

Normal flow; Optical flow; Scene flow; The brightness constancy constraint; Three dimensional dense nonrigid motion; Three dimensional normal flow

Indexed keywords

ALGORITHMS; CAMERAS; IMAGE ANALYSIS; MATRIX ALGEBRA; MOTION ESTIMATION; OPTICAL FLOWS; THREE DIMENSIONAL;

BRIGHTNESS CONSTANCY CONSTRAINT; NORMAL FLOW; SCENE FLOW; THREE DIMENSIONAL DENSE NONRIGID MOTION; THREE DIMENSIONAL NORMAL FLOW;

COMPUTER VISION;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; CLUSTER ANALYSIS; COMPUTER ASSISTED DIAGNOSIS; COMPUTER GRAPHICS; EVALUATION; IMAGE ENHANCEMENT; INFORMATION RETRIEVAL; MATHEMATICAL COMPUTING; METHODOLOGY; MOVEMENT (PHYSIOLOGY); PHOTOGRAPHY; PHYSIOLOGY; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; SIGNAL PROCESSING; THREE DIMENSIONAL IMAGING; VIDEORECORDING;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; CLUSTER ANALYSIS; COMPUTER GRAPHICS; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; IMAGING, THREE-DIMENSIONAL; INFORMATION STORAGE AND RETRIEVAL; MOVEMENT; NUMERICAL ANALYSIS, COMPUTER-ASSISTED; PATTERN RECOGNITION, AUTOMATED; PHOTOGRAMMETRY; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; SIGNAL PROCESSING, COMPUTER-ASSISTED; VIDEO RECORDING;

EID: 15044351181     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2005.63     Document Type: Article

References (24)

1. E. Adelson and J. Bergen, "The Plenoptic Function and the Elements of Early Vision," Computational Models of Visual Processing, Landy and Movshon, eds., pp. 3-20, 1991.
2. S. Avidan and A. Shashua, "Nonrigid Parallax for 3D Linear Motion," Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 2, pp. 62-66, 1998.
3. J.L. Barron, D.J. Fleet, and S.S. Beauchemin, "Performance of Optical Flow Techniques," Int'l J. Computer Vision, vol. 12, no. 1, pp. 43-77, 1994.
4. M. Black and P. Anandan, "A Framework for the Robust Estimation of Optical Flow," Proc. Fourth Int'l Conf. Computer Vision, pp. 231-236, 1993.
5. R. Carceroni and K. Kutulakos, "Multi-View Scene Capture by Surfel Sampling: From Video Streams to Nonrigid 3D Motion, Shape and Reflectance," Proc. IEEE Int'l Conf. Computer Vision, pp. 60-67, 2001.
6. J.P. Costeira and T. Kanade, "A Multibody Factorization Method for Independently Moving Objects," Int'l J. Computer Vision, vol. 29, no. 3, pp. 159-179, 1998.
7. B.K.P. Horn, Robot Vision. McGraw Hill, 1986.
8. T. Kanade, H. Saito, and S. Vedula, "The 3D Room: Digitizing Time-Varying 3D Events by Synchronized Multiple Video Streams," Technical Report CMU-RI-TR-98-34, Robotics Inst., Carnegie Mellon Univ., 1998.
9. W.-H. Liao, S.J. Aggrawal, and J.K. Aggrawal, "The Reconstruction of Dynamic 3D Structure of Biological Objects Using Stereo Microscope Images," Machine Vision and Applications, vol. 9, pp. 166-178, 1997.
10. B.D. Lucas and T. Kanade, "An Iterative Image Registration Technique with an Application to Stereo Vision," Proc. Seventh Int'l Joint Conf. Artificial Intelligence, pp. 674-679, 1981.
11. S. Maiassiotis and M.G. Strintzis, "Model-Based Joint Motion and Structure Estimation from Stereo Images," Computer Vision Image Understanding, vol. 65, no. 1, pp. 79-94, 1997.
12. D. Metaxas and D. Terzopoulos, "Shape and Nonrigid Motion Estimation through Physics-Based Synthesis," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 15, no. 6, pp. 580-591, June 1993.
13. S. Negahdaripour and B.K.P. Horn, "Direct Passive Navigation," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 9, no. 1, pp. 168-176, Jan. 1987.
14. M.A. Penna, "The Incremental Approximation of Nonrigid Motion," Computer Vision, Graphics, and Image Processing, vol. 60, no. 2, pp. 141-156, 1994.
15. A.P. Pentland and B. Horowitz, "Recovery of Nonrigid Motion and Structure," IEEE Trans. Pattern Analysis and Machine Intelligence vol. 13, no. 7, pp. 730-742, July 1991.
16. S.M. Seitz and C.R. Dyer, "Photorealistic Scene Reconstruction by Voxel Coloring," Int'l J. Computer Vision, vol. 35, no. 2, pp. 151-173, 1999.
17. K. Torrance and E. Sparrow, "Theory for Off-Specular Reflection from Rough Surfaces," J. Optical Soc. of Am., vol. 57, pp. 1105-1114, Sept. 1967.
18. S. Ullman, The Interpretation of Visual Motion. MIT Press, 1979.
19. S. Ullman, "Maximizing the Rigidity: The Incremental Recovery of 3-D Shape and Nonrigid Motion," Perception, vol. 13, pp. 255-274, 1984.
20. S. Vedula, "Image Based Spatio-Temporal Modeling and View Interpolation of Dynamic Events," PhD thesis, Robotics Inst., Carnegie Mellon Univ., 2001.
21. S. Vedula, S. Baker, and T. Kanade, "Spatio-Temporal View Interpolation," Proc. 13th ACM Eurographics Workshop Rendering, pp. 65-76, June 2002.
22. S. Vedula, S. Baker, P. Rander, R. Collins, and T. Kanade, "Three-Dimensional Scene Flow," Proc. EEE Int'l Conf. Computer Vision, pp. 722-729, 1999.
23. A.M. Waxman and J.H. Duncan, "Binocular Image Flows: Steps toward Stereo-Motion Fusion," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 8, no. 6, pp. 715-729, Nov. 1986.
24. G.S. Young and R. Chellappa, "3-D Motion Estimation Using a Sequence of Noisy Stereo Images: Models, Estimation, and Uniqueness," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 12, no. 8, pp. 735-759, Aug. 1999.