Motion estimation via dynamic vision

IEEE Transactions on Automatic Control

Volumn 41, Issue 3, 1996, Pages 393-413

  Soatto, Stefano ^a,b   Frezza, Ruggero ^a,c   Perona, Pietro ^a,b,c  

^a IEEE

^b CALIFORNIA INSTITUTE OF TECHNOLOGY   (United States)

^c UNIVERSITY OF PADOVA   (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; CALIBRATION; CAMERAS; IMAGE PROCESSING; NONLINEAR CONTROL SYSTEMS; PARAMETER ESTIMATION; VISION;

DYNAMIC VISION; MOTION ESTIMATION;

IDENTIFICATION (CONTROL SYSTEMS);

EID: 0030105156     PISSN: 00189286     EISSN: None     Source Type: Journal    
DOI: 10.1109/9.486640     Document Type: Article

References (83)

1. R. Abraham, J. E. Marsden, and T. Ratiu, Manifolds, Tensor Analysis and Applications, 2nd ed. New York: Springer-Verlag, 1988.
2. E. Arbogast and R. Mohr, "An ego-motion algorithm based on the tracking of arbitrary curves," in Proc. 2nd European Conf. Computer Vision, 1992.
3. A. Azarbayejani, B. Horowitz, and A. Pentland, "Recursive estimation of structure and motion using relative orientation constraints," in Proc. IEEE Int. Conf. Computer Vision, New York, 1993.
4. J. Barron, D. Fleet, and S. Beauchemin, "Performance of optical flow techniques," Queen's Univ., Kingston, Ontario, Robotics and Perception Laboratory, RPL-TR 9107, 1992;
5. also in Proc. CVPR 1992, pp. 236-242.
6. A. Blake, M. Taylor, and A. Cox, "Grasping visual symmetry," in Proc. IEEE Int. Conf. Computer Vision, 1993.
7. W. Boothby, Introduction to Differentiable Manifolds and Riemannian Geometry. New York: Academic, 1986.
8. J.-Y. Bouguet and P. Perona, "A visual odometer and gyroscope," in Proc. IEEE Int. Conf. Computer Vision, 1995.
9. T. Broida and R. Chellappa, "Estimating the kinematics and structure of a rigid object from a sequence of monocular frames," IEEE Trans. Pattern Anal. Mach. Intell., 1991.
10. _, "Estimation of object motion parameters from noisy images," IEEE Trans. Pattern Anal. Mach. Intell., Jan. 1986.
11. R. L. Bryant, S. S. Chern, R. B. Gardner, H. L. Goldshmidt, and P. A. Griffith, Exterior Differential Systems. New York: Springer-Verlag, 1991.
12. R. S. Bucy, "Non-linear filtering theory," IEEE Trans. Automat. Contr., vol. AC-10, 1965.
13. F. Chaumette and A. Santos, "Tracking a moving object by visual serving," in Proc. 12th IFAC World Congr., vol. 9, pp. 409-414, 1993.
14. R. Cipolla and A. Blake, "Surface orientation and time to crash from image divergence and deformation," in Proc. European Conf. Computer Vision, 1992.
15. R. Curwen, A. Blake, and A. Zisserman, "Real-time visual tracking for surveillance and path planning," in Proc. ECCV, 1992.
16. F. Darmon, "A recursive method to apply the hough transform to a set of moving objects," Proc. IEEE, 1982.
17. W. Dayawansa, B. Ghosh, C. Martin, and X. Wang, "A necessary and sufficient condition for the perspective observability problem," Syst. Contr. Lett., 1994.
18. E. Di-Bernardo, L. Toniutti, R. Frezza, and G. Picci, "Stima del moto dell'osservatore e della struttura della scena mediante visione monoculare," Tesi di Laurea-, Univ. Padova, 1993.
19. E. D. Dickmanns and T. Christians, "Relative 3-D-state estimation for autonomous visual guidance of road vehicles," in Proc. Intelligent Autonomous Syst., Amsterdam, Dec. 11-14, 1989.
20. E. D. Dickmanns and V. Graefe, "Applications of dynamic monocular machine vision," Machine Vision Appl., pp. 241-261, 1988.
21. _, "Dynamic monocular machine vision," Machine Vision Appl., pp. 223-240, 1988.
22. K. Hashimoto, T. Kimoto, T. Ebine, and H. Kimura, "Image-based dynamic visual servo for a hand-eye manipulator," Recent Advances in Mathematical Theory of Systems, Control, Networks, and Signal Processing, vol. II, Kodama Kimura, Ed. Mita, pp. 609-614;
23. also in Proc. Int. Symp. MTNS, 1991.
24. O. D. Faugeras, "What can be seen in three dimensions with an uncalibrated stereo rig," in Proc. 2nd ECCV, 1992.
25. _, Three Dimensional Vision, A Geometric Viewpoint. Cambridge, MA: MIT, 1993.
26. O. D. Faugeras, N. Ayache, and B. Faverjon, "Building visual maps by combining noisy stereo images," in Proc. Int. Conf. Robotics Automat., 1986.
27. O. D. Faugeras, Q. T. Luong, and S. J. Maybank, "Camera self-calibration: Theory and experiments," in Proc. ECCV, vol. 588. New York: Springer-Verlag, 1992.
28. O. D. Faugeras, F. Lustman, and G. Toscani, "Motion and structure from point and line matches," in Proc. IEEE Conf. ICCV, 1987.
29. O. D. Faugeras and S. J. Maybank, "Motion from point matches: Multiplicity of solutions," Int. J. Computer Vision, 1990.
30. D. B. Gennery, "Tracking known 3-dimensional objects," in Proc. AAAI 2nd Nat. Conf. Artif. Intell., Pittsburgh, PA, pp. 13-17, 1982.
31. _, "Visual tracking of known 3-dimensional objects," Int. J. Computer Vision, vol. 7, no. 3, pp. 243-270, 1992.
32. B. Ghosh, M. Jankovic, and Y. Wu, "Perspective problems in systems theory and its application in machine vision," J. Math. Syst., Est. Contr., 1994.
33. E. J. Gibson, J. J. Gibson, O. W. Smith, and H. Flock, "Motion parallax as a determinant of perceived depth," J. Exp. Psych., vol. 45, 1959.
34. G. Golub and C. Van Loan. Matrix Computations, 2nd ed. Baltimore, MD: Johns Hopkins Univ., 1989.
35. R. Hartley, "Estimation of relative camera positions for uncalibrated cameras," in Proc. 2nd Europ. Conf. Comput. Vision, G. Sandini, Ed., vol. 588. New York; Springer-Verlag, 1992.
36. D. Heeger and A. Jepson, "Subspace methods for recovering rigid motion: Algorithm and implementation," Int. J. Comp. Vision, vol. 7, no. 2, 1992.
37. J. Heel, "Direct estimation of structure and motion from multiple frames," MIT AI Lab., AI Memo 1190, Mar. 1990.
38. _, "Temporal integration of 3-d surface reconstruction," IEEE Trans. Pattern Anal. Machine Intell., to appear.
39. C. C. Ho and N. H. McClamrock, "Autonomous spacecraft docking using a computer vision system," in Proc. 31st Conf. Decision Contr, Tucson, AZ, 1992.
40. B. K. P. Horn, "Relative orientation," Int. J. Computer Vision, vol. 4, pp. 59-78, 1990.
41. A. H. Jazwinski, Stochastic Processes and Filtering Theory. New York: Academic, 1970.
42. R. E. Kalman, "A new approach to linear filtering and prediction problems," Trans. ASME-J. Basic Eng., 35-45, 1960.
43. A. Karger and J. Novak, Space Kinematics and Lie Groups. New York: Gordon and Breach, 1985.
44. K. Hashimoto, T. Kimoto, T. Ebine, and H. Kimura, "Manipulator control with image-based visual servo," in Proc. IEEE Int. Conf. Robotics Automat., pp. 2267-2272, 1991.
45. J. J. Koenderink and A. J. Van Doorn, "Affine structure from motion," J. Opt. Soc. Amer., 1991.
46. M. Lei and B. K. Ghosh, "A new nonlinear feedback controller for visually-guided robotic motion tracking," in Proc. ECC, 1993.
47. P. Libermann and C. M. Marie, Symplectic Geometry and Analytical Mechanics. Reidel: Dordrecht. 1987.
48. Y. Liu, O.D. Faugeras, and T.S. Huang, "Determination of camera location from 2-D to 3-D line and point correspondences," IEEE Trans. Pattern Anal. Mach. Intell., vol. 12, no. 1, pp. 28-37, 1990.
49. L. Ljung, Theory and Practice of Recursive Identification. Cambridge, MA: MIT, 1983.
50. _, System Identification: Theory for the User. Englewood Cliffs, NJ: Prentice-Hall, 1987.
51. H. C. Longuet-Higgins, "A computer algorithm for reconstructing a scene from two projections," Nature, vol. 293, pp. 133-135, 1981.
52. _, "Configurations that defeat the eight-point algorithm," Mental Processes: Studies in Cognitive Science. MIT, 1987.
53. B. D. Lucas and T. Kanade, "An iterative image registration technique with an application to stereo vision," in Proc. 7th Int. Joint Conf. Artif. Intell., 1981.
54. L. Matthies, R. Szeliski, and T. Kanade, "Kalman filter-based algorithms for estimating depth from image sequences," Int. 3. Computer Vision, 1989.
55. S. J. Maybank, Theory of Reconstruction from Image Motion. New York: Springer-Verlag, 1992.
56. R. Mohr, "Relative positioning with uncalibrated cameras," in Geometric Invariance in Computer Vision, 1992.
57. R. M. Murray, Z. Li, and S. S. Sastry, A Mathematical Introduction to Robotic Manipulation. CRC, 1994.
58. J. Oliensis and J. Inigo-Thomas, "Recursive multi-frame structure from motion incorporating motion error," in Proc. DARPA Image Understanding Workshop, 1992.
59. J. G. Semple and G. J. Kneebone, Algebraic Projective Geometry. Oxford, 1952.
60. A. Shashua, "On geometric and algebraic aspects of 3-D affine and projective structure from perspective 2-D views," MIT AI Lab., AI Memo 1405, Mar. 1993.
61. S. Soatto, "Observability/idenlifiability of rigid motion under perspective projection," in Proc. 33rd IEEE Conf. Decision Contr., pp. 3235-3240, Dec. 1994.
62. S. Soatto, R. Frezza, and P. Perona, "Motion estimation on the essential manifold," in Proc. 3rd Europ. Conf. Comput. Vision, J.-O. Eklundh, Ed., vol. 800-801. Springer-Verlag, 1994, pp. 11-61-72.
63. S. Soatto and P. Perona, "Recursive estimation of camera motion from uncalibrated image sequences," in Proc. 1st IEEE Int. Conf. Image Processing, Austin, TX, Nov. 1994, pp. III-58-62.
64. _, "Dynamic 3-D rigid motion estimation from weak perspective," in Proc. IEEE Int. Conf. Computer Vision, Boston, MA, June 1995.
65. _, "Structure-independent visual motion control on the essential manifold," in Proc. IFAC Symp. Robot Contr., Capri, Italy, Sept. 1994, pp. 869-876.
66. _, "Three dimensional transparent structure segmentation and multiple 3d motion estimation from monocular perspective image sequences," in IEEE Workshop Motion Nonrigid Articulated Objects, Austin, TX, Nov. 1994, pp. 228-235.
67. _, "Visual motion estimation from subspace constraints," in Proc. 1st IEEE Int. Conf. Image Processing, Austin, TX, Nov. 1994, pp. I-333-337.
68. S. Soatto, P. Perona, R. Frezza, and G. Picci, "Recursive motion and structure estimation with complete error characterization, in Proc. IEEE Conf. Computer Vision Pattern Recognition, New York, June 1993, pp. 428-433.
69. T. Söderström and P. Stoica, System Identification. Englewood Cliffs, NJ: Prentice-Hall, 1989.
70. M. Spivak, A Comprehensive Introduction to Differential Geometry, vol. I-V. Publish or Perish, 1970-75.
71. M. Swain and M. Stricker, "Promising directions in active vision," Univ. Chicago, Tech. Rep. T.R. CS 91-27, Nov. 1991.
72. R. Szeliski, "Recovering 3d shape and motion from image streams using nonlinear least squares," J. Visual Communic. Image Representation, 1994.
73. G. Taubin, "Estimation of planar curves, surfaces and nonplanar space curves defined by implicit equations," IEEE Trans. Pattern Anal. Mach. Intell., 1991.
74. C. J. Taylor and D. J. Kriegman, "Structure and motion from line segments in multiple views," Yale Univ., Tech. Rep. 9402, 1994.
75. C. Tomasi and T. Kanade, "Shape and motion from image streams: A factorization method - 3. Detection and tracking of point features," School of CS-CMU, Apr. 1991.
76. _, "Shape and motion from image streams: a factorization method - 2. Point features in 3d motion," School of CS-CMU, Jan. 1991.
77. _, "Shape and motion from image streams: a factorization method - 1. Planar motion," School of CS-CMU, Sept. 1990.
78. V. S. Varadarajan. Lie Groups, Lie Algebras and Their Representation. New York: Springer-Verlag, 1984.
79. H. von Helmholtz, Treatise on Physiological Optics, 1910.
80. J. Weng, T. Huang, and N. Ahuja, "Motion and structure from two perspective views: Algorithms, error analysis and error estimation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 11, no. 5, pp. 451-476, 1989.
81. _, "Motion and structure from line correspondences: Closed-form solution, uniqueness and optimization," IEEE Trans. Pattern Anal. Mach. Intell., vol. 14, no. 3, pp. 318-336, 1992.
82. Z. Zhang and O. Faugeras, "3D Dynamic Scene Analysis, vol. 27, in Information Sciences. New York: Springer-Verlag, 1992.
83. _, "Estimation of displacement from two 3d frames obtained form stereo," TR 1440-INRIA, 1991.