EKF-based recursive dual estimation of structure and motion from stereo data

IEEE Journal of Oceanic Engineering

Volumn 35, Issue 2, 2010, Pages 424-437

  Zhang, Hongsheng ^a   Negahdaripour, Shahriar ^b  

^a InterSense Inc   (United States)

^b UNIVERSITY OF MIAMI   (United States)

Author keywords

Dual estimation; Extended Kalman filter; Stereo; Structure from motion

Indexed keywords

ADAPTIVE TRAJECTORY; DUAL ESTIMATION; DYNAMIC FEATURES; FEATURE CORRESPONDENCE; INITIAL ESTIMATION; JOINT ESTIMATION; MODELING ERRORS; MOTION AND STRUCTURE; NON-LINEARITY; OBSERVATION NOISE; OCEAN EXPLORATION; OPERATIONAL CONSTRAINTS; OPTIMAL PATHS; REAL DATA SETS; REALTIME PROCESSING; ROBUST ESTIMATION; SEAFLOOR MAPPING; SEQUENTIAL IMPLEMENTATION; STEREOSTRUCTURE; STOCHASTIC STABILITY; TRADITIONAL JOINTS; UNBIASED ESTIMATION; UNDERWATER STEREO;

COMPUTATIONAL COMPLEXITY; EXTENDED KALMAN FILTERS; OCEANOGRAPHY; POSITION CONTROL;

ESTIMATION;

EID: 77952954931     PISSN: 03649059     EISSN: None     Source Type: Journal    
DOI: 10.1109/JOE.2010.2041573     Document Type: Article

References (51)

1. R. Szeliski and S. Kang, "Recovering 3d shape and motion from image streams using non-linear least squares," J. Vis. Comput. Image Represent., vol.5, no.1, pp. 10-28, 1994.
2. D. Gennery, "Tracking known 3-dimensional object," in Proc. AAAI 2nd National Conf. Artif. Intell., Pittsburg, PA, 1982, pp. 13-17.
3. E. Dickmanns and V. Graefe, "Applications of dynamic monocular machine vision," Mach. Vis. Appl., vol.1, pp. 241-261, 1988.
4. A. Azarbayejani and A. P. Pentland, "Recursive estimation of motion, structure, and focal length," IEEE Trans. Pattern Anal. Mach. Intell., vol.17, no.6, pp. 562-575, Jun. 1995.
5. T. Broida, S. Chandrashekhar, and R. Chellappa, "Recursive 3D motion estimation from a monocular image sequence," IEEE Trans. Aerosp. Electron. Syst., vol.26, no.4, pp. 639-656, Jul. 1990.
6. T. Broida and R. Chellappa, "Estimation of object motion parameters from noisy images," IEEE Trans. Pattern Anal. Mach. Intell., vol.PAMI-8, no.1, pp. 90-99, 1986.
7. T. Broida and R. Chellappa, "Estimating the kinematics and structure of a rigid object from a sequence of monocular images," IEEE Trans. Pattern Anal. Mach. Intell., vol.13, no.6, pp. 497-513, Jun. 1991.
8. A. Chiuso, P. Favaro, H. Jin, and S. Soatto, "Structure from motion causally integrated over time," IEEE Trans. Pattern Anal. Mach. Intell., vol.24, no.4, pp. 523-535, Apr. 2002.
9. J. Weng, N. Ahuja, and T. Huang, "Optimal motion and structure estimation," IEEE Trans. Pattern Anal. Mach. Intell., vol.15, no.9, pp. 864-884, Sep. 1993.
10. J. Weng, T. Huang, and N. Ahuja, "3D motion estimation, understanding, and prediction from noisy image sequences," IEEE Trans. Pattern Anal. Mach. Intell., vol.PAMI-9, no.3, pp. 370-389, Mar. 1987. (Pubitemid 17582579)
11. G. Young and R. Chellappa, "3D motion estimation using a sequence of noisy stereo images: Models, estimation, and uniqueness results," IEEE Trans. Pattern Anal. Mach. Intell., vol.12, no.8, pp. 735-759, Aug. 1990.
12. P. McLauchlan, I. Reid, and D. Murray, "Recursive affine structure and motion from image sequences," in Computer Vision-ECCV '94, ser. Lecture Notes in Computer Science. Berlin, Germany: Springer- Verlag, 1994, pp. 217-224.
13. D. Heeger and A. Jepson, "Subspace methods for recovering rigid motion i: Algorithm and implementation," Int. J. Comput. Vis., vol.7, no.2, pp. 95-117, 1992.
14. S. Soatto, R. Frezza, and P. Perona, "Motion estimation via dynamic vision," IEEE Trans. Autom. Control, vol.41, no.3, pp. 393-413, Mar. 1996.
15. S. Soatto and P. Perona, "Recursive 3D visual-motion estimation using subspace constraints," Int. J. Comput. Vis., vol.22, no.3, pp. 235-259, Mar. 1997.
16. S. Soatto and P. Perona, "Reducing structure from motion: A general framework for dynamic vision-Part 1: Modeling," IEEE Trans. Pattern Anal. Mach. Intell., vol.20, no.9, pp. 933-942, Sep. 1998.
17. S. Soatto and P. Perona, "Reducing structure from motion: A general framework for dynamic vision-Part 2: Implementation and experimental assessment," IEEE Trans. Pattern Anal. Mach. Intell., vol.20, no.9, pp. 943-960, Sep. 1998.
18. R. Kalman, "A new approach to linear filtering and prediction problems," Trans. ASME J. Basic Eng., ser. D, vol.82, pp. 35-45, 1960.
19. J. Montiel, J. Civera, and A. Davison, "Unified inverse depth parameterization for monocular slam," in Proc. Robot., Sci. Syst., Aug. 2006, pp. 381-386.
20. R. Sim and J. Little, "Autonomous vision-based exploration and mapping using hybrid maps and Rao-Blackwellized particle filters," in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst., 2006, pp. 2082-2089.
21. K. Murphy, "Bayesian map learning in dynamic environments," in Neural Information Processing Systems. Cambridge, MA: MIT Press, 1999, pp. 1015-1021.
22. M. Montermerlo, S. Thrun, D. Koller, and B. Wegbreit, "FastSLAM: A factored solution to the simultaneous localization and mapping problem," in Proc. AAAI Nat. Conf. Artif. Intell., Edmonton, AB, Canada, 2002, pp. 593-598.
23. M. Montermerlo, S. Thrun, D. Koller, and B. Wegbreit, "FastSLAM 2.0: An improved particle filtering algorithm for simultaneous localization and mapping that provably converges," in Proc. Int. Joint Conf. Artif. Intell., San Francisco, CA, 2003, pp. 1151-1156.
24. G. Casella and C. Robert, "Rao-Blackwellization of sampling schemes," Biometrika, vol.83, no.1, pp. 81-94, 1996.
25. E. Eade and T. Drummond, "Scalable monocular slam," in Proc. Conf. Comput. Vis. Pattern Recognit., 2006, pp. 469-476.
26. Y. Chen, T. Huang, and Y. Rui, "Parametric contour tracking using unscented Kalman filter," in Proc. Int. Conf. Image Process., 2002, vol.III, pp. 613-616.
27. P. Li and T. Zhang, "Unscented Kalman filter for visual curve tracking," in Proc. Stat. Methods Video Process., Jun. 2002, pp. 157-164.
28. B. Stenger, R.Mendonca, and R. Cipolla, "Model-based hand tracking using an unscented Kalman filter," in Proc. British Mach. Vis. Conf. , Sep. 2001, pp. 63-72.
29. R. van der Merwe and E. Wan, "Sigma-point Kalman filters for probabilistic inference in dynamic state-space models," in Proc. Workshop Adv. Mach. Learn., Montreal, QC, Canada, Jun. 2003, pp. 377-385.
30. P. McLauchlan and D. Murray, "A unifying framework for structure and motion recovery from image sequences," in Proc. Int. Conf. Comput. Vis., 1995, pp. 314-320.
31. P. Smith, I. Reid, and A. Davison, "Real-time monocular slam with straight lines," in Proc. British Mach. Vis. Conf., Sep. 2006, pp. 588-596.
32. L. Clemente, A. Davison, I. Reid, J. Neira, and J. Tardos, "Mapping large loops with a single hand-held camera," in Proc. Robot., Sci. Syst. III, Jun. 2007, pp. 417-430.
33. Z. Zhang, "Motion and structure of four points from one motion of a stereo rig," IEEE Trans. Pattern Anal. Mach. Intell., vol.17, no.12, pp. 1222-1227, Dec. 1995.
34. N. Ayache and O. Faugeras, "Maintaining representations of the environment of a mobile robot," IEEE Trans. Robot. Autom., vol.5, no.6, pp. 804-819, Dec. 1989.
35. Z. Zhang and O. Faugeras, "A 3D world model builder with a mobile robot," Int. J. Robot. Res., vol.11, no.4, pp. 269-285, 1992.
36. N. Molton and M. Brady, "Practical structure and motion from stereo when motion is unconstrained," Int. J. Comput. Vis., vol.39, no.1, pp. 5-23, 2000.
37. H. Zhang and S. Negahdaripour, "Improved temporal correspondences in stereo-vision by RANSAC," in Proc. Int. Conf. Pattern Recognit., 2004, pp. 52-55.
38. H. Zhang and S. Negahdaripour, "Epiflow quadruplet matching: Enforcing epipolar geometry for spatio-temporal stereo correspondences," in Proc. Workshop Appl. Comput. Vis., Breckenridge, CO, Jan. 2005, pp. 481-486.
39. H. Zhang, "Automatic sensor platform positioning and 3-d target modeling from underwater stereo sequences," Ph.D. dissertation, Dept. Electr. Comput. Eng., Univ. Miami, Coral Gables, FL, 2005.
40. P. Elina, R. Sim, and J. Little, "/spl sigma/slam: Stereo vision slam using the Rao-Blackwellised particle filter and a novel mixture proposal distribution," in Proc. Int. Conf. Robot. Autom., 2006, pp. 303-318.
41. T. Marks, A. Howard, M. Bajracharya, G. Cottrell, and L. Matthies, "Gamma-slam: Using stereo vision and variance grid maps for slam in unstructured environments," in Proc. IEEE Int. Conf. Robot. Autom., May 2008, pp. 3717-3724.
42. C. Han, Z. Xiang, J. Liu, and E. Wu, "Stereo vision based slam in outdoor environments," in Proc. IEEE Int. Conf. Robot. Biomimetics, Dec. 2007, pp. 1653-1658.
43. E. Wan and A. Nelson, "Dual Kalman filtering methods for nonlinear prediction, estimation, and smoothing," in Advances Neural Information Processing Systems 9, M. Mozer, M. Jordan, and T. Petsche, Eds. Cambridge, MA: MIT Press, 1997, pp. 129-135.
44. E. A.Wan and A. T. Nelson, "Removal of noise from speech using the dual EKF algorithm," in Proc. IEEE Int. Conf. Acoust. Speech Signal Process., May 1998, vol.1, pp. 381-384.
45. K. Reif, S. Gunther, E. Yaz, and R. Unbehauen, "Stochastic stability of the discrete-time extended Kalman filter," IEEE Trans. Autom. Control, vol.44, no.4, pp. 714-728, Apr. 1999.
46. K. Reif and R. Unbehauen, "The extended Kalman filter as an exponential observer for nonlinear systems," IEEE Trans. Signal Process., vol.47, no.8, pp. 2324-2328, Aug. 1999.
47. S. Julier and J. Uhlmann, "A new extension of the Kalman filter to nonlinear systems," in Proc. 11th Int. Symp. Aerosp./Denfense Sens. Simul. Controls, Multi Sensors Fusion, Tracking Resource Manage. II, 1997, pp. 182-193.
48. S. Julier, J. Uhlmann, and H. Durrant-Whyte, "A new approach for filtering nonlinear systems," in Proc. Amer. Control Conf., 1995, vol.3, pp. 1628-1632.
49. S. Julier, J. Uhlmann, and H. Durrant-Whyte, "A new method for the nonlinear transformation of means and covariances in filters and estimators," IEEE Trans. Autom. Control, vol.45, no.3, pp. 477-482, Mar. 2000.
50. R. van der Merwe and E.Wan, "Efficient derivative-free Kalman filters for online learning," in Proc. Eur. Symp. Artif. Neural Netw., Bruges, Belgium, 2001, pp. 205-210.
51. Z. Zhang and O. Faugeras, "Three-dimensional motion computation and object segmentation in a long sequence of stereo frames," Int. J. Comput. Vis., vol.7, no.3, pp. 211-241, 1992.