Robust ego-motion estimation and 3-D model refinement using surface parallax

IEEE Transactions on Image Processing

Volumn 15, Issue 5, 2006, Pages 1215-1225

  Agrawal, Amit ^a   Chellappa, Rama ^a  

^a UNIVERSITY OF MARYLAND   (United States)

Author keywords

Direct methods; Surface parallax; Three dimensional (3 D) modeling

Indexed keywords

ALGORITHMS; ITERATIVE METHODS; MATHEMATICAL MODELS; THREE DIMENSIONAL;

CONSTANT PARALLAX MODEL (CPM); DEPTH BASED PARALLAX MODEL (DBPM); DIGITAL ELEVATION MAP (DEM); ITERATIVE ALGORITHM; PARAMETRIC SURFACE PARALLAX MODELS; ROBUST EGO-MOTION; SURFACE PARALLAX;

IMAGE PROCESSING;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; COMPUTER ASSISTED DIAGNOSIS; EVALUATION; IMAGE ENHANCEMENT; IMAGE SUBTRACTION; INFORMATION RETRIEVAL; METHODOLOGY; THREE DIMENSIONAL IMAGING;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; IMAGING, THREE-DIMENSIONAL; INFORMATION STORAGE AND RETRIEVAL; PATTERN RECOGNITION, AUTOMATED; SUBTRACTION TECHNIQUE;

EID: 33645988533     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2005.864167     Document Type: Article

References (41)

1. H. Longuet-Higgins, "A computer algorithm for reconstructing a scene from two projections," Nature, vol. 293, pp. 133-135, 1981.
2. T. Huang and A. Netravali, "Motion and structure from feature correspondences: A review," Proc. IEEE, vol. 82, no. 2, pp. 252-268, Feb. 1994.
3. G. S. Young and R. Chellappa, "3-D motion estimation using a sequence of noisy stereo images: Models, estimation, and uniqueness results," IEEE Trans. Pattern Anal. Mach. Intell., vol. 12, no. 8, pp. 735-759, Aug. 1990.
4. J. Weng, T. Huang, and N. Ahuja, "3-D motion estimation, understanding, and prediction from noisy image sequences," IEEE Trans. Pattern Anal. Mach. Intell., vol. PAMI-9, no. 3, pp. 370-389, May 1987.
5. J. Weng, N. Ahuja, and T. S. Huang, "Optimal motion and structure estimation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 15, no. 9, pp. 864-884, Sep. 1993.
6. A. Azarbayejani and A. Pentland, "Recursive estimation of motion, structure, and focal length," IEEE Trans. Pattern Anal. Mach. Intell., vol. 17, no. 6, pp. 562-575, Jun. 1995.
7. C. Tomasi and T. Kanade, "Shape and motion from image streams under orthography: A factorization method," Int. J. Comput. Vis., vol. 9, pp. 137-154, 1992.
8. J. Oliensis, "A multi-frame structure-from-motion algorithm under perspective projection," Int. J. Comput. Vis., vol. 34, pp. 1-30, 1999.
9. P. Beardsley, P. Torr, and A. Zisserman, "3-D model acquisition from extended image sequences," in Proc. Eur. Conf. Computer Vision, 1996, pp. 683-695.
10. H. Liu, R. Chellappa, and A. Rosenfeld, "A hierarchical approach for obtaining structure from two-frame optical flow," in Proc. Workshop on Motion and Video Computing, Orlando, FL, Dec. 2002, pp. 214-219.
11. G. Adiv, "Determining 3-D motion and structure from optical flow generated by several moving objects," IEEE Trans. Pattern Anal. Mach. Intell., vol. PAMI-7, no. 4, pp. 384-401, Jul. 1985.
12. A. Waxman and S. Ullman, "Surface structure and three-dimensional motion from image flow kinematics," Int. J. Robot. Res., vol. 4, no. 3, pp. 72-94, 1985.
13. R. Szeliski and S. Kang, "Recovering 3-D shape and motion from image streams using nonlinear least squares," J. Vis. Comput. Image Represent., vol. 5, pp. 10-28, 1994.
14. Y. Aloimonos and C. Brown, "Direct processing of curvilinear sensor motion from a sequence of perspective images," in Proc. IEEE Computer Soc. Workshop on Computer Vision: Representation and Control, 1984, pp. 72-77.
15. B. Horn and E. Weldon, "Direct methods for recovering motion," Int. J. Comput. Vision, pp. 51-76, 1988.
16. K. Hanna, "Direct multi-resolution estimation of ego-motion and structure from motion," in IEEE Workshop on Motion and Video Computing, 1991, pp. 156-162.
17. S. Negahdaripour, N. Kolagani, and B. Hayashi, "Direct motion stereo for passive navigation," in Proc. Conf. Computer Vision and Pattern Recognition, Jun. 1992, pp. 425-431.
18. R. Kumar, P. Anandan, and K. Hanna, "Direct recovery of shape from multiple views: A parallax based approach," in Proc. 12th IAPR Int. Conf. Pattern Recognition, vol. 1, Jerusalem, Israel, 1994, pp. 685-688.
19. J. Bergen, P. Anandan, K. Hanna, and R. Hingorani, "Hierarchical model-based motion estimation," in Proc. Eur. Conf. Computer Vision, Santa Margherita Ligure, Italy, May 1992, pp. 237-252.
20. M. Irani, P. Anandan, and M. Cohen, "Direct recovery of planar-parallax from multiple frames," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 11, pp. 1528-1534, Nov. 2002.
21. G. Stein and A. Shashua, "Model based brightness constraints: On direct estimation of structure and motion," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 9, pp. 992-1015, Sep. 2000.
22. S. Negahdaripour and J. Lanjing, "Direct recovery of motion and range from images of scenes with time-varying illumination," in Proc. Int. Symp. Computer Vision, Nov. 1995, pp. 467-472.
23. A. Shashua and N. Navab, "Relative affine structure: Theory and application to 3-D reconstruction from perspective views," in Proc. Conf. Computer Vision and Pattern Recognition, Jun. 1994, pp. 483-489.
24. H. Sawhney, "3-D geometry from planar parallax," in Proc. Conf. Computer Vision and Pattern Recognition, 1994, pp. 929-934.
25. M. Irani and P. Anandan, "Parallax geometry of pairs of points for 3-D scene analysis," in Proc. Eur. Conf. Computer Vision, Cambridge, U.K., Apr. 1996, pp. 17-30.
26. M. Irani, B. Rousso, and S. Peleg, "Recovery of ego-motion using region alignment," IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 3, pp. 268-272, Mar. 1997.
27. M. Irani, P. Anandan, and D. Weinshall, "From reference frames to reference planes: Multi-view parallax geometry and applications," in Proc. Eur. Conf. Computer Vision, vol. II, Jun. 1998, pp. 829-845.
28. A. Dick and R. Cipolla, "Model refinement from planar parallax," in Proc. 10th British Machine Vision Conf., Nottingham, U.K., Sep. 1999, pp. 73-82.
29. H. Jin, P. Favaro, and S. Soatto, "A semi-direct approach to structure from motion," Vis. Comput., vol. 19, pp. 377-394, Oct. 2003.
30. J. Kearney, W. Thompson, and D. Boley, "Optical flow estimation: An error analysis of gradient-based methods with local optimization," IEEE Trans. Pattern Anal. Mach. Intell., vol. PAMI-9, no. 3, pp. 229-244, Mar. 1987.
31. T. Broida and R. Chellappa, "Performance bounds for estimating three-dimensional motion parameters from a sequence of noisy images," J. Opt. Soc. Amer. A, vol. 6, pp. 879-889, 1989.
32. G. S. Young and R. Chellappa, "Statistical analysis of inherent ambiguities in recovering 3-D motion from a noisy flow field," IEEE Trans. Pattern Anal. Mach. Intell., vol. 14, no. 10, pp. 995-1013, Oct. 1992.
33. J. Oliensis, "The least-squares error for structure from infinitesimal motion," in Proc. Eur. Conf. Computer Vision, 2004.
34. A. Chiuso, R. Brockett, and S. Soatto, "Optimal structure from motion: local ambiguities and global estimates," Int. J. Comput. Vis., vol. 39, no. 3, pp. 195-228, Sep. 2000.
35. S. Huffel and J. Vandewalle, The Total Least Squares Problem: Computational Aspects and Analysis, ser. Frontiers in Applied Mathematics. Philadelphia, PA: SIAM, Jun. 1991, vol. 9.
36. H. Haussecker and D. Fleet, "Computing optical flow with physical models of brightness variation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 6, pp. 661-673, Jun. 2001.
37. H. Liu, R. Chellappa, and A. Rosenfeld, "Accurate dense optical flow estimation and segementation using adaptive structure tensors and a parametric model," IEEE Trans. Image Process., vol. 12, no. 10, pp. 1170-1180, Oct. 2003.
38. J. Brandt, "Analysis of bias in gradient-based optical-flow estimation," in IEEE Asilomar Conf. Signals, Systems and Computers, Oct. 1995, pp. 721-725.
39. H. Liu, T. Hong, M. Herman, and R. Chellappa, "A general motion model and spatio-temporal filters for computing optical flow," Int. J. Comput. Vis., vol. 22, pp. 141-172, 1997.
40. B. Jahne, Spatio-Temporal Image Processing, Theory and Scientific Applications, ser. Lecture Notes in Computer Vision. Berlin, Germany: Springer-Verlag, 1993, vol. 751.
41. B. Jahne, "Analytical studies of low-level motion estimators in space-time images using a unified filter concept," in Proc. Conf. Computer Vision and Pattern Recognition, Jun. 1994, pp. 229-236.