Motion estimation from image and inertial measurements

International Journal of Robotics Research

Volumn 23, Issue 12, 2004, Pages 1157-1195

  Strelow, Dennis ^a   Singh, Sanjiv ^a  

^a CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

Batch shape from motion; Long term motion estimation; Omnidirectional vision; Recursive shape from motion; inertial navigation; Sensor fusion

Indexed keywords

ACCELEROMETERS; ALGORITHMS; CAMERAS; COST EFFECTIVENESS; DEGREES OF FREEDOM (MECHANICS); IMAGE ANALYSIS; IMAGE SENSORS; INERTIAL NAVIGATION SYSTEMS; MAPPING; SENSOR DATA FUSION;

BATCH SHAPE-FROM-MOTION; INERTIAL NAVIGATION; LONG-TERM MOTION ESTIMATION; OMNIDIRECTIONAL VISION; RECURSIVE SHAPE-FROM-MOTION; SENSOR FUSION;

MOTION ESTIMATION;

EID: 9744232087     PISSN: 02783649     EISSN: None     Source Type: Journal    
DOI: 10.1177/0278364904045593     Document Type: Article

References (42)

1. Baker, S., and Nayar, S.K. 2001. Single viewpoint catadioptric cameras. Panoramic Vision: Sensors, Theory, and Applications. Springer-Verlag, New York, pp. 39-71.
2. Bar-Shalom, Y., and Li, X.-R. 1995. Multitarget-Multisensor Tracking: Principles and Techniques. YBS Publishing, Storrs, CT.
3. Brooks, M.J., Chojnacki, W., Gawley, D., and van den Hengel, A. 2001. What value covariance information in estimating vision parameters? Proceedings of the 8th IEEE Interna tional Conference on Computer Vision (ICCV 2001), Vancouver, Canada.
4. Chahl, J.S., and Srinivasan, M.V. 1997. Reflective surfaces for panoramic imaging. Applied Optics 36(31):8275-8285.
5. Chai, L., Hoff, W. A., and Vincent, T. 2002. Three-dimensional motion and structure estimation using inertial sensors and computer vision for augmented reality. Presence 11(5):474-491.
6. Chong, K.S., and Kleeman, L. 1999. Feature-based mapping in real, large scale environments using an ultrasonic array. International Journal of Robotics Research 18(1):3-19.
7. Craig, J.J. 1989. Introduction to Robotics: Mechanics and Control. Addison-Wesley, Reading, MA.
8. Deans, M.C. 2002. Bearings-Only Localization and Mapping. PhD thesis, Carnegie Mellon University, Pittsburgh, PA.
9. Deans, M., and Hebert, M. 2001. Experimental comparison of techniques for localization and mapping using a bearing-only sensor. Experimental Robotics VII, D. Rus and S. Singh, editors. Springer-Verlag, Berlin, pp. 395-404.
10. Foxlin, E.M. 2002. Generalized architecture for simultaneous localization, auto-calibration, and map-building. Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2002), EPFL, Lausanne, Switzerland, September 30-October 4.
11. Foxlin, E., and Naimark, L. 2003. VIS-Tracker: a wearable vision-inertial self-tracker. IEEE Virtual Reality Conference (VR 2003), Los Angeles, CA, March.
12. Gelb, A., editor. 1974. Applied Optimal Estimation. MIT Press, Cambridge, MA.
13. Guivant, J., and Nebot, E. 2001. Compressed filter for real time implementation of simultaneous localization and mapping. International Conference on Field and Service Robotics (FSR 2001), Otaniemi, Finland, June, Vol. 1, pp. 309-314.
14. Heikkilä, J., and Silvén, O. 1997. A four-step camra calibration procedure with implicit image correction. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR 1997), San Juan, Puerto Rico, pp. 1106-1112.
15. Horn, B.K.P. 1987. Closed-form solution of absolute orientation using unit quaternions. Journal of the Optical Society of America A 4(4):629-642.
16. Huster, A., and Rock, S.M. 2001a. Relative position estimation for intervention-capable AUVs by fusing vision and inertial measurements. Proceedings of the 12th International Symposium on Unmanned Untethered Submersible Technology, Durham, NH, August.
17. Huster, A., and Rock, S.M. 2001b. Relative position estimation for manipulation tasks by fusing vision and inertial measurements. Oceans 2001 Conference, Honolulu, HI, November, Vol. 2, pp. 1025-1031.
18. Huster, A., and Rock, S.M. 2003. Relative position sensing by fusing monocular vision and inertial rate sensors. Proceedings of the 11th International Conference on Advanced Robotics (ICAR 2003), Coimbra, Portugal, July, Vol. 3, pp. 1562-1567.
19. Huster, A., Frew, E.W., and Rock, S.M. 2002. Relative position estimation for AUVs by fusing bearing and inertial rate sensor measurements. Oceans 2002 Conference, Biloxi, MS, October, pp. 1857-1864.
20. Jung, S.-H., and Taylor, C.J. 2001. Camera trajectory estimation using inertial sensor measurements and structure from motion results. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2001), Kauai, HI, December, Vol. 2, pp. 732-737.
21. Kanazawa, Y, and Kanatani, K. 2001. Do we really have to consider covariance matrices for image features? Proceedings of the 8th IEEE International Conference on Computer Vision (ICCV 2001), Vancouver, Canada, July.
22. Lowe, D.G. 1999. Object recognition and local scale-invariant features. Proceedings of the 7th International Conference on Computer Vision (ICCV 1999), Corfu, Greece, September, pp. 1150-1157.
23. Lucas, B.D., and Kanade, T. 1981. An iterative image registration technique with an application to stereo vision. Proceedings of the 7th International Joint Conference on Artificial Intelligence, Vancouver, Canada, August, Vol. 2, pp. 674-679.
24. McLauchlan, P.F. 1999. The variable state dimension filter applied to surface-based structure from motion. Technical Report VSSP-TR-4/99, University of Surrey, Guildford, UK.
25. Montemerlo, M, and Thrun, S. 2003. Simultaneous localization and mapping with unknown data association using FastSLAM. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA 2003), Taipei, Taiwan.
26. Mukai, T., and Ohnishi, N. 1999. The recovery of object shape and camera motion using a sensing system with a video camera and a gyro sensor. Proceedings of the 7th IEEE International Conference on Computer Vision (ICCV 1999), Corfu, Greece, September, pp. 411-417.
27. Nayar, S.K. 1997. Catadioptric omnidirectional camera. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR 1997), San Juan, Puerto Rico, June, pp. 482-488.
28. Ollis, M., Herman, H., and Singh, S. 1999. Analysis and design of panoramic stereo vision using equi-angular pixel cameras. Technical Report CMU-RI-TR-99-04, Carnegie Mellon University, Pittsburgh, PA.
29. Poelman, C.J. 1995. The Paraperspective and Projective Factorization Methods for Recovering Shape and Motion. PhD thesis, Carnegie Mellon University, Pittsburgh, PA.
30. Press, W.H., Teukolsky, S.A., Vetterling, W.T., and Flannery, B.P. 1992. Numerical Recipes in C: The Art of Scientific Computing. Cambridge University Press, Cambridge.
31. Qian, G., and Chellappa, R. 2001. Structure from motion using sequential Monte Carlo methods. Proceedings of the 8th IEEE International Conference on Computer Vision (ICCV 2001), Vancouver, Canada, July, pp. 614-621.
32. Qian, G., Chellappa, R., and Zhang, Q. 2001. Robust structure from motion estimation using inertial data. Journal of the Optical Society of America A 18(12):2982-2997.
33. Rasmussen, C., and Hager, G.D. 2001. Probabilistic data association method for tracking complex visual objects. IEEE Transactions on Pattern Analysis and Machine Intelligence 23(6):560-576.
34. Rehbinder, H., and Ghosh, B.K. 2001. Rigid body state estimation using dynamic vision and inertial sensors. Proceedings of the 40th IEEE Conference on Decision and Control (CDC 2001), Orlando, FL, December, pp. 2398-2403.
35. Smith, R., Self, M., and Cheeseman, P. 1990. Estimating uncertain spatial relationships in robotics. Autonomous Robot Vehicles, I.J. Cox and G.T. Wilfong, editors. Springer-Verlag, New York, pp. 167-193.
36. Strelow, D., Mishler, J., Singh, S., and Herman, H. 2001a. Extending shape-from-motion to non-central omnidirectional cameras. Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2001), Wailea, HI, October.
37. Strelow, D., Mishler, J., Koes, D., and Singh, S. 2001b. Precise omnidirectional camera calibration. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2001), Kauai, HI, December, Vol. 1, pp. 689-694.
38. Szeliski, R., and Kang, S.B. 1994. Recovering 3D shape and motion from image streams using nonlinear least squares. Journal of Visual Communication and Image Representation 5(1): 10-28.
39. Tomasi, C., and Kanade, T. 1992. Shape and motion from image streams under orthography: a factorization method. International Journal of Computer Vision 9(2):137-154.
40. Weng, J., Cui, Y., and Ahuja, N. 1997. Transitory image sequences, asymptotic properties, and estimation of motion and structure. IEEE Transactions on Image Analysis and Machine Intelligence 19(5):451-464.
41. Wolf, P.R. 1983. Elements of Photogrammetry. McGraw-Hill, New York.
42. You, S., and Neumann, U. 2001. Fusion of vision and gyro tracking for robust augmented reality registration. Proceedings of the IEEE Virtual Reality Conference (VR 2001), Yokohama, Japan, March, pp. 71-78.