Three-dimensional motion and structure estimation using inertial sensors and computer vision for augmented reality

Presence: Teleoperators and Virtual Environments

Volumn 11, Issue 5, 2002, Pages 474-492

  Chai, Lin ^a   Hoff, William A ^b   Vincent, Tyrone ^b  

^a XILINX INC   (United States)

^b Department of Geology and Geological Engineering   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

INERTIAL SENSORS;

ALGORITHMS; CAMERAS; COMPUTER VISION; IMAGE SENSORS; KALMAN FILTERING;

VIRTUAL REALITY;

EID: 0036812413     PISSN: 10547460     EISSN: None     Source Type: Journal    
DOI: 10.1162/105474602320935829     Document Type: Article

References (45)

1. Ayache, N., & Faugeras, O.D. (1988). Building, registrating, and fusing Noisy Visual Maps. International Journal of Robotics Research, 7(6), 45-65.
2. _. (1989). Maintaining representations of the environment of a mobile robot. IEEE Trans. on Robotics and Automation, 5(6), 804-819.
3. Azarbayejani, A., & Pentland, A.P. (1995). Recursive estimation of motion, structure, and focal length. IEEE Trans Pattern Anal Mach Intell, 17(6), 562-575.
4. Azuma, R.T. (1997). A survey of augmented reality. Presence: Teleoperators and Virtual Environments, 6(4), 355-385.
5. Azuma, R., & Bishop, G. (1994). Improving static and dynamic registration in an optical see-through HMD. 21st International SIGGRAPH Conference, 197-204.
6. Azuma, R., Hoff, B., Neely III, H., & Sarfaty, R. (1999). A motion-stabilized outdoor augmented reality system. IEEE Virtual Reality '99, 252-259.
7. Azuma, R., Lee, J.W., Jiang, B., Park, J., You, S., & Neumann, U. (1999). Tracking in unprepared environments for augmented reality systems. Computers and Graphics (Pergamon), 23(6), 787-793.
8. Barshan, B., & Durrant-Whyte, H.F. (1995). Inertial navigation systems for mobile robots. IEEE Transactions on Robotics and Automation, 11(3), 328-342.
9. Bhanu, B., Des, S., Roberts, B., & Duncan, D. (1996). System for obstacle detection during rotocraft low altitude flight. IEEE Trans Aerosp Electron Syst, 32(3), 875-897.
10. Borenstein, J., Everett, H.R., & Feng, L. (1996). Navigating mobile robots: Systems and techniques. Wellesley, MA: A. K. Peters, Ltd.
11. Broida, T.J., Chandrashekhar, S., & Chellappa, R. (1990). Recursive 3-D motion estimation from a monocular image sequence. IEEE Trans Aerosp Electron Syst, 26(4), 639-656.
12. Brown, R.G., & Hwang, P.Y.C. (1992). Introduction to random signals and applied Kalman filtering. New York: J. Wiley.
13. Chai, L. (2000). 3D motion and structure estimation using inertial sensors and computer vision for augmented reality. Master's thesis, Colorado School of Mines.
14. Chai, L., Nguyen, K., Hoff, W., & Vincent, T. (1999). An adaptive estimator for registration in augmented reality. 2nd Int'L Workshop on Augmented Reality, 23-32.
15. Craig, J. (1990). Introduction to robotics: Mechanics and control. Reading, MA: Addison-Wesley.
16. Crowley, J.L. (1996). Mathematical foundations of navigation and perception for an autonomous mobile robot. In L. Dorst, M. van Lambalgen, & F. Voorbraak (Eds.) Reasoning with uncertainty in robotics (pp. 9-51). New York: Springer-Verlag.
17. Debrunner, C.H., & Ahuja, N. (1998). Segmentation and factorization-based motion and structure estimation for long image sequences. IEEE Trans Pattern Anal Mach Intell, 20(2), 206-211.
18. Dickmanns, E.D., & Mysliwetz, B.D. (1992). Recursive 3-D Road and Relative Ego-State Recognition. IEEE Trans. Pattern Analysis and Machine Intelligence, 14(2), 199-213.
19. Fang, J.Q., & Huang, T.S. (1984). Some experiments on estimating the 3-D motion parameters from a sequence of image frames. IEEE Trans. on Pattern Analysis and Machine Intelligence, PAMI-6(5), 545-554.
20. Faugeras, O.D. (1993). Three-dimensional computer vision: A geometric viewpoint. Cambridge, MA: The MIT Press.
21. Forsberg, J., Larsson, U., & Wernersson, A. (1995). Mobile robot navigation using the range-weighted Hough transform. IEEE Robotics & Automation Magazine, 2(1), 18-26.
22. Foxlin, E. (1996). Inertial head-tracker sensor fusion by a complementary separate-bias Kalman filter. VRAIS, 185-194.
23. Foxlin, E., Harrington, M., & Pfeifer, G. (1998). Constellation: A Wide-range wireless motion-tracking system for augmented reality and virtual set applications. SIGGRAPH 1998, 371-378.
24. Hoff, W., & Sklair, C. (1990). Planetary terminal descent hazard avoidance using optical flow. IEEE Conf. Robotics and Automation, 238-243.
25. Hoff, W.A., Lyon, T., & Nguyen, K. (1996). Computer vision-based registration techniques for augmented reality. Intelligent Robots and Computer Vision XV, SPIE 2904, 538-548.
26. Hoff, W.A., & Vincent, T. (2000). Analysis of head pose accuracy in augmented reality. IEEE Trans. Visualization and Computer Graphics, 6(4), 319-334.
27. Kriegman, D.J., Triendl, E., & Binford, T.O. (1989). Stereo vision and navigation in buildings for mobile robots. IEEE Transactions on Robotics and Automation, 5(6), 792-803.
28. Matthies, L., & Shafer, S.A. (1987). Error modeling in stereo navigation. IEEE Journal of Robotics and Automation, RA-3(3), 239-248.
29. Melior, J.P. (1995). Realtime camera calibration for enhanced reality visualization. Computer vision, virtual reality and robotics in medicine: First international conference, CVR Med'95, 471-475.
30. Meyer, K., Applewhite, H.L., & Brocca, F.A. (1992). A survey of position trackers. Presence: Teleoperators and Virtual Environments, 1(2), 173-200.
31. Moravec, H.P. (1988). Sensor fusion in certainty grids for mobile robots. AI Magazine, 61-74.
32. Morita, T., & Kanade, T. (1997). Sequential factorization method for recovering shape and motion from image streams. IEEE Trans Pattern Anal Mach Intell, 19(8), 858-867.
33. Neumann, U., & You, S. (1999). Natural Feature Tracking for Augmented Reality. IEEE Transactions on Multimedia, 1(1), 53-64.
34. Nguyen, K. (1998). Inertial data fusion using Kalman filter methods for augmented reality. Master's thesis, Colorado School of Mines.
35. Rohling, R., Munger, P., Hollerbach, J.M., & Peters, T. (1995). Comparison of relative accuracy between a mechanical and an optical position tracker for image-guided neurosurgery. Journal of Image Guided Surgery, 1, 30-34.
36. Sammarco, J.J. (1994). A navigational system for continuous mining machines. Sensors (January), 11-17.
37. Sharma, R., & Molineros, J. (1997). Computer vision-based augmented reality for guiding manual assembly. Presence: Teleoperators and Virtual Environments, 6(3), 292-317.
38. Shekhar, C., & Chellappa, R. (1992). Passive ranging using a moving camera. Journal of Robotic Systems, 9(6), 729-752.
39. Soatto, S., & Perona, P. (1998). Reducing "structure from motion": A general framework for dynamic vision-Part 2: Implementation and experimental assessment. IEEE Trans Pattern Anal Mach Intell, 20(9), 943-960.
40. State, A., Hirota, G., Chen, D.T., Garrett, W.F., & Livingston, M.A. (1996). Superior augmented reality registration by integrating landmark tracking and magnetic tracking. 23rd International Conference on Computer Graphics and Interactive Techniques (SIGGRAPH'96), 429-438.
41. Tomasi, C., & Kanade, T. (1992). Shape and motion from image streams under orthography: A factorization method. Int J Comput Vision, 9(2), 137-154.
42. Uenohara, M., & Kanade, T. (1995). Vision-based object registration for real-time image overlay. Computers in Biology and Medicine, 25(2), 249-260.
43. Weiß, G., Wetzler, C., & Puttkamer, E. (1994). Keeping track of position and orientation of moving indoor systems by correlation of range-finder scans. 1994 International Conference on Intelligent Robots and Systems (IROS'94), 595-601.
44. You, S., Neumann, U., & Azuma, R. (1999). Hybrid inertial and vision tracking for augmented reality registration. IEEE Virtual Reality '99, 260-267.
45. Zikan, K., Curtis, W.D., Sowizval, H.A., & Janin, A.L. (1994). A note on dynamics of human head motions and on predictive filtering of head-set orientations. Telemanipulator and Telepresence Technologies, SPIE 2351, 328-336.