Computer vision on Mars

International Journal of Computer Vision

Volumn 75, Issue 1, 2007, Pages 67-92

  Matthies, Larry ^a   Maimone, Mark ^a   Johnson, Andrew ^a   Cheng, Yang ^a   Willson, Reg ^a   Villalpando, Carlos ^a   Goldberg, Steve ^a   Huertas, Andres ^a   Stein, Andrew ^b   Angelova, Anelia ^c  

^a CALIFORNIA INSTITUTE OF TECHNOLOGY   (United States)

^b CARNEGIE MELLON UNIVERSITY   (United States)

^c CALIFORNIA INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Obstacle detection; Planetary exploration; Slip prediction; Stereo vision; Visual odometry; Visual velocity estimation

Indexed keywords

AEROSPACE VEHICLES; ALGORITHMS; COMPUTER VISION; ROBOTICS; SOLAR SYSTEM; STEREO VISION;

OBSTACLE DETECTION; PLANETARY EXPLORATION; SLIP PREDICTION; VISUAL ODOMETRY; VISUAL VELOCITY ESTIMATION;

LUNAR MISSIONS;

EID: 34547193294     PISSN: 09205691     EISSN: 15731405     Source Type: Journal    
DOI: 10.1007/s11263-007-0046-z     Document Type: Article

References (97)

1. Ali, K. et al. 2005. Attitude and position estimation on the Mars Exploration Rovers. In IEEE Conference on Systems, Man, and Cybernetics.
2. Amidi, O., Kanade, T., and Miller, J.R. 1998. Vision-Based Autonomous Helicopter Research at Carnegie Mellon Robotics Institute 1991-1997. In American Helicopter Society International Conference, HeIi, Japan.
3. Amidi, O., Kanade, T., and Fujita, K. 1999. A visual odometer for autonomous helicopter flight. Journal of Robotics and Autonomous Systems, 28:185-193.
4. Andrade, C., Ben Amar, F., Bidaud, P., and Chatila, R. 1998. Modeling robot-soil interaction for planetary rover motion, control. In IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 576-581.
5. Angelova, A., Matthies, L., and Perona, P. 2006. Slip prediction using visual information. Robotics Science and Systems Conference.
6. Angelova, A., Matthies, L., Sibley, G., and Perona, P. 2006. Learning to predict slip for ground robots. In IEEE International Conference on Robotics and Automation.
7. Ansar, A., Castano, A., and Matthies, L. 2004. Enhanced real-time stereo using bilateral filtering. In 2nd International Symposium on 3D Data Processing, Visualization, and Transmission, Thessaloniki, Greece.
8. Bares, J., Hebert, M., Kanade, T., Krotkov, E., Mitchell, T., Simmons, R., and Whittaker, W.L. 1989. Ambler: An autonomous rover for planetary exploration. IEEE Computer, 22(6):18-26.
9. Bares, J. and Wettergreen, D. 1999. Dante II: Technical description, results and lessons learned. International Journal of Robotics Research, 18(7):621-649.
10. Bekker, M.G. 1964. Mechanics of locomotion and lunar surface vehicle concepts. Transactions of the Society of Automotive Engineers, 72:549-569.
11. Biesiadecki, J. et al. 2005. Mars Exploration Rover surface operations: Driving opportunity at meridiani planum. In IEEE Conference on Systems, Man, and Cybernetics.
12. Biesiasdecki, J. and Maimone, M. 2006. The Mars Exploration Rover surface mobility flight software: Driving ambition. In IEEE Aerospace Conference.
13. Bodt, B.A. and Camden, R.S. 2004. Technology readiness level six and autonomous mobility. In Proc. SPIE Vol. 5422: Unmanned Ground Vehicle Technology VI, pp. 302-313.
14. Bornstein, J.A. and Shoemaker, C.M. 2003. Army ground robotics research program. In Proc. SPIE Vol. 5083: Unmanned Ground Vehicle Technolgy V, pp. 303-310.
15. Burt, P., Wixson, L., and Salgian, G. 1995. Electronically directed 'focal' stereo. In International Conference on Computer Vision.
16. Cheng, Y., Johnson, A., Olson, C., and Matthies, L. 2003. Optical landmark detection for spacecraft navigation. In 13th Annual AAS/AIAA Space Flight Mechanics Meeting.
17. Cheng, Y. and Miller, J. 2003. Autonomous landmark based space-craft navigation system. In 13th Annual AAS/AIAA Space Flight Mechanics Meeting.
18. Cheng, Y., Goguen, J., Johnson, A., Leger, C., Matthies, L., San Martin M., and Willson, R. 2004. The Mars Exploration Rovers Descent Image Motion Estimation System. IEEE Intelligent Systems Magazine, May/June, pp. 13-21.
19. Cheng, Y., Johnson, A., and Matthies, L. 2005. MER-DIMES: A planetary landing application of computer vision. In IEEE Conf. on Computer Vision and Pattern Recognition, San Diego, pp. 806-813.
20. Cheng, Y., Maimone, M., and Matthies, L. 2006. Visual odometry on the Mars Exploration Rovers. IEEE Robotics and Automation Magazine, Vol. 13, No. 2, pp. 54-62.
21. Di, K., Xu, F., Wang, J., Niu, C., Serafy, F., Zhou, R., Li, R., and Matthies, L. 2005. Surface imagery based mapping and rover localization for the 2003 Mars Exploration Rover mission. In Proc. ASPRS Annual Conference, MD, Baltimore.
22. Eustice, R., Singh, H., Leonard, J., Walter, M., and Ballard, R. 2005. Visually navigation the RMS Titanic with SLAM information filters. In Proc. Robotics Science and Systems Conference.
23. Gennery, D.B. 1980. Modelling the Environment of an Exploring Vehicle by Means of Stereo Vision, PhD thesis, Computer Science Department, Stanford University.
24. Goldberg, S., Maimone, M., and Matthies, L. 2002 Stereo vision and rover navigation software for planetary exploration. IEEE Aerospace Conference, Big Sky, MO, Vol. 5, pp. 2025-2036.
25. Guerra, C. and Kanade, T. 1985. A systolic algorithm for stereo matching. In VLSI: Algorithms and Architectures, P. Bertolazzi and F. Luccio (Eds.), Elsevier Science Publishers B.V. (North-Holland), pp. 103-112.
26. Hapke, B. 1986. Bidirectional reflectance spectroscopy. IV. The extinction coefficient and the opposition effect. Icarus, 67:264-280.
27. Hebert, M., Kanade, T., and Kweon, I. 1988. 3-D Vision techniques for autonomous vehicles. Technical report CMU-RI-TR-88-12, Robotics Institute, Carnegie Mellon University.
28. Hebert, M., Krotkov, E., and Kanade, T. 1989. A perception system, for a planetary rover. In Proc. 28th IEEE Conference on Decision and Control, pp. 1151-1156.
29. Hebert, M., Bolles, B., Gothard, B., Matthies, L., and Rosenbloom, M. 1996. Mobility for the unmanned ground vehicle. In Reconnaissance, Surveillance, and Target Recognition (RSTA) for the Unmanned Ground Vehicle, O. Firschein (Ed.), PRC Inc.
30. Helmick, D., Cheng, Y., Clouse, D., and Matthies, L. 2004. Path following using visual odometry for a Mars Rover in. high-slip environments. In IEEE Aerospace Conference, Big Sky, MO.
31. Hirschmuller, H., Innocent, P.R., and Garibaldi, J. 2002. Real-time correlation-based stereo vision with reduced border errors. International Journal of Computer Vision, 47:229-246.
32. Iagnemma, K., Kang, S., Shibly, H., and Dubowsky, S. 2004. On-line terrain parameter estimation for wheeled mobile robots with, application to planetary rovers. IEEE Transactions on Robotics, 20(5):921-927.
33. Johnson, A., Montgomery, J., and Matthies, L. 2005. Vision guided landing of an autonomous helicopter in hazardous terrain. In IEEE International Conference on Robotics and Automation, Barcelona, Spain.
34. Johnson, A., Willson, R., Goguen, J., Alexander, J., and Meller, D. 2005. Field testing of the Mars Exploration Rovers Descent Image Motion Estimation System. In IEEE International Conference on Robotics and Automation, Barcelona, Spain, pp. 4463-4469.
35. Johnson, A., Willson, R., Cheng, Y., Goguen, J., Leger, C., SanMartin, M., and Matthies, L. Design through operation of an image-based velocity estimation system for Mars landing. Joint issue of the International Journal of Computer Vision and the International Journal of Robotics Research, Special Issue on Vision and Robotics, to appear.
36. Kanade, T. and Ikeuchi, K. 1991. Introduction to the special issue on physical modeling in computer vision. IEEE Transactions on Pattern Analysis and Machine Intelligence, 13(7):609-610.
37. Kanadie, T., Yoshida, A., Oda, K., Kano, H., and Tanaka, M. 1996. A stereo machine for video-rate dense depth mapping and its new applications. In Proc. IEEE Conf. on Computer Vision and Pattern Recognition, pp. 196-202.
38. Kanade, T., Amidi, O., and Ke, Q. 2004. Real-time and 3D vision for autonomous small and micro air vehicles. In IEEE Conference on Decision and Control.
39. Klinker, G., Shafer, S., and Kanade, T. 1990. A physical approach, to color image understanding. International Journal of Computer-Vision, 4:7-38.
40. Konolige, K. 1997. Small vision systems: Hardware and implementation. In Proc. 8th International Symposium on Robotics Research, Hayama, Japan.
41. Krotkov, E. and Simmons, R. 1996. Perception, planning, and control for autonomous walking with the ambler planetary rover. International Journal of Robotics Research, 15(2):155-180.
42. Krotkov, E. and Blitch, J. 1999. The DARPA tactical mobile robotics program. International Journal of Robotics Research, 18(7):769-776.
43. Krotkov, E., Fish, S., Jackel, L., McBride, B., Pershbacher, M., and Pippine, J. 2007. The DARPA PerceptOR evaluation, experiments. Autonomous Robots, to appear.
44. Leger, C. et al. 2005. Mars Exploration Rover surface operations: driving Spirit at Gusev Crater. In IEEE Conference on Systems, Man, and Cybernetics.
45. Levine, M.D., O'Handley, D.A., and Yagi, G.M. 1973. Computer determination of depth maps. Computer Graphics and Image Processing, 2:131-150.
46. Lewis, R.A. and Johnston, A.R. 1977. A scanning laser rangefinder for a robotic vehicle. In Proc. 5th IJCAI, Cambridge, MA, pp. 762-768.
47. Li, R., Archinal, B., Arvidson, R., Bell, J., Christensen, P., Crumpler, L., Des Marais, D., Di, K., Duxbury, T., Golombek, M., Grant, J., Greeley, R., Gunn, J., Johnson, A., Kirk, R., Maimone, M., Matthies, L, Malin, M., Parker, T., Sims, M., Thompson, S., Squyres, S., and Soderblom, L. 2006. Rover localization and topographic mapping at the landing site of Gusev Crater, Mars. Journal of Geophysical Research - Planets, 111(E1).
48. Lindemann, R. and Voorhees, C. 2005. Mars Exploration Rover mobility assembly design, test, and performance. In IEEE Conference on Systems, Man, and Cybernetics.
49. Maimone, M., Biesadecki, J., Tunstel, E., Cheng, Y., and Leger, C. 2006. Surface navigation and mobility intelligence on the Mars Exploration Rovers. In Intelligence for Space Robotics, TSI Press, Albuquerque, NM.
50. Maki, J. et al. 2003. Mars Exploration Rover engineering cameras. Journal of Geophysical Research, 108(E12).
51. Mallet, A., Lacroix, S., and Gallo, L. 2000. Position estimation in out-door environments using pixel tracking and stereovision. In IEEE International Conference on Robotics and Automation, pp. 3519-2524.
52. Masrani, D.K. and MacLean, W.J. 2006. A real-time large disparity range stereo-system using FPGAs. In Asian Conference on Computer Vision, Hyderabad, India.
53. Matthies, L. and Shafer, S, 1987. Error modelling in stereo navigation. IEEE Journal of Robotics and Automation, RA-3(3).
54. Matthies, L. 1992. Stereo vision for planetary rovers: Stochastic modeling to near real-time implementation. International Journal of Computer Vision, 8(1).
55. Matthies, L., Gat, E., Harrison, R., Wilcox, B., Volpe, R., and Litwin, T. 1995. Mars microrover navigation: Performance evaluation and enhancement. Autonomous Robots, 2(4).
56. Matthies, L., Kelly, A., Litwin, T., and Tharp, G. 1996. Obstacle detection, for unmanned ground vehicles: A progress report. In Robotics Research: The Seventh International Symposium, G. Giralt and G. Hirzinger (Eds.), Springer, pp. 475-486.
57. Matthies, L., Xiong, Y., Hogg, R., Zhu, D., Rankin, A., Kennedy, B., Hebert, M., Maclachlan, R., Won, C., and Frost, T. 2002. A portable, autonomous, urban, reconnaissance robot. Robotics and Autonomous Systems, 40(2).
58. Matthies, L. and Rankin, A. 2003. Negative obstacle detection by thermal signature. In IEEE Conf. on Intelligent Robots and Systems, Las Vegas, NV, pp. 906-913.
59. Matthies, L., Bellutta, P., and McHenry, M. 2003. Detecting water hazards for autonomous off-road navigation. In SPIE Conf. on Unmanned Ground Vehicles, Orlando, FL.
60. Mettala, E.G. 1992. The OSD Tactical Unmanned Ground Vehicle program. In Proc. DARPA Image Understanding Workshop, Morgan Kaufmann Publishers, pp. 159-172.
61. Mettler, B., Tischler, M.B., and Kanade, T. 2001. System identification, modeling of a small-scale unmanned helicopter. Journal of the American Helicopter Society.
62. Miller, J.R. and Amidi, O. 1998. 3-D Site mapping with the CMU autonomous helicopter. In Proc. 5th International Conf. on Intelligent Autonomous Systems (IAS-5).
63. Montgomery, J., Johnson, A., Roumeliotis, S.I., and Matthies, L. The JPL autonomous helicopter testbed: A platform, for planetary exploration technology research and development. Journal of Field Robotics, to appear.
64. Moravec, H.P. 1980. Obstacle Avoidance and Navigation in the Real World by a Seeing Robot Rover, PhD thesis, Computer Science Department, Stanford University.
65. Moravec, H.P. 1983. The Stanford Cart and the CMU Rover. Proceedings of the IEEE, 71(7):872-884.
66. Nayar, S., Ikeuchi, K., and Kanade, T. 1991. Surface reflection: Physical and geomerical perspectives. IEEE Transactions on Pattern Analysis and Machine Intelligence, 13(7):611-634.
67. Nister, D., Naroditsky, O., and Bergen, J. 2006. Visual odometry for ground vehicle applications. Journal of Field Robotics, 23(1):3-20
68. A Scientific Rationale for Mobility in Planetary Environments. 1999. Committee on Planetary and Lunar Exploration, National Research Council. The National Academies Press.
69. Technology Development for Army Unmanned Ground Vehicles, 2002. Committee on Army Unmanned Ground Vehicle Technology, Board on Army Science and Technology, Division of Engineering and Physical Sciences, National Research Council, The National Academies Press, Washington, D.C.
70. O'Handley, D.A. 1973. Scene analysis in support of a Mars Rover. Computer Graphics and Image Processing, 2:281-297.
71. Okutomi, M. and Kanade, T. 1993. A multiple-baseline stereo. IEEE Transactions on Pattern Analysis and Machine Intelligence, 15(4):353-363.
72. Pomerleau, D. and Jochem, T. 1996. Rapidly adapting machine vision for automated vehicle steering. IEEE Expert: Special Issue on Intelligent Systems and their Applications, 11(2):19-27.
73. Schaal, S. and Atkeson, C. 1998. Constructive incremental learning from, only local information. Neural Computation, 10(8):2047-2084.
74. Se, S., Lowe, D., and Little, J. 2002. Mobile robot localization and mapping with uncertainty using scale-invarianet visual landmarks. International Journal of Robotics Research, 21(8).
75. Shimizu, M. and Okutomi, M. 2001. Precise sub-pixel estimation on area-based matching. In International Conference on Computer Vision.
76. Shoemaker, C.M. and Bornstein, J.A. 2000. Overview and update of the Demo III Experimental Unmanned Vehicle program. In Proc. SPIE Vol. 4024: Unmanned Ground Vehicle Technology II, pp. 212-220.
77. Squyres, S. and Knoll, A.H. 2005. Sedimentary rocks at Meridiani Planum.: Origin, diagenesis, and implications for life on. Mars. Earth and Planetary Science Letters, Special Issue on Sedimentary Geology at Meridiani Planum, Mars, Vol. 240, No. 1, pp. 1-10.
78. Stein, A., Huertas, A., and Matthies, L. 2006. Attenuating stereo pixel-locking via affine window adaptation. In IEEE International Conference on Robotics and Automation.
79. Szeliski, R., and Scharstein, D. 2002. Symmetric sub-pixel stereo matching. In European Conference on Computer Vision, pp. 525-540.
80. Thompson, A.M. 1977. The navigation system of the JPL robot. In Proc. 5th IJCAI, Cambridge, MA, pp. 749-757.
81. Thorpe, C., Hebert, M., Kanade, T., and Shafer, S. 1991a. Toward autonomous driving: The CMU Navlab. Part I: Perception. IEEE Expert, 6(4):31-42.
82. Thorpe, C., Hebert, M., Kanade, T., and Shafer, S. 1991b. Toward autonomous driving: The CMU Navlab. Part II: System, and architecture. IEEE Expert, 6(4):44-52.
83. Thrun, S. 2001. A probabilistic online mapping algorithm for teams of mobile robots. International Journal of Robotics Research, 20(5):335-363.
84. Tomasi, C. and Kanade, T. 1992. Shape and motion from, image streams under orthography: A factorization method. International Journal of Computer Vision, 9(2):137-154.
85. Varma, M. and Zisserman, A. 2005. A statistical approach to texture classification from, single images. International Journal of Computer Vision, 62.
86. Stereo-on-a-Chip [STOC] Stereo Head User Manual 1.1, 2006. Videre Design.
87. Vijayakumar, S., D'Souza, A., and Schaal, S. 2005. Incremental online learning in high dimensions. Neural Computation, 17(12):2602-2634.
88. Villalpando, C. 2006. Acceleration of stereo correlation in verilog. In 9th Military andAemspace Programmable Logic Devices (MAPLD) International Conference, Washington, D.C.
89. Wettergreen, D., Thorpe, C., and Whittaker, W.L. 1993. Exploring Mount Erebus by walking robot. Robotics and Autonomous Systems.
90. Wilcox, B.H. and Gennery, D.B. 1987. A Mars rover for the 1990s. Journal of the British Interplanetary Society, pp. 483-488.
91. Wilcox, B. and Nguyen, T. 1998. Sojourner on Mars and lessons learned for future planetary rovers. In Proc. 28th International Conf. on Environmental Systems (ICES'98), Danvers, MA, Society of Automotive Engineers.
92. Williamson, T. 1998. A High-Performance Stereo Vision System for Obstacle Detection, technical report CMU-RI-TR-98-24, Robotics Institute, Carnegie Mellon University.
93. Willson, R., Johnson, A., and Goguen, D. 2005. MOC2DIMES: A camera simulator for the Mars Exploration. Rover Descent Image Motion Estimation System. In 8th International Symposium on Artificial Intelligence, Robotics and Automation, in, Space (iSAIRAS), Munich, Germany.
94. Willson, R., Maimone, M., Johnson, A., and Seherr, L. 2005. An optical model for image artifacts produced by dust particles on lenses. In 8th International Symposium on Artificial Intelligence, Robotics, and Automation in Space (i-SAIRAS).
95. Wold, H. 1966. Estimation of principal components and related models by iterative least squares. Multivariate Analysis, P.R. Krishnaiah (Ed.), Academic Press, New York, pp. 391-420.
96. Woodfill, J., Gordon, G., and Buck, R. 2004. Tyzx DeepSea high speed stereo vision system. In IEEE Workshop on Real Time 3-D Sensors and their Use, Washington, D.C.
97. Xiong, Y. and Matthies, L. 1997. Error analysis of a real-time stereo system. In IEEE Conference on Computer Vision and Pattern Recognition, pp. 1087-1093.