Vision-based control of a mobile base and on-board arm

International Journal of Robotics Research

Volumn 22, Issue 9, 2003, Pages 677-698

  Cárdenas, Antonio ^a   Goodwine, Bill ^a   Skaar, Steven ^a   Seelinger, Mike ^b  

^a UNIVERSITY OF NOTRE DAME   (United States)

^b Yoder Software Inc (YSI)   (United States)

Author keywords

Camera space manipulation; Kalman filter; Machine vision; Mobile manipulators; Mobile robots

Indexed keywords

DEGREES OF FREEDOM (MECHANICS); KALMAN FILTERING; MANIPULATORS; MOBILE ROBOTS; POSITION CONTROL; ROBOTIC ARMS; VIDEO CAMERAS;

EXTENDED KALMAN FILTERING; MOBILE CAMERA-SPACE MANIPULATION; MOBILE MANIPULATORS; VISION-BASED CONTROL;

COMPUTER VISION;

EID: 18744419985     PISSN: 02783649     EISSN: None     Source Type: Journal    
DOI: 10.1177/027836403128965295     Document Type: Article

References (47)

1. Allen, P. K., Timcenko, A., Yoshimi, B., and Michelman, P. 1992. Real-time visual servoing. In Proceedings of the IEEE International Conference on Robotics and Automation, pp. 1850-1856.
2. Arras, K., Tomatis, N., Jensen, B., and Siegwart, R. 2001. Multisensor on-the-fly localization: Precision and reliability for applications. Robotics and Autonomous Systems 34:131-143.
3. Baumgartner, E. T. 1992. An autonomous vision-based mobile robot. Ph.D. thesis, University of Notre Dame, Notre Dame, IN.
4. Baumgartner, E. T. September 2000. In-situ exploration of mars using rover systems. In Proceedings of the AIAA Space 2000 Conference. AIAA paper 2000-5062, Long Beach, CA.
5. Baumgartner, E. T., and Skaar, S. B. 1994. An autonomous vision-based mobile robot. IEEE Transactions on Automatic Control 39(3): 493-502.
6. Cameron, J. M., MacKenzie, D. C., Ward, K. R., Arkin, R. C., and Book, W. J. 1993. Reactive control for mobile manipulation. In Proceedings of the IEEE International Conference on Robotics and Automation, Atlanta, USA, Vol. 3, pp. 228-235.
7. Carriker, W. F., Khosla, P. K., and Krogh, B. H. 1991. Path planning for mobile manipulators for multiple task execution. IEEE Transactions on Robotics and Automation 7(3):403-408.
8. Castellanos, J., Martinez, J., Neira, J., and Tardós, J. 1997. Testbed for mobile robot navigation: The cps experiment. Technical report, Departamento de Informática e Ingeniería de Sistemas, Universidad de Zaragoza, Spain. Technical Report RR-97-11.
9. Denavit, J., and Hartenberg, R. S. 1995. A kinematic notation for lower-pair mechanisms based on matrices. Journal of Applied Mechanics 22:215-221.
10. Dubowsky, S., and Tanner, A. B. 1987. A study of the dynamics and control of mobile manipulators subjected to vehicle disturbances. In R. C. Bolles, and B. Roth, eds., Proceedings of the 4th Symposium of Robotics Research. MIT Press, Cambridge, MA, pp. 111-117.
11. Gelb, A. 1974. Applied Optimal Estimation. MIT Press, Cambridge, MA.
12. Gonzalez-Galvan, E. J. 1995. Application of Servoable Cameras in Three-Dimensional Camera-Space Manipulation. Ph.D. thesis, University of Notre Dame, Notre Dame, IN.
13. Gonzalez-Galvan, E. J., and Skaar, S. B. 1996. Efficient camera-space manipulation using moments. In Proceedings of the IEEE International Conference on Robotics and Automation, pp. 3407-3412.
14. Gonzalez-Galvan, E. J., Skaar, S. B., Korde, U. A., and Chen, W. Z. 1997. Application of a precision enhancing measure in 3D rigid-body positioning using camera-space manipulation. International Journal of Robotics Research 16(2):240-257.
15. Gonzalez-Galvan, E. J., Pazos, F., Skaar, S., and Cardenas-Galindo, A. 2002. Camera pan/tilt to eliminate the workspace-size/pixel-resolution tradeoff with camera-space manipulation. Robotics and Computer-Integrated Manufacturing 18(2):95-104.
16. Hashimoto, K. 1993. Visual Servoing, World Scientific, Singapore
17. Horaud, R., Dornaika, F., and Espiau, B. 1998. Visually guided object grasping. IEEE Transactions on Robotics and Automation 14(4):525-532.
18. Horn, B. 1986. Robot Vision. MIT Press, Cambridge, MA.
19. Hutchinson, S., Hager, G., and Corke, P. 1996. A tutorial on visual servo control. IEEE Transactions on Robotics and Automation 12(5): 651-670.
20. Kam, M., Zhu, X., and Kalata, P. January 1997. Sensor fusion for mobile robot navigation. Proceedings of IEEE 85:108-119.
21. Khatib, O. 1999. Mobile manipulation: The robotic assistant. Robotics and Autonomous Systems 26:175-183.
22. Lewis, F. L. 1986. Optimal Estimation with an Introduction to Stochastic Control Theory. Wiley, New York.
23. Ma, Q. 2000. Supervisory control of a Mobile Robot Using Point-and-Click Mobile Camera-Space Manipulation. Master's thesis, University of Notre Dame, Notre Dame, IN.
24. Ma, Q., Cardenas, A., Goodwine, B., and Skaar, S. B. 2000. Supervisory control of a mobile robot using point-and-click mobile camera-space manipulation. In B. Sánchez, R. H. II, M. Soriano, and P. Tiako, eds., Proceedings of the World Multiconference on Systemics, cybernetics and Informatics, Vol. IX, pp. 38-43.
25. MacKenzie, D., and Arkin, R. 1996. Behavior-based mobile manipulations for drum sampling. In Proceedings of the IEEE International Conference on Robotics and Automation, pp. 2389-2395.
26. Matijevic, J. 1998. The pathfinder mission to mars: Autonomous navigation and the sojourner microrover. Science 280(5362):454-455.
27. Monta, M., Kondo, N., and Shibano, Y. May 1995. Agricultural robot in grape production system. In Proceedings of the IEEE International Conference on Robotics and Automation, Nagoya, Japan, pp. 2504-2509.
28. Nagatani, K., and Yuta, S. 1996. Door-opening behavior of an autonomous mobile manipulator by sequence of action primitives. Journal of Robotic Systems 13(11):709-721.
29. Pavlov, V. A., and Timofeyev, A. V. 1976. Construction and stabilization of programmed movements of a mobile robot-manipulator. Engineering Cybernetics 14(6):70-79.
30. Petersson, L., Austin, D., and Kragic, D. 2000. High-level control of a mobile manipulator for door opening. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, Vol. 3, pp. 2333-2338.
31. Petersson, L., Jensfelt, P., Tell, D., Strandberg, M., Kragic, D., and Christensen, H. I. 2002. Systems integration for real-world manipulation tasks. In Proceedings of the IEEE International Conference on Robotics and Automation, pp. 2500-2505.
32. Pin, F. G., Morgansen, K. A., Tulloch, F. A., Hacker, C. J., and Gower, K. B. 1996. Motion planning for mobile manipulators with a nonholonomic constraint using the fsp (full space parametrization) method. Journal of Robotic Systems 13(11):723-736.
33. Pissard-Gibollet, R., and Rives, P. May 1995. Applying visual servoing techniques to control a mobile hand-eye system. In Proceedings of the IEEE International Conference on Robotics and Automation, Nagoya, Japan, pp. 166-171.
34. Puget, P., and Skordas, T. 1990. An optimal solution for mobile camera calibration. In Proceedings of the IEEE International Conference on Intelligent Robots and Systems, Vol. 1, pp. 34-39.
35. Robinson, M. 2001. A structured lighting approach to image analysis for robotic applications using camera-space manipulation. Ph.D. thesis, University of Notre Dame, Notre Dame, IN.
36. Seelinger, M. J. 1999. Point-and-click Camera-space manipulation, mobile camera-space manipulation, and some fundamental issues regarding the control of robots using vision. Ph.D. thesis, University of Notre Dame, Notre Dame, IN.
37. Seelinger, M., Skaar, S. B., and Robinson, M. 1998. An alternative approach for image-plane control of robots. In D. J. Kriegman, G. D. Hager, A. S. Morse, eds., Lecture Notes in Control and Information Sciences. Springer, London, pp. 41-65.
38. Seelinger, M., Yoder, J.-D., Baumgartner, E. T., and Skaar, S. B. 2002. High precision visual control of mobile manipulators. IEEE Transactions on Robotics and Automation 18(6):957-965.
39. Seraji, H. May 1995. Configuration control of rover-mounted manipulators. In Proceedings of the IEEE International Conference on Robotics and Automation, Nagoya, Japan, pp. 2261-2266.
40. Singh, S. 1997. State of the art in automation of earthmoving. ASCE Journal of Aerospace Engineering 10(4):179-188.
41. Skaar, S. B., Brockman, W. H., and Hanson, R. 1987. Camera space manipulation. International Journal of Robotics Research 6(4):20-32.
42. Skaar, S. B., Brockman, W. H., and Jang, W. S. 1990. Three-dimensional camera space manipulation. International Journal of Robotics Research 9(4):22-39.
43. Stentz, A. T., Bares, J., Singh, S., and Rowe, P. 1999, A robotic excavator for autonomous truck loading. Autonomous Robots 7(2):175-186.
44. Swain, R., and Devy, M. May 1999. Motion control using visual servoing and potential fields for a rover-mounted manipulator. In Proceedings of the IEEE International Conference on Robotics and Automation, Detroit, USA, pp. 2249-2254.
45. Tan, J., and Xi, N. 2001. Integrated sensing and control of mobile manipulators. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, Hawaii, USA.
46. Yamamoto, Y., and Yun, X. 1996. Effect of the dynamic interaction on coordinated control of mobile manipulators. IEEE Transactions on Robotics and Automation 12(5):816-824.
47. Zhuang, H., and Roth, Z. S. 1996. Camera-Aided Robot Calibration. CRC Press, Boca Raton, FL.