Toward automatic robot instruction from perception - Mapping human grasps to manipulator grasps

IEEE Transactions on Robotics and Automation

Volumn 13, Issue 1, 1997, Pages 81-95

  Kang, Sing Bing ^a   Ikeuchi, Katsushi ^b,c  

^a HEWLETT PACKARD COMPANY   (United States)

^b Carnegie Mellon University   (United States)

^c IEEE

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL COMPLEXITY; COMPUTER VISION; GRIPPERS; MANIPULATORS; MATHEMATICAL MODELS; MOTION PLANNING; VIRTUAL REALITY;

FINITE AUTOMATION MODEL; HUMAN GRASP RECOGNITION; OBJECT MOTION EXTRACTION; PLANNING MANIPULAR GRASPS; ROBOT TEACHING INTERFACE;

ROBOT PROGRAMMING;

EID: 0031078977     PISSN: 1042296X     EISSN: None     Source Type: Journal    
DOI: 10.1109/70.554349     Document Type: Article

References (35)

1. M. A. Arbib, T. Iberall, and D. M. Lyons, "Coordinated control programs for movements of the hand," in Hand Function and the Neocortex, A. W. Goodwin and T. Darian-Smith, Eds. Berlin, Germany: Springer-Verlag, 1985, pp. 111-129.
2. S. Borkar et al., "Supporting systolic and memory communication in iWarp," in Proc. 17th Int. Symp. Computer Architecture, Seattle, WA, 1990, pp. 70-81.
3. D. L. Brock and J. K. Salisbury, "Implementation of behavioral control on a robot hand/arm system," in Proc. 2nd Int. Symp. Experimental Robotics, 1991, pp. 1-19.
4. S. L. Chiu, "Task compatibility of manipulator postures," Int. J. Robot. Res., vol. 7, no. 5, pp. 13-21, 1988.
5. M. R. Cutkosky and R. D. Howe, "Human grasp choice and robotic grasp analysis," in Dextrous Robot Hands, S. T. Venkataraman and T. Iberall, Eds. Berlin, Germany: Springer-Verlag, 1990, pp. 5-31.
6. E. Grosso and G. Vercelli, "Grasping strategies for reconstructed unknown 3D objects," in Proc. IEEE/RSJ Workshop Intelligent Robots and Systems, Osaka, Japan, 1991, pp. 70-75.
7. T. Hamada, K. Kamejima, and I. Takeuchi, "Image based operation: A human-robot interaction architecture for intelligent manufacturing," in Proc. 15th Conf. IEEE Industrial Electron. Soc., 1989, pp. 556-561.
8. T. Hasegawa, T. Suehiro, and K. Takase, "A model-based manipulation system with skill-based execution," IEEE Trans. Robot. Automat., vol. 8, pp. 535-544, Oct. 1992.
9. K. Ikeuchi and T. Suehiro, "Toward an assembly plan from observation, Part I: Task recognition with polyhedral objects," IEEE Trans. Robot. Automat., vol. 10, pp. 368-385, June 1994.
10. S. C. Jacobson, J. E. Wood, D. F. Knutti, and K. B. Biggers, "The Utah/MIT dextrous hand: Work in progress," Int. J. Robot. Res., vol. 3, no. 4, pp. 21-50, 1984.
11. S. B. Kang, "Robot instruction from human demonstration," Ph.D. dissertation, The Robotics Institute, Carnegie Mellon Univ., Pittsburgh, PA, Dec. 1994 (also as CMU-RI-TR-94-44).
12. S. B. Kang and K. Ikeuchi, "Toward automatic robot instruciton from perception - Temporal segmentation of tasks from human hand motion," in IEEE Robot. Automat., vol. 11, pp. 670-681, 1995.
13. _, "Grasp recognition and manipulative motion characterization from human hand sequences," in Proc. IEEE Int. Conf. on Robotics and Automation, San Diego, CA, May 1994, pp. 1759-1764.
14. _, "Toward automatic robot instruction from perception - Recognizing a grasp from observation," IEEE Trans. Robot. Automat., vol. 9, pp. 432-443, Aug. 1993.
15. _, "A grasp abstraction hierarchy for recognition of grasping tasks from observation," in Proc. IEEE/RSJ Int. Conf. Intelligent Robots and Systems, Yokohama, Japan, July 1993, pp. 621-628.
16. _, "A framework for recognizing grasps," Tech. Rep. CMU-RI-TR-91-24, Carnegie Mellon Univ., Pittsburgh, PA, Nov. 1991.
17. S. B. Kang, J. A. Webb, C. L. Zitnick, and T. Kanade, "A multibaseline stereo system with active illumination and real-time image acquisition," Int. Conf. Computer Vision, Cambridge, MA, June 20-23, 1995, pp. 88-93.
18. T. Kuniyoshi, M. Inaba, and H. Inoue, "Teaching by showing: Generating robot programs by visual observation of human performance," in Proc. 20th Int. Symp. Industrial Robots, 1989, pp. 119-126.
19. Z. Li and S. Sastry, "Task oriented optimal grasping by multifingered robot hands," in Proc. IEEE Int. Conf. Robotics and Automation, 1987, pp. 389-394.
20. X. Markenskoff and C. H. Papadimitriou, "Optimum grip of a polygon," Int. J. Robot. Res., vol. 8, no. 2, pp. 17-29, 1989.
21. M. T. Mason and J. K. Salisbury, Robot Hands and the Mechanics of Manipulation. Cambridge, MA: MIT Press, 1985.
22. J. H. Mathews, Numerical Methods for Computer Science, Engineering, and Mathematics. Englewood Cliffs, NJ: Prentice-Hall, 1987.
23. J. Napier, "The prehensile movements of the human hand," J. Bone and Joint Surgery, vol. 38B, no. 4, pp. 902-913, Nov. 1956.
24. V. Nguyen, "Constructing stable grasps in 3-D," in Proc. IEEE Int. Conf. Robotics and Automation, 1987, pp. 234-239.
25. T. Okada, "Object-handling system for manual industry," IEEE Trans. Syst., Man, Cybern., vol. SMC-9, pp. 79-89, 1979.
26. M. Okutomi and T. Kanade, "A multiple-baseline stereo," in Proc. IEEE Int. Conf. Computer Vision and Pattern Recognition, 1991, pp. 63-69.
27. N. Pollard, "Planning grasps for a robot hand in the presence of obstacles," in Proc. Int. Conf. Robotics and Automation, 1993, pp. 723-728.
28. K. Rao, G. Medioni, H. Liu, and G. A. Bekey, "Robot hand-eye coordination: Shape description and grasping," in Proc. Int. Conf. Robotics and Automation, 1988, pp. 407-411.
29. S. A. Stansfield, "Robotic grasping of unknown objects A knowledge-based approach," Int. J. Robot. Res., vol. 10, no. 4, pp. 314-326, 1991.
30. D. B. Stewart and P. K. Khosla, Chimera 3.1, The Real-Time Programming Operating System for Reconfigurable Sensor-Based Control Systems, Carnegie Melon Univ., Pittsburgh, PA, 1993.
31. T. Takahashi and H. Ogata, "Robotic assembly operation based on task-level teaching in virtual reality," in Proc. IEEE Int. Conf. Robotics and Automation, 1992, pp. 1083-1088.
32. J. A. Webb, T. Warfel, and S. B. Kang, "A scalable video rate camera interface," Tech. Rep. CMU-CS-94-192, Carnegie Mellon Univ., Pittsburgh, PA, 1994.
33. M. D. Wheeler and K. Ikeuchi, "Sensor modeling, probabilistic hypothesis generation, and robust localization for object recognition," in Proc. 2nd CAD-Based Vision Workshop, 1994, pp. 46-53.
34. J. D. Wolter, R. A. Volz, and A. C. Woo, "Automatic generation of gripping positions for assembly," in Robot Grippers, D. T. Pham and W. B. Heginbotham, Eds. Berlin, Germany: Springer-Verlag, 1986, pp. 55-74.
35. T. Yoshikawa, "Manipulability of robotic mechanisms," Int. J. Robot. Res., vol. 4, no. 2, pp. 3-9, 1985.