Toward Automatic Robot Instruction from Perception—Recognizing a Grasp from Observation

IEEE Transactions on Robotics and Automation

Volumn 9, Issue 4, 1993, Pages 432-443

  Kang, Sing Bing ^a   Ikeuchi, Katsushi ^a  

^a CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AUTOMATION; MANIPULATORS; ROBOT PROGRAMMING; ROBOTIC ASSEMBLY;

ASSEMBLY PLAN FROM OBSERVATION (APO); AUTOMATIC ROBOT INSTRUCTION; LOW-LEVEL HAND CONFIGURATION; STATIC GRASP PHASE;

PROGRAMMABLE ROBOTS;

EID: 0027644513     PISSN: 1042296X     EISSN: None     Source Type: Journal    
DOI: 10.1109/70.246054     Document Type: Article

References (43)

1. P. Allen, “Object recognition using vision and touch,” Ph.D. dissertation, Univ. Penn., 1985.
2. K. N. An, E. Y. Chao, W. P. Cooney, and R. L. Linscheid, “Normative model of human hand for biomechanical analysis,” J. Biomech., vol. 12, 1979, pp. 775–788.
3. M. A. Arbib, T. Iberall, and D. M. Lyons, “Coordinated control programs for movements of the hand,” Hand Function and the Neocortex, A. W. Goodwin, and I. Darian-Smith, Eds. New York: Springer-Verlag, 1985, pp. 111–129.
4. H. Asada, and Y. Asari, “The direct teaching of tool manipulation skills via the impedance identification of human motions,” in Proc. IEEE Int. Conf. Robotics Automat., 1988, pp. 1269–1274.
5. C. Bard, J. Troccaz, and G. Vercelli, “Shape analysis and hand preshaping for grasping,” in Proc. IEEE/RSJ Int. Workshop Intelligent Robots and Syst., 1991, pp. 64–69.
6. L. Bologni, S. Caselli, and G. Vassura, “On grasp categorization for a dextrous robotic hand,” in Proc. Int. Symp. Sensorial Integration for Industrial Robots, Zaragoza, Spain, 1989, 281–286.
7. B. Buchholz, and T.J. Armstrong, “A kinematic model of the human hand to evaluate its prehensile capabilities,” J. Biomech., vol. 25, no. 2, pp. 149–162, 1992.
8. S. Caselli, E. Faldella, and F. Zanichelli, “Grasp synthesis for a dextrous robotic hand using a multi-layer perceptron,” in Proc. 6th Mediterranean Electrotech. Conf, 1991, pp. 916–922.
9. M. R. Cutkosky, “On grasp choice, grasp models and the design of hands for manufacturing tasks,” IEEE Trans. Robotics Automat., vol. 5, pp. 269–279, 1989.
10. M. R. Cutkosky and R. D. Howe, “Human grasp choice and robotic grasp analysis,” Dextrous Robot Hands, S. T. Venkataraman, and T. Iberall, Eds. New York: Springer-Verlag, 1990, p. 531.
11. M. R. Cutkosky and P. K. Wright, “Modeling manufacturing grips and correlations with the design of robotic hands,” in Proc. IEEE Int. Conf Robotics Automat., 1986, pp. 1533–1539.
12. R. Finkel, R. Taylor, R. Bolles, R. Paul, and J. Feldman, “AL: A programming system for automation,” Tech. Rep. AIM-177, Stanford Univ., Artificial Intell. Lab., 1974.
13. W.A. Gruver, B.I. Soroka, J.J. Craig, T.L. Turner, “Evaluation of commercially available robot programming languages,” in Proc. 13th Int. Symp. Indus. Robots, 1983, pp. 12–58.
14. T. Iberall, “The nature of human prehension: three dextrous hands in one,” in Proc. IEEE Int. Conf. Robotics Automat., 1987, pp. 396–401.
15. T. Iberall, “A neural network for planning hand shapes in human prehension,” in Proc. Amer. Contr. Conf., 1988, pp. 2288–2293.
16. T. Iberall, G. Bingham, and M.A. Arbib, “Opposition space as a structuring concept for the analysis of skilled hand movements,” Experimental Brain Research Series 15 Generation and Modulation of Action Patterns H. Heuer and C. Fromm, Eds. New York: Springer-Verlag, 1986, pp. 158–173.
17. T. Iberall, J. Jackson, L. Labbe, and R. Zampano, “Knowledge-based prehension: capturing human dexterity,” in Proc. IEEE Int. Conf Robotics Automat., 1988, pp. 82–87.
18. T. Iberall, and C.L. MacKenzie, “Opposition space and human prehension,” Dextrous Robot Hands, S. T. Venkataraman and T. Iberall, Eds. New York: Springer-Verlag, 1990, pp. 32–54.
19. K. Ikeuchi, and M. Hebert, “Task oriented vision,” CMU Tech Rep CMU-CS-91-163, July 1991.
20. K. Ikeuchi, and T. Suehiro, ' ‘Toward an assembly plan from observation: Task recognition with polyhedral objects,” CMU Tech. Rep. CMU-CS-91-167, Aug. 1991.
21. M. Jeannerod, “The timing of natural prehension movements,” J. Motor Beh., vol. 16, no. 3, 1984, pp. 235–254.
22. Joint Motion: Method of Measuring and Recording, Amer. Acad. Orthopedic Surgeons, Chicago, 1965.
23. M. Kaneko, and K. Tanie, “Contact point detection for grasping of an unknown object using joint compliance,” in Proc. IEEE/RSJ Int. Conf. Intelligent Robots Syst., 1990, pp. 845–851.
24. S.B. Kang, and K. Ikeuchi, “A framework for recognizing grasps,” CMU Tech. Rep. CMURI-TR-91-24, Nov. 1991.
25. T. Kuniyoshi, M. Inaba, and H. Inoue, ' ‘Teaching by showing: Generating robot programs by visual observation of human performance,” in Proc. 20th Int. Symp. Indus. Robots, 1989, pp. 119–126.
26. P. Lammineur, and O. Cornillie, Industrial Robots. New York: Pergammon, 1984, pp. 43–54.
27. Z. Li, and S. Sastry, ' ‘Task oriented optimal grasping by multifingered robot hands,” in in Proc. IEEE Int. Conf. Robotics Automat., pp. 389–394, 1987.
28. C. Long, P. W. Conrad, E. A. Hall, and S. L. Furler, “Intrinsic-extrinsic muscle control of the hand in power grip and precision handling,” J. Bone and Joint Surgery, vol. 52-A, no. 5, pp. 853–867, 1970.
29. T. LozanoPerez, “Automatic planning of manipulator transfer movements,” IEEE Trans, on Systems, Man and Cybernetics, SMC-11(10), 1981, pp. 681–689.
30. D.M. Lyons, “A simple set of grasps for a dextrous hand,” in Proc. IEEE Int. Conf. Robotics Automat., 1985, pp. 588–593.
31. J. Napier, “The prehensile movements of the human hand,” J. Bone and Joint Surgery, vol. 38B, no. 4, Nov. 1956, pp. 902–913.
32. T. N. Nguyen, and H. E. Stephanou, “A topological model of multifingered prehension,” in Proc. IEEE Int. Conf. Robotics Automat., 1989, pp. 446–451.
33. ——, “A computational model of prehensility and its application to dextrous manipulation,” in Proc. IEEE Int. Conf. Robotics Automat., 1991, pp. 878–883.
34. V. Nguyen, “Constructing stable grasps in 3-D,” in Proc. IEEE Int. Conf. Robotics Automat., 1987, pp. 234–239.
35. L. Pao, and T. H. Speeter, ' ‘Transformation of human hand positions for robotic hand control,” in Proc. IEEE Int. Conf. Robotics Automat., 1989, 1758–1763.
36. K. Perlin, J. W. Demmel, and P. K. Wright, “Simulation software for the Utah/MIT dextrous hand,” Robotics and Computer-Integrated Manufacturing, vol. 5, no. 4, pp. 281–292, 1989.
37. H. Rijpkema, and M. Girard, “Computer animation of knowledge-based human grasping,” Comput. Graphics, vol. 25, no. 4, 339–348, 1991.
38. G. Schlesinger, “Der mechanische aufbau der kunstlichen Glieder,” Er-satzglieder und Arbeitshilfen fur Kriegsbeschadigte und Unfallverletzte, Borchardt, et al., Eds. New York: Springer, 1919, pp. 321–699.
39. C. Sollerman, “Grip function of the hand: Analysis, evaluation and a new method,” Hand Surgery, Dept. Orthopaedic Surgery, Sahlgren Hospital, Univ. Goteberg, Goteberg, Sweden, 1980.
40. S.A. Stansfield, “Visually-aided tactile exploration,” in Proc. IEEE Int. Conf. Robotics Automat., 1987, pp. 1487–1492.
41. P.D. Summers, and D.D. Grossman, “XPROBE: An experimental sys tem for programming robots by example,” The Int. J. Robotics Res., vol. 3, no. 1, 1984, pp. 25–39.
42. C.L. Taylor, and R.J. Schwarz, “The anatomy and mechanics of the human hand,” Artificial Limbs, no. 2, 1955, pp. 22–35.
43. R. Tomovic, G.A. Bekey, and W.J. Karplus, “A strategy for grasp synthesis with multifingered robot hands,” in Proc. IEEE Int. Conf. Robotics Automat., 1987, pp. 83–89.