Toward Automatic Robot Instruction from PerceptionTemporal Segmentation of Tasks from Human Hand Motion

IEEE Transactions on Robotics and Automation

Volumn 11, Issue 5, 1995, Pages 670-681

  Ikeuchi, Katsushi ^b  

^a HEWLETT PACKARD COMPANY   (United States)

^b CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AUTOMATION; CHARACTERIZATION; COMPUTATIONAL GEOMETRY; DEMONSTRATIONS; END EFFECTORS; MANIPULATORS; MOTION PLANNING; SPEED;

ASSEMBLY PLAN FROM OBSERVATION PARADIGM; AUTOMATIC PROGRAMMING; GRASPING TASK; HAND OBJECT INTERACTION; HIGH LEVEL TASK SPECIFICATIONS; HUMAN HAND MOTION; TASK PROGRAMMING; TEMPORAL TASK SEGMENTATION;

ROBOT PROGRAMMING;

EID: 0029394488     PISSN: 1042296X     EISSN: None     Source Type: Journal    
DOI: 10.1109/70.466599     Document Type: Article

References (52)

1. Space Isotrak Users Manual, Polhemus, Inc. Jan. 1992.
2. M. A. Arbib, T. Iberall, and D. M. Lyons, “Coordinated control programs for movements of the hand,” Hand Function and the Neocortex, A. W. Goodwin and I. Darian-Smith, Ed. Berlin, West Germany: Springer-Verlag, 1985, pp. 111-129.
3. H. Asada and Y. Asari, “The direct teaching of tool manipulation skills via the impedance identification of human motions,” in Proc. IEEE Int. Conf. Robot. Automat., 1988, pp. 1269-1274.
4. P. Balakumar, J. C. Robert, R. Hoffman, K. Ikeuchi, and T. Kanade, “VANTAGE: A Frame-based Geometric Modeling SystemProgrammer/Users Manual,” Carnegie Mellon Univ., Dec. 1988.
5. C. Bard, J. Troccaz, and G. Vercelli, “Shape analysis and hand preshaping for grasping,” in Proc. IEEE/RSJ Int. Workshop Intell. Robots Syst., 1991, pp. 64-69.
6. H. J. Buchner, M. J. Hines, and H. Hemami, “A dynamic model for finger interphalangeal coordination,” J. Biomech., vol. 21, no. 6, pp. 459-468, 1988.
7. T. Cao and A.C. Sanderson, Task sequence planning in a robot workcell using AND/OR nets,” in Proc. IEEE Int. Symp. Intell Contr., 1991, pp. 13-15.
8. M. R. Cutkosky, “On grasp choice, grasp models and the design of hands for manufacturing tasks,” IEEE Trans. Robot. Automat., vol. 5, pp. 269-279 1989.
9. CyberGloveTM System Documentation, Virtual Technologies, June 1992.
10. R. Finkel, R. Taylor, R. Bolles, R. Paul, and J. Feldman, “AL: A programming system for automation,” Artificial Intelligence Lab., Stanford Univ., Tech. Rep. AIM-177, 1974.
11. W. A. Gruver, B. I. Soroka, J. J. Craig, and T. L. Turner, “Evaluation of commercially available robot programming languages,” in Proc. 13th Int. Symp. Ind. Robots, 1983, pp. 12-58.
12. T. Hamada, K. Kamejima, and I. Takeuchi, “Image based operation; A human-robot interaction architecture for intelligent manufacturing,” in Proc. 15th Conf. IEEE Ind. Elect. Soc., 1989, pp. 556-561.
13. T. Hasegawa, T. Suehiro, and K. Takase, “A model-based manipulation system with skill-based execution,” IEEE Trans. Robot. Automat., vol. 8, pp. 535-544, 1992.
14. H. Hashimoto and M. Buss, “Skill acquisition for the intelligent assisting system using virtual reality simulator,” in Proc. 2nd Int. Conf. Art. Reality Tele-Existence (ICAT 92), Tokyo, Japan, 1992, pp. 37-46.
15. S. Hirai and T. Sato, “Motion understanding for world model management of telerobot,” in Proc. 5th Int. Symp. Robot. Res., 1989, pp. 5-12.
16. W. Iba, “Acquisition and improvement of human motor skills: Learning through observation and practice,” Artificial Intell. Res. Branch, NASA Ames Res. Center, Tech. Rep. RIA-91-29, Oct. 1991.
17. T. Iberall, J. Jackson, L. Labbe, and R. Zampano, “Knowledge-based prehension: Capturing human dexterity,” in Proc. IEEE Int. Conf. Robot. Automat., 1988, pp. 82-87.
18. K. Ikeuchi and T. Suehiro, “Toward an Assembly Plan from Observation, Part I: Task recognition with polyhedral objects,” IEEE Trans. Robot. Automat., vol. 10, pp. 368-385, 1994.
19. M. Jeannerod, “Intersegmental coordination during reaching at natural visual objects,” in Attention and Performance IX, J. Long and A. Baddley, Ed. Hillsdale, NJ: Erlbaum, 1981, pp. 153-168.
20. M. Jeannerod, “The timing of natural prehension movements,” J. Motor Behav., vol. 16, no. 3, 1984, pp. 235-254.
21. S. B. Kang, J. A. Webb, T. Kanade, and C. L. Zitnick, “An active multibaseline stereo system with real-time image acquisition,” in Int. Conf. Comp. Vision, Cambridge, MA, June 20-23, 1995.
22. S. B. Kang and K. Ikeuchi, “Robot task programming by human demonstration: Mapping human grasps to manipulator grasps,” in Proc. IEEE/RSJ/GI Int. Conf. Intell. Robots Syst., Munchen, Germany, Sept. 1994, pp. 97-104.
23. “Toward automatic robot instruction from perceptionRecognizing a grasp from observation,” IEEE Trans. Robot. Automat., vol. 9, pp. 432-443, 1993.
24. “A grasp abstraction hierarchy for recognition of grasping tasks from observation,” in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst., July 1993, pp. 194-201.
25. M. Kass, A. Witkin, and D. Terzopoulos, “Snakes: Active contour models,” Int. J. Comp. Vision, vol. 2, no. 1, 1987, pp. 322-331.
26. “Knowledge Craft ManualVol. I: CRL Technical Manual,” Carnegie Group, Inc., 1989.
27. T. Kuniyoshi, M. Inaba, and H. Inoue, Teaching by showing: Generating robot programs by visual observation of human performance,” in Proc. 20th Int. Symp. Ind. Robots, 1989, pp. 119-126.
28. P. Lammineur and O. Cornillie, Industrial Robots. Pergammon Press, 1984, pp. 43-54.
29. J. M. F. Landsmeer, “Power grip and precision handling,” Ann. Rheum. Dis., vol. 21, 1962, pp. 164-170.
30. H. Liu, T. Iberall, and G. A. Bekey, “The multi-dimensional quality of task requirements for dextrous robot hand control,” in Proc. IEEE Int. Conf. Robot. Automat., 1989, pp. 452-457.
31. T. Lozano-Perez, “Automatic planning of manipulator transfer movements,” IEEE Trans. Syst. Man Cybernet., vol. SMC-11, pp. 681-689, 1981.
32. D. M. Lyons, “A simple set of grasps for a dextrous hand,” in Proc. IEEE Int. Conf. Robot. Automat., 1985, pp. 588-593.
33. C. L. MacKenzie and J. Van den Biggelaar, “The effects of visual information, object motion, and size on reaching and grasping kinematics,” Soc. Neurosci. Abstracts, vol. 13, part 1, pg. 351, 1987.
34. R.G. Marteniuk and S. Athenes, “Characteristics of natural prehension movements for objects of verying size,” Soc. Neurosci. Abstracts, vol. 12, part 2, pg. 970, 1986.
35. R. G. Marteniuk, C. L. MacKenzie, M. Jeannerod, S. Athenes, and C. Dugas, “Constraints on human arm movement trajectories,” Can. J. Psych., vol. 41, no. 3, pp. 365-378, 1987.
36. M. T. Mason and J. K. Salisbury, Robot Hands and the Mechanics of Manipulation. Cambridge, MA: MIT Press, 1985.
37. K. Meyer and H. L. Applewhite, “A survey of position trackers,” Presence, vol. 1, no. 2, 173-200, 1992.
38. B. J. McCarragher and H. Asada, “A discrete event approach to the control of robotic assembly tasks,” in Proc. IEEE Int. Conf Robot. Automat., vol. 1, 1993, pp. 331-336.
39. P. Morasso, “Spatial control of arm movements,” Experiment. Brain Res., vol. 42, no. 1, pp. 223-227, 1981.
40. K. Perlin, J. W. Demmel, and P. K. Wright, “Simulation software for the Utah/MIT dextrous hand,” Robot. Comp.-Integrated Manufact., vol. 5, no. 4, pp. 281-292, 1989.
41. P. K. Pook and D. H. Ballard, “Recognizing teleoperated manipulations,” in Proc. IEEE Int. Conf. Robot. Automat., vol. 2, 1993, pp. 578-585.
42. H. Rijpkema and M. Girard, “Computer animation of knowledge-based human grasping,” Comp. Graphics, vol. 25, no. 4, pp. 339-348, 1991.
43. J. M. Rubin and W. A. Richards, “Boundaries of visual motion,” Artificial Intelligence Laboratory, Massachusetts Institute of Technology, Tech. Rep. AIM-835, Apr. 1985.
44. T. M. Sobh and R. Bajcsy, “Visual observation under uncertainty as a discrete event process,” in Proc. 11th Int. Conf. Patt. Recog., vol. 1, 1992, pp. 429-432.
45. T. H. Speeter, “Transforming human hand motion for telemanipulation,” Presence, vol. 1, no. 1, pp. 63-79, 1992.
46. “Control of the Utah/MIT dextrous hand: Hardware and software hierarchy,” J. Robot. Syst., vol. 7, no. 5, pp. 759-790, Oct. 1990.
47. D. B. Stewart and P. K. Khosla, “Chimera 3, the real-time programming operating system for reconfigurable sensor-based control systems,” Carnegie Mellon Univ., 1993.
48. T. Takahashi and H. Ogata, “Robotic assembly operation based on task-level teaching in virtual reality,” in Proc. IEEE Int. Conf. Robot. Automat., 1992, pp. 1083-1088.
49. D. Terzopoulos, A. Witkin, and M. Kass, “Constraints on deformable models: Recovering 3-D shape and nonrigid motion,” Art. Intell, vol. 36, pp. 91-123, 1988.
50. R. Tomovic, G. A. Bekey, and W. J. Karplus, “A strategy for grasp synthesis with multifingered robot hands,” in Proc. IEEE Int. Conf. Robot. Automat., 1987, pp. 83-89.
51. A. M. Wing and C. Fraser, “The contribution of the thumb to reaching movements,” Q. J. Experiment. Psych., vol. 35A, pp. 297-309, 1983.
52. M. D. Wheeler and K. Ikeuchi, “Sensor modeling, probabilistic hypothesis generation, and robust localization for object recognition,” in Proc. 2nd. CAD-Based Vision Workshop, 1994, pp. 46-53.