Recognizing assembly tasks through human demonstration

International Journal of Robotics Research

Volumn 26, Issue 7, 2007, Pages 641-659

  Takamatsu, Jun ^a   Ogawara, Koichi ^a   Kimura, Hiroshi ^b   Ikeuchi, Katsushi ^c  

^a INSTITUTE OF INDUSTRIAL SCIENCE   (Japan)

^b UNIVERSITY OF ELECTRO COMMUNICATIONS   (Japan)

^c UNIVERSITY OF TOKYO   (Japan)

Author keywords

Assembly planning; Learning from observation; Movement primitives

Indexed keywords

DEGREES OF FREEDOM (MECHANICS); LEARNING SYSTEMS; LOGIC PROGRAMMING; OBJECT RECOGNITION; REAL TIME SYSTEMS; STEREO VISION;

ASSEMBLY PLANNING; MOVEMENT PRIMITIVES; OBSERVATION LEARNING;

ROBOTICS;

EID: 34250639960     PISSN: 02783649     EISSN: 17413176     Source Type: Journal    
DOI: 10.1177/0278364907080736     Document Type: Article

References (39)

1. Besl, P. and McKay, N. (1992). A method for registration of 3-d shapes. IEEE Transactions on Pattern Analysis and Machine Intelligence, 14 (2). 239 256.
2. Dillmann, R. and Bordegoni, M. (1999). Learning robot behavior and skills based on human demonstration and advice: The machine learning paradigm. International Symposium on Robotics Research, pp. 229238.
3. Donald, B.R. (1987). A search algorithm for motion planning with six degrees of freedom. Artificial Intelligence, 31 (3). 295 353.
4. Ehrenmann, M., Zollner, R., Knoop, S., and Dillmann, R. (2001). Sensor fusion approaches for observation of user actions in programing by demonstration. IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems, Baden-Baden, Germany.
5. Fukuda, T., Nakaoka, M., Ueyama, T., and Hasegawa, Y. (2001). Direct teaching and error recovery method for assembly task based on a transition process of a constraint condition. IEEE International Conference on Robotics and Automation, pp. 15181523.
6. Goeree, B.B., Fasse, E.D., and Marefat, M.M. (2000). Determining feasible contact state of pairs of spatial polyhedra. IEEE International Conference on Robotics and Automation, pp. 13961401.
7. Hasegawa, T., Suehiro, T., and Takase, K. (1992). A model-based manipulation system with skill-based execution. IEEE Transactions on Robotics and Automation, 8 (5). 535 545.
8. Hirai, S., Asada, H., and Tokumaru, H. (1988). Kinematic analysis of contact state transitions in assembly operations and automatic generation of transition network. Journal of the Society of Instrument and Control Engineers, 24 (4). 406 413.
9. Hirukawa, H. (1996). On motion planning of polyhedra in contact. Workshop on Algorithmic Foundation of Robotics.
10. Hirukawa, H., Matsui, T., and Takase, K. (1994). Automatic determination of possible velocity and applicable force of frictionless objects in contact from a geometric model. IEEE Transactions on Robotics and Automation, 10 (3). 309 322.
11. Ikeuchi, K. and Suehiro, T. (1994). Toward an assembly plan from observation: Part I: Task recognition with polyhedral objects. IEEE Transactions on Robotics and Automation, 10 (3). 368 385. 1994.
12. Jones, R.E., Wilson, R.H., and Calton, T.L. (1998). On constraints in assembly planning. IEEE Transactions on Robotics and Automaiton, 14 (6). 849 963.
13. Kanade, J., Kano, H., Kimura, S., Kawamura, E., Yoshida, A., and Oda, K. (1997). Development of a video-rate stereo machine. Journal of the Robotics Society of Japan, 15 (2). 261 267.
14. Kang, S.B. (1994). Robot instruction by human demonstration. PhD thesis, Carnegie Mellon University.
15. Keni, B., Ogawara, K., Ikeuchi, K., and Dillmann, R. (2003). A hidden markov model based sensor fusion approach for recgnizing continuous human grasping sequences. Third IEEE International Conference on Humanoid Robots, Munich and Karlsruhe, Germany.
16. Kuhn, H.W. and Tucker, A.W. (1956). Linear inequalities and related systems. Annals of Mathematics Studies, Princeton University Press, USA.
17. Kuniyoshi, Y., Inaba, M., and Inoue, H. (1994). Learning by watching: Extracting reusable task knowledge from visual observation of human performance. IEEE Transactions on Robotics and Automation, 10 (6). 799 822.
18. Latombe, J.C. (1991). Robot Motion Planning. Kluwer Academic Publishers.
19. Lozano-Perez, T., Mason, M.T., and Taylor, R.H. (2000). Automatic synthesis of fine-motion strategies for robotics. International Journal of Robotics Research, 3 (1). 3 24.
20. Maeda, Y., Ishido, N., Kikuchi, H., and Arai, T. (2002). Teaching of grasp/graspless manipulation for industrial robots by human demonstration. IEEE International Conference on Intelligent Robots and Systems, pp. 15231528.
21. Miura, J. and Ikeuchi, K. (1998). Task-oriented generation of visual sensing strategies in assembly tasks. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(2): 126138.
22. Ogawara, K., Iba, S., Tanuki, T., Kimura, H., and Ikeuchi, K. (2001). Acquiring hand-action models by attention point analysis. IEEE International Conference on Robotics and Automations, pp. 465470.
23. Ogawara, K., Takamatsu, J., Iba, S., Tanuki, T., Sato, Y., Saegusa, A., Kimura, H., and Ikeuchi, K. (2000). Acquiring hand-action models in task and behavior levels by a learning robot through observing human demonstrations. The First IEEE-RAS International Conference on Humanoid Robots, Cambridge, USA.
24. Ohwovoriole, M.S. and Roth, B. (1981). An extension of screw theory. Journal of Mechanical Design, 103: 725 735.
25. Ong, C. and Gilbert, E.G. (1996). Growth distance: New measures for object separation and penetration. IEEE International Transactions on Robotics and Automation, 12 (6). 888 903.
26. Onda, H., Ogasawara, T., Hirukawa, H., Kitagaki, K., Nakamura, A., and Tsukune, H. (2000). A telerobotics system using planning functions based on manipulation skills and teaching-by-demonstration technique in vr. Journal of the Robotics Society of Japan, 18 (7). 979 994.
27. Pan, F. and Schimmels, J.M. (2003). Efficient contact state graph generation for assembly application. IEEE International Conference on Robotics and Automation, pp. 2592 2598.
28. Schaal, S. (1999). Is imitation learning the route to humanoid robots? Trends in Cognitive Sciences, 3: 233 242.
29. Suehiro, T. and Ikeuchi, K. (1992). Towards an assembly plan from observation: Part II: Correction of motion parameters based on fact contact constraints. IEEE International Conference on Intelligent Robots and Systems, July, pp. 2096 2102.
30. Takamatsu, J., Kimura, H., and Ikeuchi, K. (2002). Calculating optimal trajectories from contact transitions. IEEE International Conference on Intelligent Robots and Systems, pp. 232237.
31. Thomas, U., Finkemeyer, B., Kroger, T., and Wahl, F.M. (2003). Error-tolerant execution of complex robot tasks based on skill primitives. IEEE International Conference on Robotics and Automation, pp. 30693075.
32. Tsuda, M., Takahashi, T., and Ogata, H. (2000). Generation of an assembly-task model analyzing human demonstration. Journal of the Robotics Society of Japan, 18 (4). 535 544.
33. Uchiyama, M. and Imahashi, K. (1994). Computer-aided rule generation for a rule-based artificial dexterity system. Journal of the Robotics Society of Japan, 12 (3). 459 465.
34. Wheeler, M.D. and Ikeuchi, K. (1995). Sensor modeling, probabilistic hypothesis generation, and robust localization for object recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 17: 252 265.
35. Xiao, J. and Ji, X. (2000). A divide-and-merge approach to automatic generation of contact states and planning of contact motion. IEEE International Conference on Robotics and Automation, pp. 750756.
36. Xiao, J. and Zhang, L. (1996). Toward obtaining all possible contacts - growing a polyhedron by its location uncertainty. IEEE Transactions on Robotics and Automation, 12(4): 553565.
37. Yokokohji, Y. (1993). Classification of contact states and planning of assembly sequence. Journal of the Robotics Society of Japan, 11 (2). 185 191.
38. Yu, Y. and Yoshikawa, T. (2000). Evaluation of contact stability between objects. Journal of the Robotics Society of Japan, 18 (7). 1026 1033.
39. Zllner, R., Rogalla, O., Dillmann, R., and Zllner, M. (2002). Understanding users intention: Programming fine manipulation tasks by demonstration. Proceedings of IEEE International Conference on Robots and Systems, pp. 1114 1119.