Multi-modal human-machine communication for instructing robot grasping tasks

IEEE International Conference on Intelligent Robots and Systems

Volumn 2, Issue , 2002, Pages 1082-1088

  McGuire, P ^a   Fritsch, J ^a   Steil, J J ^a   Rothling F ^a   Fink, G A ^a   Wachsmuth, S ^a   Sagerer, G ^a   Ritter, H ^a  

^a BIELEFELD UNIVERSITY   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

COGNITIVE SYSTEMS; HUMAN COMPUTER INTERACTION; NEURAL NETWORKS; ROBOT PROGRAMMING; SENSORY PERCEPTION; SPEECH RECOGNITION; STATISTICAL METHODS;

FINITE STATE MACHINES; GESTURAL INSTRUCTION; LINGUISTIC INFORMATION; MULTI-MODAL TASK-ORIENTED MAN-MACHINE COMMUNICATION; VISUAL ATTENTION;

INTELLIGENT ROBOTS;

EID: 0036448774     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (23)

1. P.K. Allen, A. Miller, P. Y. Oh, and B. Leibowitz, Integration of vision, force and tactile sensing for grasping. Int. J. Intelligent Machines, 4(1):129-149, 1999.
2. P. Bakker and Y. Kuniyoshi. Robot see, robot do: An overview of robot imitation. In Proc. AISB workshop Learning in Robots and Animals, pages 3-11, Brighton, UK, 1996.
3. C. Bauckhage, G. A. Fink, J. Fritsch, F. Kummert, F. Lömker, G. Sagerer, and S. Wachsmuth. An Integrated System for Cooperative Man-Machine Interaction. In IEEE Int. Symp. on Comp. Int. in Robotics and Automation, pages 328-333, 2001.
4. H. Brandt-Pook, G. A. Fink, S. Wachsmuth, and G. Sagerer. Integrated recognition and interpretation of speech for a construction task domain. In Proc. Int. Conf. on Human-Computer Interaction, volume 1, pages 550-554, 1999.
5. C. Breazeal and B. Scassellati. A context-dependent attention system for a social robot. In Proc. IJCA199, pages 1146-1151, Stockholm, Sweden, 1999.
6. C. Breazeal and B. Scassellati. Challenges in building robots that imitate people. In K. Dautenhahn and C. Nehaniv, editors, Imitation in Animals and Artifacts. MIT Press, in press.
7. R. A. Brooks, C. Breazeal, M. Marjanovic, B. Scassellati, and M. M. Williamson. The COG project: Building a humanoid robot. In C. L. Nehaniv, editor, Computation for Metaphors, Analogy and Agents, LN AI 1562, Springer, 1999.
8. R. Dillmann, M. Kaiser, and A. Ude. Acquisition of elementary robot skills from human demonstration. In In International Symposium on Intelligent Robotic Systems, pages 185-192, Pisa, Italy, 1995.
9. J. A. Driscoll, R. A. Peters II, and K. R. Cave. A visual attention network for a humanoid robot. In Proc. IROS 1998, Victoria, B.C., October 12-16, 1998.
10. G. A. Fink. Developing HMM-based recognizers with ESMERALDA. In V. Matoušek, P. Mautner, J. Ocelíková, and P. Sojka, editors, LN in AI, volume 1692, pages 229-234 Berlin, 1999 Springer.
11. G. A. Fink, N. Jungclaus, H. Ritter, and G. Sagerer. A communications framework for heterogeneous distributed pattern analysis. In Int. Conf. on Algorithms and Architectures for Parallel Processing, pages 881-890, Brisbane, 1995.
12. GRAVIS-homepage http://www.TechFak.UniBielefeld.DE/agas/ni/projects/cogn tivrobot/GRAVIS/GRAVIS.html
13. S. Shiry Ghidary, M. Hattori, S. Tadokoro, and T. Takamori, Multi-modal human robot interaction for map generation. In Proc. IROS2001, pages 2246-2251, 2001.
14. A. J. Ijspeert, J. Nakanishi, and S. Schaal. Trajectory formation for limitation with nonlinear dynamical systems. In Proc. IROS, pages 752-757, 2001.
15. N. Jungclaus, R. Rae, and H. Ritter. An integrated system for advanced human-computer interaction. In UCSB-Workshop on Signals and Images, pages 93-97, University of California, USA, 1998.
16. Y. Kuniyoshi, M. Inaba, and H. Inoue. Learning by watching: extracting reusable task knowledge from visual observation of human performance. IEEE. Trans. Robotics Automation, 10(6):799-822, 1994.
17. P. McKevitt, editor. Integration of natural language and vision processing. Kluwer, Dordrecht, 1994.
18. J. Pauli. Learning to recognize and grasp objects. Autonomous Robots, 5:407-420, 1998.
19. G. Rickhei and I. Wachsmuth. Collaborative research centre "Situated Artificial Communicators" at the University of Bielefeld, Germany. Artificial Intelligence Reviews, 10(3-4):165-170, 1996.
20. J. J. Steil, G. Heidemann, J. Jockusch, R. Rae, N. Jungclaus, and H. Ritter. Guiding attention for grasping tasks by gestural instruction: The GRAVIS-robot architecture. In Proc. IROS 2001, pages 1570-1577, IEEE, 2001.
21. S. Vijayakumar, J. Conradt, T. Shibata, and S. Schaal. Overt visual attention for a humanoid robot. In Proc. IROS, pages 2332-2337, 2001.
22. S. Wachsmuth, H. Brandt-Pook, G. Socher, F. Kummert, and G. Sagerer. Multilevel integration of vision and speech understanding using bayesian networks. In H. I. Christensen, editor, Computer Vision Systems: First Int. Conf., pages 231-254, 1999.
23. M. Yeasin and S. Chaudhuri. Automatic robot programming by visual demonstration of task execution. In Proc. of Int. Conf. on Advanced Robotics, Monterey, CA, June 1997.