Combining goal inference and natural-language dialogue for human-robot joint action

CEUR Workshop Proceedings

Volumn 375, Issue , 2008, Pages 25-30

  Foster, Mary Ellen ^a   Giuliani, Manuel ^a   Müller, Thomas ^a   Rickert, Markus ^a   Knoll, Alois ^a   Erlhagen, Wolfram ^b   Bicho, Estela ^b   Hipólito, Nzoji ^b   Louro, Luis ^b  

^a TECHNICAL UNIVERSITY OF MUNICH   (Germany)

^b UNIVERSITY OF MINHO   (Portugal)

Author keywords

[No Author keywords available]

Indexed keywords

COMMUNICATIVE ACTIONS; DIALOGUE MANAGER; DYNAMIC NEURAL FIELDS; EXISTING SYSTEMS; INDIVIDUAL SYSTEMS; INTEGRATED SYSTEMS; REASONING COMPONENTS; SYSTEMS SUPPORT;

NEURAL NETWORKS;

ROBOTS;

EID: 84885213678     PISSN: 16130073     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (33)

1. E. Bicho, L. Louro, N. Hipólito, and W. Erlhagen, 'A dynamic neural field architecture for flexible and fluent human-robot interaction.', in Proceedings of the 2008 International Conference on Cognitive Systems, pp. 179-185, (2008).
2. C. Breazeal, A. Brooks, J. Gray, G. Hoffman, C. Kidd, H. Lee, J. Lieberman, A. Lockerd, and D. Chilongo, 'Tutelage and collaboration for humanoid robots', International Journal of Humanoid Robotics, 1(2), 315-348, (2004).
3. W. Erlhagen and E. Bicho, 'The dynamic neural field approach to cognitive robotics', Journal of Neural Enginering, 3, R36-R54, (2006). (Pubitemid 44262018)
4. W. Erlhagen, A. Mukovskiy, and E. Bicho, 'A dynamic model for action understanding and goal-directed imitation.', Brain Research, 1083, 174-188, (2006).
5. W. Erlhagen, A. Mukovskiy, E. Bicho, G. Panin, C. Kiss, A. Knoll, H. van Schie, and H. Bekkering, 'Goal-directed imitation for robots: a bio-inspired approach to action understanding and skill learning', Robotics and Autonomous Systems, 54, 353-360, (2006).
6. W. Erlhagen, A. Mukovskiy, F. Chersi, and E. Bicho, 'On the development of intention understanding for joint action tasks', in Proceedings of the 6th IEEE International Conference on Development and Learning, (July 2007).
7. T. Fong, C. Thorpe, and C. Baur, 'Collaboration, dialogue, and humanrobot interaction', in Robotics Research, volume 6 of Springer Tracts in Advanced Robotics, 255-266, Springer, (2003).
8. M. E. Foster, 'Roles of a talking head in a cooperative human-robot dialogue system', in Proceedings of the 7th International Conference on Intelligent Virtual Agents (IVA 2007), (September 2007).
9. M. E. Foster, E. G. Bard, R. L. Hill, M. Guhe, J. Oberlander, and A. Knoll, 'The roles of haptic-ostensive referring expressions in cooperative, task-based human-robot dialogue', in Proceedings of the 3rd ACM/IEEE International Conference on Human Robot Interaction (HRI 2008), (March 2008).
10. M. E. Foster and C. Matheson, 'Following assembly plans in cooperative, task-based human-robot dialogue', in Proceedings of Londial 2008, (June 2008).
11. M. Giuliani and A. Knoll, 'Integrating multimodal cues using grammar based models', in Proceedings of HCI International 2007, (July 2007).
12. M. Giuliani and A. Knoll. MultiML - A general purpose representation language for multimodal human utterances, 2008. Submitted.
13. N. Hawes, A. Sloman, J.Wyatt, M. Zillich, H. Jacobsson, G.-J. Kruijff, M. Brenner, G. Berginc, and D. Skočaj, 'Towards an integrated robot with multiple cognitive functions', in Proceedings of the 22nd Conference on Artificial Intelligence (AAAI 2007), (2007).
14. M. Henning, 'A new approach to object-oriented middleware', IEEE Internet Computing, 8(1), 66-75, (Jan-Feb 2004).
15. G. Hoffman and C. Breazeal, 'Effects of anticipatory action on humanrobot teamwork efficiency, fluency, and perception of team', in Proceedings of the 2nd ACM/IEEE International Conference on Human Robot Interaction (HRI 2007), (2007).
16. K.-y. Hsiao, S. Vosoughi, S. Tellex, R. Kubat, and D. Roy, 'Object schemas for responsive robotic language use', in Proceedings of the 3rd ACM/IEEE International Conference on Human Robot Interaction (HRI 2008), (2008).
17. W. G. Kennedy, M. D. Bugajska, M. Marge, W. Adams, B. R. Fransen, D. Perzanowski, A. C. Schultz, and J. G. Trafton, 'Spatial representation and reasoning for human-robot collaboration', in Proceedings of the 22nd Conference on Artificial Intelligence (AAAI 2007), (2007).
18. S. Larsson and D. R. Traum, 'Information state and dialogue management in the TRINDI dialogue move engine toolkit', Natural Language Engineering, 6, 323-340, (2000).
19. G. Metta, P. Fitzpatrick, and L. Natale, 'YARP: Yet another robot platform', International Journal of Advanced Robotics Systems, 3(1), 43-48, (2006).
20. T. Müller, P. Ziaie, and A. Knoll, 'A wait-free realtime system for optimal distribution of vision tasks on multicore architectures', in Proceedings of the 5th International Conference on Informatics in Control, Automation and Robotics, (May 2008).
21. Nuance Communications. Dragon NaturallySpeaking 9. http://www.nuance.com/ naturallyspeaking/.
22. R. Petrick, D. Kraft, K. Mourão, C. Geib, N. Pugeault, N. Krüger, and M. Steedman, 'Representation and integration: Combining robot control, high-level planning, and action learning', in Proceedings of the International Cognitive Robotics Workshop (CogRob 2008) at ECAI 2008, (July 2008).
23. M. Rickert, M. E. Foster, M. Giuliani, T. By, G. Panin, and A. Knoll, 'Integrating language, vision and action for human robot dialog systems', in Proceedings of HCI International 2007, (July 2007).
24. D. Roy, K.-Y. Hsiao, and N. Mavridis, 'Mental imagery for a conversational robot', IEEE Transactions on Systems, Man, and Cybernetics, Part B, 34(3), 1374-1383, (June 2004).
25. N. Sebanz, H. Bekkering, and G. Knoblich, 'Joint action: bodies and minds moving together', Trends in Cognitive Sciences, 10, 70-76, (2006). (Pubitemid 43177181)
26. T. Spexard, M. Hanheide, and G. Sagerer, 'Human-oriented interaction with an anthropomorphic robot', IEEE Transactions on Robotics, 23(5), 852-862, (October 2007). (Pubitemid 47577962)
27. R. Stiefelhagen, H. Ekenel, C. Fugen, P. Gieselmann, H. Holzapfel, F. Kraft, K. Nickel, M. Voit, and A. Waibel, 'Enabling multimodal human-robot interaction for the Karlsruhe humanoid robot', IEEE Transactions on Robotics, 23(5), 840-851, (October 2007). (Pubitemid 47577961)
28. D. Traum and S. Larsson, 'The information state approach to dialogue management', in Current and New Directions in Discourse and Dialogue, eds., J. C. J. Van Kuppevelt and R. W. Smith, 325-353, Kluwer Academic Publishers, (2003).
29. A. J. N. van Breemen, 'iCat: Experimenting with animabotics', in Proceedings of the AISB 2005 Creative Robotics Symposium, (2005).
30. G.Westphal, C. von der Malsburg, and R.Würtz, 'Feature-driven emergence of model graphs for object recognition and categorization', in Applied Pattern Recognition, eds., A. Kandel, H. Bunke, and M. Last, 155-199, Springer Verlag, (2008).
31. M. White, 'Efficient realization of coordinate structures in Combinatory Categorial Grammar', Research on Language and Computation, 4(1), 39-75, (2006). (Pubitemid 43830209)
32. H. Zender, P. Jensfelt, Ó .MartinezMozos, G.-J.M. Kruijff, andW. Burgard, 'An integrated robotic system for spatial understanding and situated interaction in indoor environments', in Proceedings of the 22nd Conference on Artificial Intelligence (AAAI 2007), (July 2007).
33. P. Ziaie, T. Müller, M. E. Foster, and A. Knoll, 'Using a naïve Bayes classifier based on k-nearest neighbors with distance weighting for static hand-gesture recognition in a human-robot dialog system', in Proceedings of CSICC 2008, (March 2008).