Integrating verbal and nonverbal communication in a dynamic neural field architecture for human-robot interaction

Frontiers in Neurorobotics

Volumn 4, Issue MAY, 2010, Pages

  Bicho, Estela ^a   Louro, Luís ^a   Erlhagen, Wolfram ^a  

^a UNIVERSITY OF MINHO   (Portugal)

Author keywords

Goal inference; Joint action; Mirror system; Natural communication; Neural fields

Indexed keywords

EID: 78649902791     PISSN: None     EISSN: 16625218     Source Type: Journal    
DOI: 10.3389/fnbot.2010.00005     Document Type: Article

References (48)

1. Alami, R., Clodic, A., Montreuil, V., Sisbot, E. A., and Chatila, R. (2005). "Task planning for human-robot interaction," in Proceedings of the 2005 Joint Conference on Smart Objects and Ambient Intelligence. ACM International Conference Proceeding Series, Vol. 121, Grenoble, 81-85.
2. Amari, S. (1977). Dynamics of pattern formation in lateral-inhibitory type neural fields. Biol. Cybern. 27, 77-87.
3. Arbib, M. A. (2005). From monkey-like action recognition to human language: an evolutionary framework for neurolinguistics. Behav. Brain Sci. 28, 105-168.
4. Aziz-Zadeh, L., Wilson, S. M., Rizzolatti, G., and Iacoboni, M. (2006). Congruent embodied representations for visually presented actions and linguistic phrases describing actions. Curr. Biol. 16, 1818-1823.
5. Barsalou, L. W., Simmons, W. K., Barbey, A. K., and Wilson, C. (2003). Grounding conceptual knowledge in modality-specific systems. Trends Cogn. Sci. (Regul. Ed.) 7, 84-91.
6. Bicho, E., Louro, L., Hipolito, N., and Erlhagen, W. (2008). "A dynamic neural field architecture for flexible and fluent human-robot interaction," in Proceedings of the 2008 International Conference on Cognitive Systems (Germany: University of Karlsruhe), 179-185.
7. Bicho, E., Louro, L., Hipolito, N., and Erlhagen, W. (2009). "A dynamic field approach to goal inference and error monitoring for human-robot interaction," in Proceedings of the 2009 International Symposium on New Frontiers in Human-Robot Interaction, ed. K. Dautenhahn (Edinburgh: AISB 2009 Convention, Heriot-Watt University), 31-37.
8. Billard, A. (2002). "Imitation: a means to enhance learning of a synthetic proto-language in autonomous robots," in Imitation in Animals and Artifacts, eds K. Dautenhahn and C. L. Nehaniv (Cambridge, MA: MIT Press), 281-311.
9. Breazeal, C., Gray, J., and Berlin, M. (2009). An embodied cognition approach to mindreading skills for socially intelligent robots. Int. J. Rob. Res. 28, 656-680.
10. Breazeal, C., Hoffman, G., and Lockerd, A. (2004). "Teaching and working with robots as a collaboration," in Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems. New York, USA, 1030-1037.
11. Calinon, S., and Billard, A. (2008). "A framework integrating statistical and social cues to teach a humanoid robot new skills," in Proceedings of the ICRA 2008 Workshop on Social Interaction with Intelligent Indoor Robots, Pasadena, CA, USA, 27-34.
12. Cangelosi, A. (2004). "The sensorimotor basis of linguistic structure: experiments with grounded adaptive agents," in From Animals to Animats 8, eds S. Schaal, A. J. Ijspeert, A. Billard, S. Vijayakumar, J. Hallam, and J.-A. Meyer (Cambridge, MA: MIT Press), 487-496.
13. Chersi, F., Fogassi, L., Bonini, L., Erlhagen, W., Bicho, E., and Rizzolatti, G. (2007). "Modeling intentional neural chains in parietal and premotor cortex," in Proceedings of the 37th Annual Meeting of the Society for Neuroscience, Soc. Neuroscience Abs. 636.6 San Diego.
14. Cohen, P., and Levesque, H. J. (1990). Intention is choice with commitment. Artif. Intell. 42, 213-261.
15. Cuijpers, R. H., van Schie, H. T., Koppen, M., Erlhagen, W., and Bekkering, H. (2006). Goals and means in action observation: a computational approach. Neural Netw. 19, 311-322.
16. di Pellegrino, G., Fadiga, I., Fogassi, L., Gallese, V., and Rizzolatti, G. (1992). Understanding motor events: a neurophysiological study. Exp. Brain Res. 91, 176-180.
17. Erlhagen, W., and Bicho, E. (2006). The dynamic neural field approach to cognitive robotics. J. Neural Eng. 3, R36-R54.
18. Erlhagen, W., Mukovskiy, A., and Bicho, E. (2006a). A dynamic model for action understanding and goal-directed imitation. Brain Res. 1083, 174-188.
19. Erlhagen, W., Mukovskiy, A., Bicho, E., Panin, G., Kiss, C., Knoll, A., van Schie, H., and Bekkering, H. (2006b). Goal-directed imitation for robots: a bio-inspired approach to action understanding and skill learning. Rob. Auton. Syst. 54, 353-360.
20. Erlhagen, W., Mukovskiy, A., Chersi, F., and Bicho, E. (2007). "On the development of intention understanding for joint action tasks," in 6th IEEE International Conference on Development and Learning (London: Imperial College), 140-145.
21. Fogassi, L., Ferrari, P. F., Gesierich, B., Rozzi, S., Chersi, F., and Rizzolatti, G. (2005). Parietal lobe: from action organization to intention understanding. Science 308, 662-667.
22. Fong, T., Nourbakhsh, I., and Dautenhahn, K. (2003). A survey of socially interactive robots. Rob. Auton. Syst. 42, 143-166.
23. Foster, M. E., Giuliani, M., Mueller, T., Rickert, M., Knoll, A., Erlhagen, W., Bicho, E., Hipolito, N., and Louro, L. (2008). "Combining goal inference and natural language dialog for human-robot joint action," in Proceedings of the 1st International Workshop on Combinations of Intelligent Methods and Applications, CIAM 2008, Patras, Greece, 25-30.
24. Gast, J., Bannat, A., Rehrl, T., Wallhoff, F., Rigoll, G., Wendt, C., Schmidt, S., Popp, M., and Farber, B. (2009). "Real-time framework for multimodal human-robot interaction," in Proceedings of the 2nd Conference on Human System Interactions 2009, HSI '09. IEEE Computer Society, Catanid, Italy, 276-283.
25. Glenbach, A. M., and Kaschak, M. P. (2002). Grounding language in action. Psychon. Bull. Rev. 9, 558-565.
26. Hamilton, A. F., and Grafton, S. T. (2008). Action outcomes are represented in human inferior frontoparietal cortex. Cereb. Cortex 18, 1160-1168.
27. Hassin, R. R., Aarts, H., and Ferguson, M. J. (2005). Automatic goal inferences. J. Exp. Soc. Psychol. 41, 129-140.
28. Hauk, O., Johnsrude, I., and Pulvermüller, F. (2004). Somatotopic representation of action words in human motor and premotor cortex. Neuron 41, 301-307.
29. Hoffman, G., and Breazeal, C. (2007). Cost-based anticipatory action selection for human-robot fluency. IEEE Trans. Robot. 23, 952-961.
30. Keysers, C., and Perrett, D. (2004). Demystifying social cognition: a Hebbian perspective. Trends Cogn. Sci. (Regul. Ed.) 8, 501-507.
31. Koenig, N., Chernova, S., Jones, C., Loper, M., and Jenkins, O. C. (2008). "Hands-free interaction for human-robot teams," in Proceedings of the ICRA 2008 Workshop on Social Interaction with Intelligent Indoor Robots, Pasadena, CA, USA, 35-41.
32. McGuire, P., Fritsch, J., Ritter, H., Steil, J. J., Röthling, F., Fink, G. A., Wachsmuth, S., and Sagerer, G. (2002). "Multi-modal human-machine communication for instructing robot grasping tasks," in 2002 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2002. IEEE Computer Society, Lausanne, Switzerland, 1082-1089.
33. Newman-Norlund, R. D., van Schie, H. T., van Zuijlen, A. M. J., and Bekkering, H. (2007). The mirror neuron system is more active during complementary compared with imitative action. Nat. Neurosci. 10, 817-818.
34. Pardowitz, M., Knopp, S., Dillmann, R., and D, Z. R. (2007). Incremental learning of tasks from user demonstrations, past experiences and vocal comments. IEEE Trans. Syst. Man Cybern. B Cybern. 37, 322-332.
35. Rizzolatti, G., and Arbib, M. A. (1998). Language within our grasp. Trends Neurosci. 21, 188-194.
36. Rizzolatti, G., and Craighero, L. (2004). The mirror-neuron system. Annu. Rev. Neurosci. 27, 169-192.
37. Schaal, S. (2007). The new robotics: towards human-centered machines. HFSP J 1, 115-126.
38. Schöner, G. (2008). "Dynamical systems approaches to cognition," in The Cambridge Handbook of Computational Psychology, ed. R. Sun (Cambridge University Press, New York), 101-125.
39. Sebanz, N., Bekkering, H., and Knoblich, G. (2006). Joint action: bodies and minds moving together. Trends Cogn. Sci. (Regul. Ed.) 10, 70-76.
40. Spexard, T. P., Hanheide, M., and Sagerer, G. (2007). Human-oriented interaction with an anthropomorphic robot. IEEE Trans. Robot. 23, 852-862.
41. Steil, J. J., Röthling, F., Haschke, R., and Ritter, H. (2004). Situated robot earning for multi-modal instruction and imitation of grasping. Rob. Auton. Syst. 47, 129-141.
42. Sugita, Y., and Tani, J. (2005). Learning semantic combinatoriality from interaction between linguistic and behavioral processes. Adapt. Behav. 13, 33-52.
43. Umiltà, M. A., Kohler, E., Gallese, V., Fogassi, L., Fadiga, L., Keysers, C., and Rizzolatti, G. (2001). I know what you are doing: a neurophysiological study. Neuron 31, 155-165.
44. van Schie, H. T., Toni, I., and Bekkering, H. (2006). Comparable mechanisms for action and language: neural systems behind intentions, goals, and means. Cortex 42, 495-498.
45. Wermter, S., Weber, C., Elshaw, M., Panchev, C., Erwin, H., and Pulvermüller, F. (2004). Towards multimodal neural robot learning. Rob. Auton. Syst. 47, 171-175.
46. Westphal, G., von der Malsburg, C., and Würtz, R. P. (2008). "Feature-driven emergence of model graphs for object recognition and categorization," in Applied Pattern Recognition, Sudies in Computational Intelligence, Vol. 91, eds H. Bunke, A. Kandel and M. Last (Berlin/Heidelberg: Springer Verlag), 155-199.
47. Wolpert, D. M., Doya, K., and Kawato, M. (2003). A unifying computational framework for motor control and social interactions. Philos. Trans. R. Soc. Lond., B, Biol. Sci. 358, 593-602.
48. Zwann, R. A., and Taylor, L. J. (2006). Seeing, acting, understanding: motor resonance in language comprehension. J. Exp. Psychol. Gen. 135, 1-11.