How can multimodal cues from child-directed interaction reduce learning complexity in robots?

Advanced Robotics

Volumn 20, Issue 10, 2006, Pages 1183-1199

  Rohlfing, Katharina J ^a   Fritsch, Jannik ^a   Wrede, Britta ^a   Jungmann, Tanja ^b  

^a BIELEFELD UNIVERSITY   (Germany)

^b LEIBNIZ UNIVERSITY HANNOVER   (Germany)

Author keywords

Child directed input; Learning mechanisms; Motionese; Multi modal motherese

Indexed keywords

COMPUTATIONAL COMPLEXITY; COMPUTER ARCHITECTURE; DATABASE SYSTEMS; HUMAN COMPUTER INTERACTION; ROBOT APPLICATIONS; ROBOT PROGRAMMING;

CHILD-DIRECTED INPUT; LEARNING MECHANISMS; MULTIMODAL ACTION; STRUCTURING ACTIONS;

ROBOT LEARNING;

EID: 33750541505     PISSN: 01691864     EISSN: None     Source Type: Journal    
DOI: 10.1163/156855306778522532     Document Type: Article

References (40)

1. Y. Kuniyoshi, M. Inaba and H. Inoue, Learning by watching: Extracting reusable task knowledge from visual observation of human performance. IEEE Trans. Robotics Automat. 10, 165-170 (1994).
2. C. Breazeal and B. Scassellati, Robots that imitate humans. Trends Cogn. Sci. 6, 481-487 (2002).
3. J. Demiris and G. Hayes, Imitative learning mechanisms in robots and humans, in: Proceedings of the 5th European Workshop on Learning Robots, Bari, pp. 9-16 (1996).
4. J. Fritsch, N. Hofemann and K. Rohlfing, Detecting 'when to imitate' in a social context with a human caregiver, in: Proceedings of the IEEE ICRA Workshop on The Social Mechanisms of Robot Programming by Demonstration. Barcelona (2005).
5. J. Call and M. Carpenter, Three sources of information in social learning, in: Imitation in Animals and Articats, K. Dautenhahn and C. L. Nehaniv (Eds), pp. 211-227. MIT. Cambridge, MA (2002).
6. B. Bertenthal, Variation and selection in the development of perception and action, in: Non-linear Developmental Processes, G. Savelsbergh, H. van der Maas and P. van Geert (Eds), pp. 105-121. KNAW, Amsterdam (1999).
7. P. Zukow-Goldring, Assisted imitation: Affordances, effectivities, and the mirror system in early language development, in: From Action to Language, M. A. Arbib (Ed.). pp. 469-500. Cambridge University Press, Cambridge (2006).
8. S. Wermter, C. Weber, M. Elshaw, V. Gallese and F. Pulvermüller, Grounding neural robot language in action, in: Biomimetic Neural Learning for Intelligent Robots, S. Wermter. G. Palm and M. Elshaw (Eds), pp. 162-181. Springer, Heidelberg (2005).
9. A. Fernald, Four-month-old infants prefer to listen to motherese. Infant Behav. Dev. 8, 181-195 (1985).
10. A. Fernald and C. Mazzie, Prossody and focus in speech to infants and adults, Dev. Psychol. 27, 209-221 (1991).
11. A. E. Snow, Issues in the study of input: Finetuning, universality, individual and developmental differences, and necessary causes, in: The Handbook of Child Language, P. Fletcher and B. MacWinney (Eds), pp. 180-193. Blackwell, Cambridge, MA (1995).
12. P. F. Dominey and C. Dodane, Indeterminancy in language acquisition: the role of child directed speech and joint attention, J. Neurolinguistics 17, 121-145 (2004).
13. A. Fernald, T. Taeschner, J. Dunn, M. Papousek, B. Boysson-Bardies and I. Fukui, A cross-language study of prosodic modifications in mothers' and fathers' speech to preverbal infants, J. Child Lang. 16, 477-501 (1989).
14. P. K. Kuhl. A new view of language acquisition. Proc. Natl. Acad. Sci. USA 97, 11850-11857 (2000).
15. G. Csibra and G. Gergely, Social learning and social cognition: The case for pedagogy, in: Processes of Change in Brain and Cognitive Development. Attention and Performance XXI. M. H. Johnson and Y. Munakata (Eds), pp. 249-274. Oxford University Press. Oxford (2005).
16. R. J. Brand, D. A. Baldwin and L. A. Ashburn, Evidence for "motionese': modifications in mothers' infant-directed action. Dev. Sci. 5, 72-83 (2002).
17. L. J. Gogate and L. E. Bahrick, Intersensory redundancy and 7-month-old infants' memory for arbitrary syllable-object relations. Infancy 2, 219-231 (2001).
18. D. J. Matatyaho and L. J. Gogate, The role of motion in maternal bimodal naming to preverbal infants, in: Proc. of the 5th International Conference on Development and Learning. Bloomington, IN (2006).
19. L. J. Gogate, L. E. Bahrick and J. Watson, A study of multimodal motherese: The role of temporal synchrony between verbal labels and gestures. Child Dev. 71, 878-894 (2000).
20. L. J. Gogate and C. Prince, Is "Multimodal Motherese" universal? paper presented at the Xth International Congress for Studies in Child Language, Berlin (2005).
21. D. A. Baldwin and L. J. Moses, Early understanding of referential intent and attentional focus: Evidence from language and emotion, in: Children's Early Understanding of Mind. Origins and Development, C. Lewis and P. Mitchell (Eds), pp. 133-156. LEA, Hove (1994).
22. R. J. Brand and D. A. Baldwin, Motionese and Motherese: Two avenues for supporting infant action processing, paper presented at the Xth International Congress for Studies in Child Language, Berlin (2005).
23. P. Zukow-Goldring and N. Rader, Discussion to the symposium "Multimodal Motherese", paper presented at the Xth International Congress for Studies in Child Language, Berlin (2005).
24. S. L. Oviatt, Ten myths of multimodal interaction, Commun. ACM 42, 74-81 (1999).
25. G. Gergely, What should a robot learn from an infant? Mechanisms of action interpretation and observational learning in infancy, in: Proc. 3rd International Workshop on Epigenetic Robotics, Boston, MA, pp. 191-209 (2003).
26. J. Schmidt, B. Kwolek and J. Fritsch, Kernel particle filter for real-time 3D body tracking in monocular color images, in: Proc. of the IEEE International Conference on Automatic Face and Gesture Recognition, Southampton, pp. 567-572 (2006).
27. J. Fritsch, Vision-based recognition of gestures with context, PhD thesis, Bielefeld University, Faculty of Technology (2003). Available online at http://bieson.ub.uni-bielefeld.de/volltexte/2003/285/pdf/Fritsch2003.pdf
28. C. Chang and R. Ansari, Kernel particle filter for visual tracking, Signal Process. Lett. 12, 242-245 (2005).
29. K. J. Rohlfing, J. Fritsch and B. Wrede, Learning to manipulate objects: A quantitative evaluation of Motionese, in: Proc. 3rd International Conference on Development and Learning, San Diego, CA (2004).
30. K. J. Rohlfing and T. Jungmann, Referenz durch Bewegung. Eine Studie zu 'Motionese', poster presented at the 17. Tagung der Fachgruppe Entwicklungspsychologie (EPSY2005), Bochum, (2005) (in German).
31. T. J. Sejnowski, Making smooth moves, Nature 394, 725-726 (1998).
32. B. Wrede, J. Fritsch and K. J. Rohlfing, How can prosody help to learn actions? in: Proc. of the 4th International Conference on Development and Learning, Osaka (2005).
33. K. Ogawara, J. Takamatsu, S. Iba, T. Tanuki, H. Kimura and K. Ikeuchi, Acquiring hand-action models in task and behavior levels by a learning robot through observing human demonstrations, in: Proc. of the 1st IEEE-RAS International Conference on Humanoid Robots, Boston, MA (2000).
34. A. Billard and R. Siegwart, Special issue on robot programming by demonstration, Robotics and Autonomous Systems 47 (2-3) (2004).
35. J. K. Aggarwal, Problems, ongoing research and future directions in motion research, Machine Vision Appl. 14, 199-201 (2003).
36. S. Wermter, C. Weber, M. Elshaw, C. Panchev, H. Erwin and F. Pulvermüller, Towards multimodal neural robot learning, Robotics Auton. Syst. 47, 171-175 (2004).
37. M. Lungarella, G. Metta, R. Pfeifer and G. Sadini, Developmental robotics: a survey, Connect. Sci. 15, 151-190 (2004).
38. L. E. Bahrick, R. Lickliter and R. Flom, Intersensory redundancy guides the development of selective attention, perception and cognition in infancy, Curr. Directions Psychol. Sci. 13, 99-102 (2004).
39. A. Weber, M. Elshaw, A. Zochios and S. Wermter, A multimodal hierarchial approach to robot learning by imitation, in: Proc. 4th International Workshop on Epigenetic Robotics: Modeling Cognitive Development in Robotic Systems 117, Genoa, L. Berthouze, H. Kozima, C. G. Prince, G. Sandini, G. Stojanov, G. Metta and C. Balkenius (Eds), pp. 131-134 (2004).
40. Y. Yoshikawa, K. Hosoda and M. Asada, Cross-anchoring for binding tactile and visual sensations via unique association through selfperception, in: Proc. 3rd International Conference on Development and Learning, San Diego, CA (2004).