Developmental word grounding through a growing neural network with a humanoid robot

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 37, Issue 2, 2007, Pages 451-462

  He, Xiaoyuan ^a   Kojima, Ryo ^a   Hasegawa, Osamu ^b  

^a TOKYO INSTITUTE OF TECHNOLOGY   (Japan)

^b JAPAN SCIENCE AND TECHNOLOGY AGENCY   (Japan)

Author keywords

Interactive learning; Language; Mental models; Robot; Word grounding

Indexed keywords

ANTHROPOMORPHIC ROBOTS; ARTIFICIAL INTELLIGENCE; LEARNING SYSTEMS; SELF ORGANIZING MAPS; TOPOLOGY;

HUMANOID ROBOT; INTERACTIVE LEARNING; MENTAL MODELS; WORD GROUNDING;

NEURAL NETWORKS;

ALGORITHM; ARTICLE; ARTIFICIAL NEURAL NETWORK; BIOMIMETICS; CYBERNETICS; EVALUATION; HEARING; HUMAN; LINGUISTICS; METHODOLOGY; NATURAL LANGUAGE PROCESSING; READING; ROBOTICS;

ALGORITHMS; AUDITORY PERCEPTION; BIOMIMETICS; CYBERNETICS; HUMANS; NATURAL LANGUAGE PROCESSING; NEURAL NETWORKS (COMPUTER); READING; ROBOTICS; VOCABULARY, CONTROLLED;

EID: 34047187932     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2006.885309     Document Type: Article

References (25)

1. S. Harnad, "The symbol grounding problem," Physica D, vol. 42, no. 1-3, pp. 335-346, Jun. 1990.
2. J. Siskind, "A computational study of cross-situational techniques for learning word-to-meaning mappings," Cognition, vol. 61, no. 1/2, pp. 39-91, Oct./Nov. 1996.
3. J. Siskind, "Learning word-to-meaning mappings," in Models of Language Acquisition: Inductive and Deductive Approaches, P. Broeder and J. Murre, Eds. London. U.K.: Oxford Univ. Press, Jul. 2000, pp. 121-153.
4. S. Wachsmuth, G. Socher, H. Brandt-Pook, F. Kummert, and G. Sagerer, "Integration of vision and speech understanding using Bayesian networks," Videre: J. Comput. Vis. Res., vol. 1, no. 4, pp. 61-83, 2000.
5. A. L. Gorin, D. Petrovksa-Delacretaz, G. Riccardi, and J. Wright, "Learning spoken language without transcriptions," in Proc. IEEE Workshop Speech Recog. and Understanding, 1999, pp. 293-296.
6. T. Regier, The Human Semantic Potential: Spatial Language and Constrained Connectionism. Cambridge, MA: MIT Press, 1996.
7. T. Oates, Z. Eyler-Walker, and P. R. Cohen, "Toward natural language interfaces for robotic agents: Grounding linguistic meaning in sensors," in Proc. 4th Int. Conf. Auton. Agents, 2000, pp. 227-228.
8. D. Roy and A. Pentland, "Learning words from sights and sounds: A computational model," Cogn. Sci., vol. 26, no. 1, pp. 113-146, 2002.
9. N. Iwahashi, "Language acquisition through a human-robot interface by combining speech, visual, and behavioral information," Inf. Sci., vol. 156, no. 1/2, pp. 109-121, Nov. 2003.
10. N. Iwahashi, "Active and unsupervised learning of spoken words through a multimodal interface," in Proc. 13th IEEE Workshop Robot and Human Interactive Commun., 2004, pp. 437-442.
11. C. Yu and D. Ballard, "On the integration of grounding language and learning objects," in Proc. 19th Nat. Conf. Artif. Intell. (AAAI), Jul. 2004, pp. 488-494.
12. L. Steels and P. Vogt, "Grounding adaptive language games in robotic agents," in Proc. ECAL, I. Harvey and P. Husbands, Eds., 1997, pp. 474-482.
13. L. Steels and J.-C. Baillie, "Shared grounding of event descriptions by autonomous robots," Robot. Auton. Syst., vol. 43, no. 2/3, pp. 163-173, 2003.
14. L. Steels, F. Kaplan, A. McIntyre, and J. Van Looveren, "Crucial factors in the origins of word-meaning," in The Transition to Language, A. Wray, Ed. Oxford, U.K.,: Oxford Univ. Press, 2002, ch. 12, pp. 252-271.
15. P. Vogt, "The emergence of compositional structures in perceptually grounded language games," Artif. Intell., vol. 167, no. 1/2, pp. 206-242, Sep. 2005.
16. J. Weng, J. McClelland, A. Pentland, O. Sporns, I. Stockman, M. Sur, and E. Thelen, "Autonomous mental development by robots and animals," Science, vol. 291, no. 5504, pp. 599-600, 2001.
17. J. Elman, "Learning and development in neural networks: The importance of starting small," Cognition, vol. 48, no. 1, pp. 71-99, 1993.
18. S. Thrun and T. Mitchell, "Learning one more thing," in Proc. IJCAI, Montreal, QC, Canada, Aug. 1995, pp. 1217-1223.
19. S. Imai, T. Kobayashi, K. Tokuda, T. Masuko, and K. Koishida, Speech Signal Processing Toolkit: Sptk Version 3.0, 2002.
20. A. Gersho and R. M. Gray, Vector Quantization and Signal Compression. Boston, MA: Kluwer, 1992.
21. C. S. Myers and L. R. Rabiner, "A comparative study of several dynamic time-warping algorithms for connected word recognition," Bell Syst. Tech. J., vol. 60, no. 7, pp. 1389-1409, Sep. 1981.
22. F. Shen and O. Hasegawa, "An incremental network for on-line unsupervised classification and topology learning," Neural Netw., vol. 19, no. 1, pp. 90-106, Jan. 2006.
23. D. Roy, K. Hsiao, and N. Mavridis, "Mental imagery for a conversational robot," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 34, no. 3, pp. 1374-1383, Jun. 2004.
24. K. Hsiao, N. Mavridis, and D. Roy, "Coupling perception and simulation: Steps towards conversational robotics," in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst., 2003, pp. 928-933.
25. J. Piaget and B. Inhelder, The Child's Conception of Space. London, U.K.: Routledge and Kegan Paul, 1956.