Developmental word acquisition and grammar learning by humanoid robots through a self-organizing incremental neural network

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 37, Issue 5, 2007, Pages 1357-1372

  He, Xiaoyuan ^a,b   Ogura, Tomotaka ^a,c   Satou, Akihiro ^a   Hasegawa, Osamu ^a  

^a TOKYO INSTITUTE OF TECHNOLOGY   (Japan)

^b NEC CORPORATION   (Japan)

^c SONY CORPORATION   (Japan)

Author keywords

Interactive learning; Language; Mental models; Robot; Word grounding

Indexed keywords

DATA ACQUISITION; LEARNING SYSTEMS; NEURAL NETWORKS; SELF ORGANIZING MAPS; WORD PROCESSING;

GRAMMAR LEARNING; HUMANOID ROBOTS; INTERACTIVE LEARNING; SELF-ORGANIZING INCREMENTAL NEURAL NETWORK; WORD ACQUISITION; WORD GROUNDING;

ROBOTS;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; ARTIFICIAL NEURAL NETWORK; AUTOMATED PATTERN RECOGNITION; AUTOMATIC SPEECH RECOGNITION; BIOMIMETICS; CYBERNETICS; HUMAN; METHODOLOGY; NATURAL LANGUAGE PROCESSING; ROBOTICS;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; BIOMIMETICS; CYBERNETICS; HUMANS; NATURAL LANGUAGE PROCESSING; NEURAL NETWORKS (COMPUTER); PATTERN RECOGNITION, AUTOMATED; ROBOTICS; SPEECH RECOGNITION SOFTWARE;

EID: 35148857941     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2007.903447     Document Type: Article

References (24)

1. S. Russell and P. Norvig, Artificial Intelligence - A Modern Approach 2nd ed. Upper Saddle River, NJ: Personal Education, Inc., 2003.
2. J. Weng, J. McClelland, A. Pentland, O. Sporns, I. Stockman, M. Sur, and E. Thelen, "Autonomous mental development by robots and animals," Science, vol. 291, no. 5504, pp. 599-600, Jan. 2001.
3. S. Harnad, "The symbol grounding problem," Phys. D, vol. 42, no. 1-3, pp. 335-346, Jun. 1990.
4. J. Siskind, "A computational study of cross-situational techniques for learning word-to-meaning mappings," Cognition, vol. 61, no. 1/2, pp. 39-91, Oct./Nov. 1996.
5. S. Wachsmuth, G. Socher, H. Brandt-Pook, F. Kummert, and G. Sagerer, "Integration of vision and speech understanding using Bayesian networks," Videre: J. Comput. Vis. Res., vol. 1, no. 4, pp. 61-83, 2000.
6. T. Regier, The Human Semantic Potential: Spatial Language and Constrained Connectionism. Cambridge, MA: MIT Press, 1996.
7. D. Roy and A. Pentland, "Learning words from sights and sounds: A computational model," Cogn. Sci., vol. 26, no. 1, pp. 113-146, 2002.
8. N. Iwahashi, "Language acquisition through a human-robot interface by combining speech, visual, and behavioral information," Inf. Sci., vol. 156, no. 1, pp. 109-121, Nov. 2003.
9. N. Iwahashi, "Active and unsupervised learning of spoken words through a multimodal interface," in Proc. 13th IEEE Workshop Robot and Human Interactive Commun., 2004, pp. 437-442.
10. C. Yu and D. Ballard, "On the integration of grounding language and learning objects," in Proc. 19th Nat. Conf. Artif. Intell. (AAAI Jul. 2004, pp. 488-494.
11. L. Steels and P. Vogt, "Grounding adaptive language games in robotic agents," in Proc. ECAL, I. Harvey and P. Husbands, Eds., 1997, pp. 474-482.
12. L. Steels, F. Kaplan, A. McIntyre, and J. Van Looveren, "Crucial factors in the origins of word-meaning," in The Transition to Language, A. Wray, Ed. Oxford, U.K.: Oxford Univ. Press, 2002, ch. 12, pp. 252-271.
13. L. Steels and J.-C. Baillie, "Shared grounding of event descriptions by autonomous robots," Robot. Auton. Syst., vol. 43, no. 2/3, pp. 163-173, 2003.
14. P. Vogt, "The emergence of compositional structures in perceptually grounded language games," Artif. Intell., vol. 167, no. 1/2, pp. 206-242, Sep. 2005.
15. F. Shen and O. Hasegawa, "An incremental network for on-line unsupervised classification and topology learning," Neural Netw., vol. 19, no. 1, pp. 90-106, Jan. 2006.
16. J. Elman, "Learning and development in neural networks: The importance of starting small," Cognition, vol. 48, no. 1, pp. 71-99, 1993.
17. S. Thrun and T. Mitchell, "Learning one more thing," in Proc. IJCAI Montreal, QC, Canada, Aug. 1995, pp. 1217-1223.
18. X. He, R. Kojima, and O. Hasegawa, "Developmental word grounding through a growing neural network with a humanoid robot," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 37, no. 2, pp. 451-462, Apr. 2007.
19. S. Imai, T. Kobayashi, K. Tokuda, T. Masuko, and K. Koishida, Speech Signal Processing Toolkit: SPTK version 3.0, 2002.
20. A. Gersho and R. M. Gray, Vector Quantization and Signal Compression Boston, MA: Kluwer, 1992.
21. C. S. Myers and L. R. Rabiner, "A comparative study of several dynamic time-warping algorithms for connected word recognition," Bell Syst. Tech. J., vol. 60, no. 7, pp. 1389-1409, Sep. 1981.
22. D. Roy, K. Hsiao, and N. Mavridis, "Mental imagery for a conversational robot," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 34, no. 3, pp. 1374-1383, Jun. 2004.
23. Y. Kamiya, F. Shen, and O. Hasegawa, "Non-stop learning: A new scheme for continuous learning and recognition," in Proc. Joint 2nd Int. Conf. Soft Comput. and Intell. Syst. and 5th Int. Symp. Adv. Intell. Syst., 2004.
24. L. R. Rabiner, "A tutorial on hidden Markov models and selected applications in speech recognition," Proc. IEEE, vol. 77, no. 2, pp. 257-286, Feb. 1989.