Language bootstrapping: Learning word meanings from perception-action association

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 42, Issue 3, 2012, Pages 660-671

  Salvi, Giampiero ^a   Montesano, Luis ^b   Bernardino, Alexandre ^c   Santos Victor, José ^c  

^a ROYAL INSTITUTE OF TECHNOLOGY   (Sweden)

^b UNIVERSITY OF ZARAGOZA   (Spain)

^c INSTITUTO SUPERIOR TÉCNICO   (Portugal)

Author keywords

Affordances; automatic speech recognition; Bayesian networks; cognitive robotics; grasping; humanoid robots; language; unsupervised learning

Indexed keywords

AFFORDANCES; AUTOMATIC SPEECH RECOGNITION; COGNITIVE ROBOTICS; GRASPING; HUMANOID ROBOT; LANGUAGE;

ANTHROPOMORPHIC ROBOTS; BAYESIAN NETWORKS; UNSUPERVISED LEARNING;

SPEECH RECOGNITION;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; BIOMIMETICS; COMPUTER SIMULATION; DECISION SUPPORT SYSTEM; HUMAN; INFANT; METHODOLOGY; NATURAL LANGUAGE PROCESSING; ROBOTICS; THEORETICAL MODEL;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; BIOMIMETICS; COMPUTER SIMULATION; DECISION SUPPORT TECHNIQUES; HUMANS; INFANT; MODELS, THEORETICAL; NATURAL LANGUAGE PROCESSING; PATTERN RECOGNITION, AUTOMATED; ROBOTICS;

EID: 84861192014     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2011.2172420     Document Type: Article

References (31)

1. L. M. N. Akhtar, "Early lexical acquisition: The role of cross-situational learning," First Lang., vol. 19, no. 57, pp. 347-358, Sep. 1999.
2. K. Smith, A. Smith, and R. Blyth, "Cross-situational learning: An experimental study of word-learning mechanisms," Cogn. Sci., vol. 35, no. 3, pp. 480-498, Apr. 2011.
3. F. Lacerda, E. Marklund, L. Lagerkvist, L. Gustavsson, E. Klintfors, and U. Sundberg, "On the linguistic implications of context-bound adult-infant interactions," in Proc. 4th Int. Workshop Epigenetic Robot., 2004, pp. 149-150.
4. J. Weng, "The developmental approach to intelligent robots," in Proc. AAAI Spring Symp. Ser.-Integrating Robotic Research: Taking The Next Leap, Stanford, CA, Mar. 1998.
5. M. Lungarella, G. Metta, R. Pfeifer, and G. S and ini, "Developmental robotics: A survey," Connection Sci., vol. 15, no. 40, pp. 151-190, Dec. 2003. (Pubitemid 38474539)
6. L. Montesano, M. Lopes, A. Bernardino, and J. Santos-Victor, "Learning object affordances: From sensory motor maps to imitation," IEEE Trans. Robot.-Special Issue on Bio-Robotics, vol. 24, no. 1, pp. 15-26, Feb. 2008. (Pubitemid 351411194)
7. V. Krunic, G. Salvi, A. Bernardino, L. Montesano, and J. Santos-Victor, "Affordance based word-to-meaning association," in Proc. IEEE ICRA, Kobe, Japan, 2009, pp. 4138-4143.
8. J. M. Siskind, "A computational study of cross-situational techniques for learning word-to-meaning mapping," Cognition, vol. 61, no. 1/2, pp. 39-91, Oct./Nov. 1996. (Pubitemid 126410829)
9. M. Frank, N. Goodman, and J. Tanenbaum, "A Bayesian framework for cross-situational word learning," in Proc. Adv. Neural Inf. Process. Syst., 2008, vol. 20, pp. 457-464.
10. D. Roy, "New horizons in the study of child language acquisition," in Proc. Interspeech, 2009, pp. 13-20.
11. R. Pfeifer and J. Bongard, How the Body Shapes the Way We Think. A New View of Intelligence. Cambridge, MA: MIT Press, 2007.
12. S. Harnad, "The symbol grounding problem," Phys. D, vol. 42, no. 1-3, pp. 335-346, Jun. 1990.
13. J. J. Gibson, The Ecological Approach to Visual Perception. Boston, MA: Houghton Mifflin, 1979.
14. L. Lopes and L. Seabra, "How many words can my robot learn?: An approach and experiments with one-class learning," Interaction Stud., vol. 8, no. 1, pp. 53-81, Apr. 2007.
15. S. Takamuku, Y. Takahashi, and M. Asada, "Lexicon acquisition based on object-oriented behavior learning," Adv. Robot., vol. 20, no. 10, pp. 1127-1145, 2006. (Pubitemid 44671139)
16. N. Mavridis and D. Roy, "Grounded situation models for robots: Where words and percepts meet," in Proc. IEEE/RSJ Int. Conf. IROS, 2006, pp. 4690-4697. (Pubitemid 46928665)
17. K. Hsiao, S. Tellex, S. Vosoughi, R. Kubat, and D. Roy, "Object schemas for grounding language in a responsive robot," Connection Sci., vol. 20, no. 4, pp. 253-276, 2008.
18. C. Yu and D. H. Ballard, "A multimodal learning interface for grounding spoken language in sensory perceptions," ACM Trans. Appl. Perception, vol. 1, no. 1, pp. 57-80, Jul. 2004.
19. C. Yu and D. H. Ballard, "A unified model of early word learning: Integrating statistical and social cues," Neurocomputing, vol. 70, no. 13-15, pp. 2149-2165, Aug. 2007. (Pubitemid 46825364)
20. X. He, T. Ogura, A. Satou, and O. Hasegawa, "Developmental word acquisition and grammar learning by humanoid robots through a selforganizing incremental neural network," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 37, no. 5, pp. 1357-1372, Oct. 2007. (Pubitemid 47534598)
21. V. Stouten, K. Demuynck, and H. Van Hamme, "Discovering phone patterns in spoken utterances by non-negative matrix factorisation," IEEE Signal Process. Lett., vol. 15, pp. 131-134, Jan. 2008. [Online]. Available: http://ieeexplore.ieee.org/xpl/freeabs-all.jsp?arnumber=4418411
22. G. Salvi, "Ecological language acquisition via incremental model-based clustering," in Proc. Eurospeech/Interspeech, Lisbon, Portugal, 2005, pp. 1181-1184. (Pubitemid 43908278)
23. J. Pearl, Causality: Models, Reasoning and Inference. Cambridge, U.K.: Cambridge Univ. Press, 2000.
24. D. M. Blei, A. Y. Ng, and M. I. Jordan, "Latent Dirichlet allocation," J. Mach. Learn. Res., vol. 3, pp. 993-1022, 2003.
25. D. Heckerman, "A tutorial on learning with Bayesian networks," in Learning in Graphical Models, M. Jordan, Ed. Cambridge, MA: MIT Press, 1998.
26. G. Cooper and E. Herskovits, "A Bayesian method for the induction of probabilistic networks from data," Mach. Learn., vol. 9, no. 4, pp. 309-347, Oct. 1992.
27. D. Pelleg and A. W. Moore, "X-means: Extending k-means with efficient estimation of the number of clusters," in Proc. Int. Conf. Mach. Learn., San Francisco, CA, 2000, pp. 727-734.
28. B. Lindberg, F. T. Johansen, N. Warakagoda, G. Lehtinen, Z. Karcic, A. Žgank, K. Elenius, and G. Salvi, "A noise robust multilingual reference recogniser based on SpeechDat(II)," in Proc. ICSLP, 2000, pp. 370-373.
29. C. J. Leggetter and P. C. Woodl and , "Maximum likelihood linear regression for speaker adaptation of continuous density hiddenMarkovmodels, " Comput. Speech Lang., vol. 9, no. 2, pp. 171-185, Apr. 1995.
30. H. Kjellstrom, J. Romero, and D. Kragic, "Visual object-action recognition: Inferring object affordances from human demonstration," Comput. Vis. Image Underst and ., vol. 115, no. 1, pp. 81-90, Jan. 2011.
31. D. Song, C. Ek, K. Huebner, and D. Kragic, "Multivariate discretization for Bayesian network structure learning in robot grasping," in Proc. IEEE Int. Conf. Robot. Autom., Shanghai, China, 2011, pp. 1944-1950.