Integration of speech and action in humanoid robots: ICub simulation experiments

IEEE Transactions on Autonomous Mental Development

Volumn 3, Issue 1, 2011, Pages 17-29

  Tikhanoff, Vadim ^a   Cangelosi, Angelo ^b   Metta, Giorgio ^a  

^a ISTITUTO ITALIANO DI TECNOLOGIA   (Italy)

^b UNIVERSITY OF PLYMOUTH   (United Kingdom)

Author keywords

Artificial intelligence; cognitive robotics; manipulation; speech recognition

Indexed keywords

BUILDING INTELLIGENT SYSTEMS; COGNITIVE ROBOTICS; COGNITIVE SKILL; DEVELOPMENTAL ROBOTICS; ENVIRONMENTAL CONDITIONS; GRAND CHALLENGE; HUMAN LEVELS; HUMANOID ROBOT; MANIPULATION; NEW APPROACHES; PHYSICAL WORLD; ROBOTIC SIMULATION; SCIENCE AND TECHNOLOGY; SIMULATION EXPERIMENTS; SOCIAL LEARNING;

ANTHROPOMORPHIC ROBOTS; COGNITIVE SYSTEMS; INTELLIGENT BUILDINGS; INTELLIGENT SYSTEMS; MACHINE DESIGN; ROBOTICS;

SPEECH RECOGNITION;

EID: 79952933184     PISSN: 19430604     EISSN: None     Source Type: Journal    
DOI: 10.1109/TAMD.2010.2100390     Document Type: Conference Paper

References (65)

1. D. Sperber and L. Hirschfeld, "Culture cognition and evolution," in MIT Encyclopedia of the Cognitive Sciences, R. Wilson and F. Keil, Eds. Cambridge, MA: MIT Press, 1999, pp. cxi-cxxxii.
2. C. Breazeal and B. Scassellati, "Infant-like social interactions between a robot and a human caretaker," Adapt. Behav., vol. 8, no. 1, pp. 49-74, 2000. (Pubitemid 33226799)
3. A. Cangelosi, "Evolution of communication and language using signals, symbols, and words," IEEE Trans. Evol. Comput., vol. 5, no. 2, pp. 93-101, Apr. 2001. (Pubitemid 32486957)
4. T. Fong, C. Thorpe, and C. Baur, "Robot, asker of questions," Robot. Autonom. Syst., vol. 42, no. 3-4, pp. 235-243, 2003.
5. M. Asada, K. F. MacDorman, H. Ishiguro, and Y. Kuniyoshi, "Cognitive developmental robotics as a new paradigm for the design of humanoid robots," Robot. Autonom. Syst., vol. 37, no. 2, pp. 185-193, 2001. (Pubitemid 33039294)
6. M. Lungarella and R. Pfeifer, "Robot as a cognitive tool: An information theoretic analysis of sensory-motor data," in Proc. 2nd IEEE-RAS Int. Conf. Human. Robot., Tokyo, Japan, 2001, pp. 245-252.
7. M. Lungarella, G. Metta, R. Pfeifer, and G. Sandini, "Developmental robotics: A survey," Connect. Sci., vol. 15, no. 4, pp. 151-190, 2003. (Pubitemid 38474539)
8. G. Metta, G. Sandini, L. Natale, and F. Panerai, "Development and robotics," in Proc. 2nd IEEE-RAS Int. Conf. Human. Robot., Tokyo, Japan, Nov. 2001, pp. 33-42.
9. R. Pfeifer, "Robots as cognitive tools," Int. J. Cogn. Technol., vol. 1, no. 1, pp. 125-143, 2002.
10. C. Balkenius et al., "Modeling cognitive development in robotics systems," in Proc. 1st Int. Workshop Epig. Robot., Lund, Sweden, 2001, pp. 1-4.
11. J. Weng, W. S. Hwang, Y. Zhang, C. Yang, and R. J. Smith, "Developmental humanoids: Humanoids that develop skills automatically," in Proc. 1st IEEE-RAS Conf. Human., Beijing, China, 2001, pp. 123-132.
12. K. Dautenhahn, "Socially intelligent robots: Dimensions of humanrobot interaction," Philos. Trans. Roy. Soc. London-Series B, vol. 362, no. 1480, pp. 679-704, 2007. (Pubitemid 47056835)
13. P. Bakker and Y. Kuniyoshi, "Robot see, robot do: An overview of robot imitation," in Proc. AISB Workshop Learn. Robot. Animals, Brighton, U.K., 1996, pp. 3-11.
14. A. Meltzoff, "Elements of a developmental theory of imitation," in The Imitative Mind, A. Meltzoff and W. Prinz, Eds. Cambridge, U.K.: Cambridge Univ. Press, 2002, pp. 19-141.
15. B. Scassellati, "Knowing what to imitate and knowing when you succeed," in Proc. AISB'99 Symp. Imitation Animals Artifacts, Edinburgh, Scotland, Apr. 1999, pp. 105-113.
16. R. MacWhinney, "Models of the emergence of language," Annu. Rev. Psychol., vol. 49, pp. 199-227, 1998.
17. L. Steels, "Evolving grounded communication for robots," Trends Cogn. Sci., vol. 7, no. 7, pp. 308-312, 2003. (Pubitemid 36818924)
18. A. Cangelosi, E. Hourdakis, and V. Tikhanoff, "Language acquisition and symbol grounding transfer with neural networks and cognitive," in Proc. Int. Joint Conf. Neural Netw. (IJCNN06), Vancouver, BC, Canada, 2006, pp. 1576-1582. (Pubitemid 351369509)
19. A. Cangelosi and T. Riga, "An embodied model for sensorimotor grounding and grounding transfer," Cogn. Sci., vol. 30, no. 4, pp. 673-689, 2006.
20. D. Roy, "Learning visually grounded words and syntax of natural spoken language," Evol. Commun., vol. 4, no. 1, pp. 33-56, 2002.
21. L. Steels, "Self-organising vocabularies," in Artificial Life V,C. Langton and K. Shimohara, Eds. Cambridge, MA: MIT Press, 1996, pp. 179-184.
22. A. Cangelosi, "The emergence of language: Neural adaptive agent models," Connect. Sci., vol. 17, no. 3-4, pp. 185-190, 2005. (Pubitemid 41625445)
23. K. Plunkett, C. Sinha, M. F. Møller, and O. Strandsby, "Symbol grounding or the emergence of symbols? vocabulary growth in children and a connectionist net," Cogn. Sci., vol. 4, pp. 293-312, 1992.
24. D. Roy and N. Mukherjee, "Towards situated speech understanding: Visual context priming of language models," Comput. Speech Lang., vol. 19, no. 2, pp. 227-248, 2005.
25. W. Kintsch, Comprehension: A Paradigm for Cognition. Cambridge, U.K.: Cambridge Univ. Press, 1998.
26. S. Harnad, "The symbol grounding problem," Physica D, vol. 42, pp. 335-346, 1990.
27. D. Roy, "Scemiotic schemas: A framework for grounding language in action and perception," Artif. Intell., vol. 167, no. 1-2, pp. 170-205, 2005. (Pubitemid 41240681)
28. G. Sandini, G. Metta, and D. Vernon, "The iCub cognitive humanoid robot: An open-system research platform for enactive cognition," in 50 Years of AI, M. Lungarella, Ed. et al. Berlin, Germany: Springer-Verlag, 2007, pp. 359-370.
29. V. Tikhanoff, A. Cangelosi, P. Fitzpatrick, G. Metta, L. Natale, and F. Nori, "An open-source simulator for cognitive robotics research: The prototype of the iCub humanoid robot simulator," in Proc. IEEE Workshop Perform. Metrics Intell. Syst. , Washington, DC, 2008.
30. T. Ziemke, "On the role of robot simulations in embodied cognitive science," AISB J., vol. 1, no. 4, pp. 389-399, 2003.
31. J. C. Bongard and R. Pfeifer, "Evolving complete agents using artificial ontogeny," in Morpho-Functional Machines: The New Species (Designing Embodied Intelligence), F. Hara and R. Pfeifer, Eds. Berlin, Germany: Springer-Verlag, 2003, pp. 237-258.
32. S. Kumar and P. J. Bentley, On Growth, Form and Computers. Amsterdam, The Netherlands: Elsevier , 2003.
33. S. Nolfi et al., "How to evolve autonomous robots: Different approaches in evolutionary robotics," in Artificial Life IV, R. Brooks and P. Maes, Eds. Cambridge, MA: MIT Press, 2000.
34. R. Smith, Open Dynamic Engine 2001 [Online]. Available: http://www.ode.org/
35. G. Metta, P. Fitzpatrick, and L. Natale, "YARP: Yet another robot platform," Int. J. Adv. Robot. Syst., Special Issue Software Develop. Integr. Robot., vol. 3, no. 1, pp. 43-48, 2006.
36. N. Nava et al. , "Kinematic and dynamic simulations for the design of robotcub upper body structure," in Proc. Eng. Syst. Design Anal. Conf. (ESDA), Haifa, Israel, 2008, pp. 413-421.
37. D. E. Rumelhart, G. E. Hinton, J. L. McClelland, and A. General, "Framework for parallel distributed processing," in Parallel Distributed Processing: Explorations in the Microstructure of Cognition, D. E. Rumelhart and J. L. McClell, Eds. Cambridge, MA: MIT Press, 1986.
38. M. Jordan, Serial Order: A Parallel Distributed Processing Approach. San Diego, CA: California Univ. Press, 1986, pp. 64-64.
39. A. Crowe, J. Porrill, and T. Prescott, "Kinematic coordination of reach and balance," J. Motor Behav., vol. 30, no. 3, pp. 217-233, 1998. (Pubitemid 28453397)
40. M. A. Arbib, T. Iberall, and D. Lyons, "Coordinated control programs for movements of the hand," Exp. Brain Res., vol. 10, pp. 111-129, 1985.
41. K. Okada, A. Haneda, H. Nakai, M. Inaba, and H. Inoue, "Environment manipulation planner for humanoid robots using task graph that generates action sequence," in Proc. IEEE/RSJ Int. Conf. Intell. Robot. Syst., Tokyo, Japan, 2004, pp. 3553-3558.
42. G. Metta, G. Sandini, and J. Konczak, "A developmental approach to visually-guided reaching in artificial systems," Neural Netw., vol. 12, no. 10, pp. 1413-1427, 1999.
43. G. Metta, F. Panerai, R. Manzotti, and G. Sandini, "Babybot: An artificial developing robotic agent," in Proc. 6th Int. Conf. Simulation Adapt. Behav., Paris, France, 2000.
44. M. Marjanovic, B. Scassellati, and M. Williamson, "Self taught visually guided pointing for a humanoid robot," in Proc. 4th Int.l Conf. Simulation Adapt. Behav. (SAB-96), Cape Cod, MA, 1996.
45. J. R. Cooperstock and E. E. Milios, "Self-supervised learning for docking and target reaching," Robot. Autonom. Syst.ems, vol. 11, no. 3-4, pp. 243-260, 1993.
46. D. E. Rumelhart, G. E. Hinton, and R. J. Williams, "Learning representation by back-propagating errors," Nature, vol. 323, pp. 533-536, 1986.
47. J. P. Lewis, "Fast template matching," Vis. Interface, pp. 120-123, 1995.
48. S. Birchfield and C. Tomasi, "Depth discontinuities by Pixel-to-Pixel stereo," Int. J. Computer Vis., vol. 35, no. 3, pp. 269-293, 1999. (Pubitemid 32210845)
49. N. Rezzoug and P. Gorce, "Robotic grasping: A generic neural network architecture," in Mobile Robots Towards New Applications, A. Lazinica, Ed. Berlin, Germany: Pro Literatur Verlag Robert MayerScholz, 2006.
50. G. A. Bekey et al. , "Knowledge-based control of grasping in robot hands using heuristics from human motor skills," IEEE Trans. Robot. Autom., vol. 9, no. 6, pp. 709-722, Dec. 1993.
51. T. Iberall, "Human prehension and dexterous robot hands," Int. J. Robot. Res., vol. 16, no. 3, pp. 285-299, 1997.
52. P. Gorce and J. Fontaine, "Design methodology for flexible grippers," J. Intell. Robot. Syst., vol. 15, no. 3, pp. 307-328, 1996.
53. R. Grupen and J. Coelho, "Acquiring state form control dynamics to learn grasping policies for robot hands," Int. J. Adv. Robot., vol. 15, no. 5, pp. 427-444, 2002.
54. M. Moussa and M. kamel, "An experimental approach to robotic grasping using a connectionist architecture and generic grasping functions," IEEE Trans. Syst., Man, Cybernet., vol. 28, no. 2, pp. 239-253, 1998. (Pubitemid 128748623)
55. F. Carenzi, P. Gorce, Y. Burnod, and M. Maier, "Using generic neural networks in the control and prediction of grasp postures," in Proc. 13th Eur. Symp. Artif. Neural Netw. (ESANN2005), Bruges, Belgium, 2005.
56. A. G. Barto and M. Jordan, "Gradient following without back-propagation in layered networks," in Proc. IEEE 1st Annu. Conf. Neural Netw., San Diego, CA, 1987, pp. II629-II636.
57. P. Varchacskaia, P. Fitzpatrick, and C. Breazeal, "Characterizing and processing robot-directed speech," in Proc. Int. IEEE/RSJ Conf. Human. Robot., Tokyo, Japan, 2001, pp. 229-237.
58. V. Zue, S. Seneff, J. Glass, J. Polifroni, C. Pao, T. Hazen, and L. Hetherington, "Jupiter: A telephone based conversational interface for weather information," IEEE Trans. Speech Audio Process., vol. 8, no. 1, pp. 100-112, Jan. 2000.
59. J. F. Werker, V. L. Lloyd, and J. E. Pegg, "Putting the baby in the bootstraps: Towards a more complete understanding of the role of the input in the infant speech processing," in Signal to Syntax: Bootstrapping From Speech to Grammar in Early Acquisition, J. Morgan and K. Denrath, Eds. Mahwah, NJ: Erlbaum, 1996, pp. 427-447.
60. M. Brent and J. Siskind, "The role of exposure to isolated words in early vocabulary development," Cognition, vol. 81, pp. B33-B44, 2001. (Pubitemid 32463854)
61. P. Placeway et al. , "The 1996 hub-4 sphinx-3 system," in Proc. ARPA Speech Recogn. Workshop, Gaithersburg, MD, 1997, pp. 85-89.
62. P. W. Jusczyk, "How infants begin to extract words from speech," Trends Cogn. Sci., vol. 3, no. 9, pp. 323-328, 1999. (Pubitemid 29417563)
63. A. Meltzoff and M. Moore, "Explaining facial imitation: A theoretical model," Early Develop. Parent., vol. 6, no. 3-4, pp. 179-192, 1997. (Pubitemid 127527083)
64. A. Dankers, N. Barnes, and A. Zelinsky, "MAP ZDF segmentation and tacking using active stereo vision: Hand tracking case study," CVIU, 2008, vol. 1-2, pp. 74-86, Oct.-Nov. 2007. (Pubitemid 47333385)
65. S. Grossberg, "How does the cerebral cortex work? development, learning, attention, and 3D vision by laminar circuits of visual cortex," Spatial Vis., vol. 12, pp. 163-187, 2003.