Autonomous learning of the semantics of internal sensory states based on motor exploration

International Journal of Humanoid Robotics

Volumn 4, Issue 2, 2007, Pages 211-243

  Choe, Yoonsuck ^a   Yang, Huei Fang ^a   Eng, Daniel Chern Yeow ^a  

^a TEXAS A AND M UNIVERSITY   (United States)

Author keywords

Grounding; Neural encoding decoding; Semantics; Sensorimotor learning

Indexed keywords

AUTONOMOUS MENTAL DEVELOPMENT; INTERNAL SENSORY STATE; MOTOR EXPLORATION; SENSORIMOTOR LEARNING;

BRAIN; HUMAN ENGINEERING; ROBOTICS; SEMANTICS; SENSORY PERCEPTION;

REINFORCEMENT LEARNING;

EID: 34447330416     PISSN: 02198436     EISSN: None     Source Type: Journal    
DOI: 10.1142/S0219843607001102     Document Type: Article

References (75)

1. J. Weng, J. L. McClelland, A. Pentland, O. Sporns, I. Stockman, M. Sur and E. Thelen, Autonomous mental development by robots and animals, Science 291(5504) (2001) 599-600.
2. M. Lugarella, G. Metta, R. Pfeifer and G. Sandini, Developmental robotics: A survey, Connect. Sci. 15 (2003) 151-190.
3. J. Weng, Developmental robotics: Theory and experiments, Int. J. Humanoid Robot. 1 (2004) 199-236.
4. R. D. Beer, Dynamical approaches to cognitive science, Trends Cogn. Sci. 4 (2000) 91-99.
5. R. A. Brooks, Intelligence without representation, Artif. Intell. 47 (1991) 139-159.
6. R. Pfeifer and C. Scheier, Understanding Intelligence (MIT Press, Cambridge, MA, 1999).
7. O. Sporns, Embodied cognition, in The Handbook of Brain Theory and Neural Networks, ed. M. A. Arbib, 2nd edn. (MIT Press, Cambridge, MA, 2003), pp. 395-398.
8. N. Daw, Visual Development (Plenum Press, New York, 1995).
9. E. R. Kandel, J. H. Schwartz and T. M. Jessell, Principles of Neural Science, 4th edn. (McGraw-Hill, New York, 2000).
10. R. Miikkulainen, J. A. Bednar, Y. Choe and J. Sirosh, Computational Maps in the Visual Cortex (Springer, Berlin, 2005), [http://www.computationalmaps.org].
11. E. Marder and R. L. Calabrese, Principles of rhythmic motor pattern production, Physiol. Rev. 76 (1996) 687-717.
12. R. Yuste, J. N. MacLean, J. Smith and A. Lansner, The cortex as a central pattern generator, Nature Rev. Neurosci. 2 (2005) 477-483.
13. D. M. Pierce and B. J. Kuipers, Map learning with uninterpreted sensors and effectors, Artif. Intell. 92 (1997) 162-227.
14. J. Piaget, The Origins of Intelligence in Children (Norton, New York, 1952).
15. M. A. Arbib, E. J. Conklin and J. Hill, From Schema Theory to Language (Oxford University Press, Oxford, 1987).
16. J. L. McClelland and T. T. Rogers, The parallel distributed processing approach to semantic cognition, Nature Rev. Neurosci. 4 (2003) 310-322.
17. T. T. Rogers and J. L. McClelland, Semantic Cognition: A Parallel Distributed Processing Approach (MIT Press, Cambridge, MA, 2004).
18. W. J. Freeman, A neurobiological theory of meaning in perception, in Proc. Int. Joint Conf. Neural Networks, Portland, OR, 20-24 July 2003 (IEEE Press, Piscataway, NJ, 2003), pp. 1373-1378.
19. P. R. Cohen and C. R. Beal, Natural semantics for a mobile robot, Technical Report 00-59, University of Massachusetts Computer Science (2000).
20. T. Ziemke, Rethinking grounding, in Understanding Representation in the Cognitive Sciences: Does Representation Need Reality?, eds. A. Riegler, A. von Stein and M. Peschl (Kluwer Academic/Plenum Press, New York, 1999), pp. 177-199.
21. S. Harnad, The symbol grounding problem, Physica D 42 (1990) 335-346.
22. P. Rieke, D. Warland, R. de Ruter van Steveninck and W. Bialek, Spikes: Exploring the Neural Code, 1st edn. (MIT Press, Cambridge, MA, 1997).
23. Y. Choe and N. H. Smith, Motion-based autonomous grounding: Inferring external world properties from internal sensory states alone, in Proc. 21st Nat. Conf. Artificial Intelligence, Boston, MA, 16-20 July 2006, eds. Y. Gil and R. Mooney (AAAI Press, Menlo Park, CA, 2006), pp. 936-641.
24. D. Marr and E. Hildreth, Theory of edge detection, Proc. Roy. Soc. London Ser. B 207 (1980) 187-217.
25. J. G. Daugman, Two-dimensional spectral analysis of cortical receptive field profiles, Vision Res. 20 (1980) 847-856.
26. N. Petkov and P. Kruizinga, Computational models of visual neurons specialised in the detection of periodic and aperiodic oriented visual stimuli: Bar and grating cells, Biol. Cybern. 76 (1997) 83-96.
27. M. C. Doyle and R. Walker, Multisensory interactions in saccade target selection: Curved saccade trajectories, Exper. Brain Res. 142 (2002) 116-130.
28. R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction (MIT Press, Cambridge, MA, 1998).
29. R. S. Sutton, Learning to predict by the methods of temporal differences, Mach. Learn. 3 (1988) 9-44.
30. C. J. C. H. Watkins, Learning from delayed rewards, Ph.D. dissertation, University of Cambridge, England (1989).
31. N. H. Smith, Learning sensory invariance driven action in complex input environments (2007), under preparation.
32. R. L. Bishop and S. I. Goldberg, Tensor Analysis on Manifolds (Dover, New York, 1980) [original edition: Macmillan (1968)].
33. R. P. N. Rao and D. L. Ruderman, Learning lie groups for invariant visual perception, in Advances in Neural Information Processing Systems 11, eds. M. S. Kearns, S. A. Solla and D. A. Cohn (MIT Press, Cambridge, MA, 1999), pp. 810-816.
34. N. Almássy and O. Sporns, Perceptual invariance and categorization in an embodied model of the visual system, in Biorobotics: Methods and Applications, eds. B. Webb and T. R. Consi (AAAI Press/MIT Press, Menlo Park, CA, 2001), pp. 123-143.
35. J. J. Gibson, The Perception of the Visual World (Houghton Mifflin, Boston, 1950).
36. J. K. O'Regan and A. Noë, A sensorimotor account of vision and visual consciousness, Behav. Brain Sci. 24(5) (2001) 883-917.
37. D. Philipona, J. K. O'Regan and J.-P. Nadal, Is there something out there? Inferring space from sensorimotor dependencies, Neural Comput. 15 (2003) 2029-2050.
38. D. Philipona, J. K. O'Regan, J.-P. Nadal and O. J.-M. D. Coenen, Perception of the structure of the physical world using unknown multimodal sensors and effectors, in Advances in Neural Information Processing Systems 16, eds. S. Thrun, L. Saul and B. Schölkopf (MIT Press, Cambridge, MA, 2004), pp. 945-952.
39. A. J. Bell, Levels and loops: The future of artificial intelligence and neuroscience, Philos. Trans. Roy. Soc. London 354 (1999) 2013-2020.
40. R. Platt Jr., A. H. Fagg and E. A. Grupen, Nullspace composition of control laws for grasping, in Proc. 2002 IEEE/RSJ Int. Cont. Intelligent Robots and Systems, Lausanne, Switzerland, 30 September-4 October 2002 (IEEE Press, Piscataway, N.J, 2002), pp. 1717-1723.
41. G. Tevatia and S. Schaal, Inverse kinematics for humanoid robots, in Proc. IEEE Int. Conf. Robotics and Automation 2000, San Francisco, CA, 24-28 April 2000, Vol. 1, ed. O. Khatib (IEEE, Piscataway, NJ, 2000), pp. 294-299.
42. R. Held and A. Hein, Movement-produced stimulation in the development of visually guided behavior, J. Comparat. Physiol. Psychol. 56 (1963) 872-876.
43. P. Bach-y-Rita, Brain Mechanisms in Sensory Substitution (Academic Press, New York, 1972).
44. P. Bach-y-Rita, Tactile vision substitution: Past and future, Int. J. Neurosci. 19 (1983) 29-36.
45. R. A. Brooks, A robust layered control system for a mobile robot, IEEE J. Robot. Autom. 2(10) (1986) 14-23.
46. R. A. Brooks, C. Braezeal (Ferrell), R. Irie, C. C. Kemp, M. Marjanović, B. Scassellati and M. M. Williamsom, Alternative essences of intelligence, in Proc. 15th Natl. Conf. Artificial Intelligence Madison, WI, 26-30 July 1998, eds. J. Mostow and C. Rich (AAAI Press, Menlo Park, CA, 1998), pp. 961-976.
47. A. Edsinger and C. C. Kemp, What can I control? A framework for robot discovery, in 6th Int. Conf. Epigenetic Robotics: Modeling Cognitive Development in Robotic Systems, Paris, France (20-22 September 2006), online proceedings: http://www.csl.sony.fr/epirob2006/papers/ EdsingerKemp.pdf.
48. K. Gold and B. Scassellati, Learning acceptable windows of contingency, Connect. Sci. 18 (2006) 217-228.
49. P. R. Cohen and C. R. Beal, Natural semantics for a mobile robot, University of Massachusettes, Department of Computer Science, Technical Report 00-59 (2000).
50. J. M. Mandler, How to build a baby: On the development of an accessible representational system, Cogn. Dev. 3 (1992) 113-136.
51. D. M. Pierce, Map learning with uninterpreted sensors and effectors, Ph.D. dissertation, Department of Computer Sciences, The University of Texas at Austin, Austin, TX (1995).
52. D. Pierce and B. Kuipers, Map learning with uninterpreted sensors and effectors, Artifi. Intell. 92 (1997) 169-227.
53. M. Bowling, A. Ghodsi and D. Wilkinson, Action respecting embedding, in Proc. 22nd Int. Cont. Machine Learning, Bonn, Germany, 7-11 August 2005, eds. L. De Raedt and S. Wrobel (Omni Press, Madison, WI, 2005), pp 65-72.
54. S. Singh, A. G. Barto and N. Chentanez, Intrinsically motivated reinforcement learning, in Advances in Neural Information Processing Systems 17, eds. L. K. Saul, Y. Weiss and L. Bottou (MIT Press, Cambridge, MA, 2005), pp. 1281-1288.
55. Y. Choe and R. Miikkulainen, Contour integration and segmentation in a self-organizing map of spiking neurons, Biol. Cybern. 90 (2004) 75-88.
56. Y. Choe and H.-F. Yang, Co-development of visual receptive fields and their motor primitive-based decoding scheme, in Society for Neuroscience Abstracts, Society for Neuroscience, Washington, DC (2006) Program No. 734.6. Online.
57. D. LaBerge, Attentional Processing (Harvard University Press, Cambridge, MA, 1995).
58. N. Misra, Comparison of motor-based versus visual representations in object recognition tasks, Master's thesis, Department of Computer Science, Texas A&M University, College Station, Texas (2005).
59. F. C. T. Moore, Bergson: Thinking Backwards (Cambridge University Press, Cambridge, UK, 1996).
60. S. Harnad, personal communication (2005).
61. R. Kozma and W. J. Freeman, Basic principles of the KIV model and its application to the navigation problem, J. Int. Neurosci. 2 (2003) 125-145.
62. E. Naito, P. E. Roland and H. H. Ehrsson, I felt my hand moving: A new role of the primary motor cortex in somatic perception of limb movement, Neuron 36 (2002) 979-988.
63. M. Bensafi, J. Porter, S. Pouliot, J. Mainland, B. Johnson, C. Zelano, N. Young, E. Bremner, D. Aframian, R. Khan and N. Sobel, Olfactomotor activity during imagery mimics that during perception, Nat. Neurosci. 6 (2003) 1142-1144.
64. A. Bompas, J. J. Clark and J. K. O'Regan, Colour perception in the sensorimotor contingency theory, Perception 31 (supplement) (2002) 90 i Proc. 25th European Conf. Visual Perception, Glasgow, Scotl and, 25-29 August 2002].
65. E. T. Rolls, Representation in the brain, Synthese 129 (2001) 153-171.
66. J. M. Fuster, The prefrontal cortex - An update: Time is of the essence, Neuron 30 (2001) 319-333.
67. G. Rizzolatti, L. Fadiga, V. Gallese and L. Fogassi, Premotor cortex and the recognition of motor neurons, Cogn. Brain Res. 3 (1996) 131-141.
68. G. Rizzolatti, L. Fogassi and V. Gallese, Neurophysiological mechanisms underlying the understanding and imitation of action, Nat. Rev. Neurosci. 2 (2001) 661-670.
69. Y. Choe, A deeper semantic role for the mirror system, Behavioral and Brain Sciences, Vol. 28 (2005), (On-line supplemental commentary on Arbib (2005) Behavioral and Brain Sciences, Vol. 28, pp. 105-167. URL: http://www.bbsonline.org/Preprints/Arbib-05012002/Supplemental.) 1 page.
70. P. Bach-y-Rita, Tactile sensory substitution studies, Ann. New York Acad. Sci. 1013 (2004) 83-91.
71. G. Kampis, The natural history of agents, in Agents Everywhere, eds. L. Gulyás, G. Tatai and J. Váncza (Springer, Budapest, 1999), pp. 24-48.
72. G. G. Turrigiano, Homeostatic plasticity in neuronal networks: The more things change, the more they stay the same, Trends Neurosci. 22 5) (1999) 221-227.
73. G. G. Turrigiano, K. R. Leslie, N. S. Desai, L. C. Rutherford and S. B. Nelson, Activity-dependent scaling of quantal amplitude in neocortical neurons, Nature 391 (February 1998) 845-846.
74. T. J. Sullivan and V. R. de Sa, Homeostatic synaptic scaling in self-organizing maps, Neural Networks 19 (2006) 734-743.
75. Y. Choe and S. K. Bhamidipati, Autonomous acquisition of the meaning of sensory states through sensory-invariance driven action, in Biologically Inspired Approaches to Advanced Information Technology: First International Workshop, eds. A. J. Ijspcert, M. Murata and N. Wakamiya, Lecture Notes in Computer Science, Vol. 3141 (Springer, Berlin, 2004), pp. 176-188.