Inherent value systems for autonomous mental development

International Journal of Humanoid Robotics

Volumn 4, Issue 2, 2007, Pages 407-433

  Huang, Xiao ^a   Weng, Juyang ^a  

^a Michigan State University   (United States)

Author keywords

Developmental learning; Habituation; Reinforcement learning; Value system; Visual attention

Indexed keywords

DEVELOPMENTAL LEARNING; INHERENT VALUE SYSTEM; SENSORIMOTOR SKILLS; VISUAL ATTENTION;

ARTIFICIAL INTELLIGENCE; AUTONOMOUS AGENTS; BRAIN MODELS; COMPUTER ARCHITECTURE; COMPUTER VISION;

REINFORCEMENT LEARNING;

EID: 34447328072     PISSN: 02198436     EISSN: None     Source Type: Journal    
DOI: 10.1142/S0219843607001011     Document Type: Article

References (41)

1. N. Almassy, G. M. Edelman and O. Sporns, Behavioral constraints in the development of neural properties: A cortical model embedded in a real-world device, Cereb. Cortex 8 (1998) 346-361.
2. M. Asada, K. MacDorman, H. Ishiguro and Y. Kuniyoshi, Cognitive developmental robotics as a new paradigm for the design of humanoid robots, Robot. Autonom. Syst. 37 (2001) 185-193.
3. M. Asada, S. Noda, S. Tawaratsumida and K. Hosoda, Purposive behavior acquisition on a real robot by vision-based reinforcement learning, Mach. Learn. 23 (1996) 279-303.
4. A. Barto, S. Singh and N. Chentanez, Intrinsically motivated learning of hierarchical collections of skills, in Proc. 3rd Int. Conf. on Development and Learning, La Jolla, California, 20-22 October 2004 (IEEE Press, 2004), pp. 112-119.
5. N. Bayley, Bayley Scales of Infant Development (Psychological Corp, San Antonio, TX, 1993).
6. V. Castellugcci and E. Kandel, An invertebrate system for the cellular study of habituation and sensitization, in Habituation: Perspective from Child Development, Animal Behavior and Neurophysiology, eds. T. Tighe and R. Leaton (Lawrence Erlbaum Associates, Hillsdale, NJ, 1976), pp. 1-48.
7. L. Cohen, Habitutation of infant visual attention, in Habituation: Perspective from Child Development, Animal Behavior and Neurophysiology eds. T. Tighe and R. Leaton (Lawrence Erlbaum Associates, Hillsdale, NJ, 1976), pp. 207-238.
8. M. Domjan, The Principles of Learning and Behavior (Brooks/Cole Publishing Company, Belmont, CA, 1998).
9. J. H. Flavell, P. H. Miller and S. A. Miller, Cognitive Development (Prentice-Hall, Englewood Cliffs, NJ, 1993).
10. X. Huang and J. Weng, Novelty and reinforcement learning in the value system of developmental robots, in 2nd Int. Workshop on Epigenetic Robotics, Edinburgh, Scotland (10-11 August 2002), pp. 47-55.
11. L. Itti, C. Koch and E. Niebur, A model of saliency-based visual attention for rapid scene analysis, IEEE Trans. Pattern Anal. Mach. Intell. 20(11) (1998) 1254-1259.
12. S. Kakade and P. Dayan, Dopamine bonuses, in Advances in Neural Information Processing Systems, Vol. 13, Denver, CO (MIT Press, 2000), pp. 131-137.
13. S. Kakade and P. Dayan, Dopamine: Generalization and bonuses, Neural Network 15 (2002) 549-559.
14. P. W. Kaplan, J. S. Werner and J. W. Rudy, Habitutation, sensitization and infant visual attention, in Advances in Infancy Research, eds. C. Rovee-Collier and L. Lipsit (ABLEX Publishing Corporation, Norwood, NJ, 1990), pp. 61-110.
15. C. Koch and S. Ullman, Shifts in selective visual attention towards the underlying neural circuitry, Human Neurobiol. 4 (1985) 219-227.
16. M. Lungarella, G. Metta, R. Pfeifer and G. Sandini, Developmental robotics: A survey, Connection Sci. 15(4) (2003) 151-190.
17. S. Marsland, U. Nehmzow and J. Shapiro, Novelty detection on a mobile robot using habituation, in From Animals to Animats, 6th Int. Conf. Simulation of Adaptive Behaviour, Paris, France (2000), pp. 188-198.
18. H. Ogmen, A developmental perspective to neural models of intelligence and learning, in Optimality in Biological and Artificial Networks? eds. D. Levine and R. Elsberry (Lawrence Erlbaum Associates, Hillsdale, NJ, 1997), pp. 363-395.
19. P. Y. Oudeyer and F. Kaplan, Intelligent adaptive curiosity: A source of self-development, in Proc. 4th Int. Workshop on Epigenetic Robotics Genoa, Italy (25-27 August 2004), pp. 127-130.
20. P. Y. Oudeyer and F. Kaplan, The playground experiment: Task-independent development of a curious robot, in Proc. AAAI Spring Symp. Workshop on Developmental Robotics, Stanford, CA (2005), pp. 42-47.
21. H. Peeke and M. Herz, Habituation (Academic Press, 1973).
22. J. Piaget, The Origins of Intelligence in Children (International Universities Press, New York, 1952).
23. M. Rucci, G. Tononi and G. M. Edelman, Registration of neural maps through value-dependent learning: Modeling the alignment of auditory and visual maps in the barn owl's pitic tecturm, J. Neurosci. 17 (1997) 334-352.
24. S. Russell and P. Norvig, Artificial Intelligence: A Modern Approach (Prentice Hall, Englewood Cliffs, NJ, 1995).
25. B. Scassellati, Theory of mind for a humanoid robot, Autonom. Robot. 12 (2002) 13-24.
26. J. Schmidhuber, Curious model-building control systems, in Proc. Int. Joint Conf. Neural Networks, Singapore (IEEE Press, 1991), pp. 1458-1463.
27. W. Schultz, Multiple reward signals in the brain, Nature Rev. Newrosci. 1 (2000) 199-207.
28. O. Sporns, Modeling development and learning in autonomous devices, in Workshop on Development and Learning, E. Lansing, Michigan, USA, April 5-7 (2000), pp. 88-94.
29. O. Sporns, N. Almassy and G. Edelman, Plasticity in value system and its role in adaptive behavior, Adaptive Behav. 8(2) (2000) 129-148.
30. J. Stanley, Computer simulation of a model of habituation, Nature 261 (1976) 146-148.
31. M. Sur, A. Angelucci and J. Sharm, Rewiring cortex: The role of patterned activity in development and plasticity of neocortical circuits, J. Neurobiol. 41 (1999) 33-43.
32. R. S. Sutton and A. G. Barto, Toward a modern theory of adaptive networks: Expectation and prediction, Psychol. Rev. 88(2) (1981) 135-170.
33. R. S. Sutton and A. G. Barto, Reinforcement Learning - An Introduction (MIT Press, Cambridge, MA, 1998).
34. R. Thompson, The neurobiology of learning and memory, Science 233 (1986) 941-947.
35. S. Thrun, Exploration in Active Learning (MIT Press, Cambridge, MA, 1995).
36. C. J. Watkins, Qlearning, Mach. Learn. 8 (1992) 279-292.
37. J. Weng, Developmental robotics: Theory and experiments, Int. J. Humanoid Robot. 1 (2004) 199-236.
38. J. Weng, From neural networks to the brain: Autonomous mental development, IEEE Comput. Intell. Mag. 1(3) (2006) 15-31.
39. J. Weng and W. Hwang, An incremental learning algorithm with automatically derived discriminating features, in Proc. 4th Asian Conf. Computer Vision, Taipei, Taiwan, 8-9 January 2000 (Elsevier Science, 2000), pp. 426-431.
40. J. Weng, J. McClelland, A. Pentland, O. Sporns, I. Stockman, M. Sur and E. Thelen, Autonomous mental development by robots and animals, Science 291 (2000) 599-600.
41. D. Zeaman, The ubiquity of novelty-familiarity effects, in Habituation: Perspective from Child Development, Animal Behavior and Neurophysiology, eds. T. Tighe and R. Leaton (Lawrence Erlbaum Associates, Hillsdale, NJ, 1976), pp. 297-320.