Combining self-organizing maps with mixtures of experts: Application to an actor-critic model of reinforcement learning in the basal ganglia

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 4095 LNAI, Issue , 2006, Pages 394-405

  Khamassi, Mehdi ^a,b,c   Martinet, Louis Emmanuel ^a,b   Guillot, Agnès ^a,b  

^a SORBONNE UNIVERSITÉ   (France)

^b CNRS   (France)

^c l'alimentation et l'Environnement   (France)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; KNOWLEDGE ACQUISITION; LEARNING SYSTEMS; MATHEMATICAL MODELS;

REINFORCEMENT LEARNING; TASK COMPLEXITY; TASK DECOMPOSITION;

SELF ORGANIZING MAPS;

EID: 33749675082     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/11840541_33     Document Type: Conference Paper

References (21)

1. Albertin, S. V., Mulder, A. B., Tabuchi, E., Zugaro, M. B., Wiener, S. I.: Lesions of the medial shell of the nucleus accumbens impair rats in finding larger rewards, but spare reward-seeking behavior. Behavioral Brain Research. 117(1-2) (2000) 173-83
2. Arleo, A., W. Gerstner,W.: Spatial cognition and neuro-mimetic navigation: a model of hippocampal place cell activity. Biological Cybernetics, 83(3) (2000) 287-99
3. Baldassarre, G.: A modular neural-network model of the basal ganglia's role in learning and selecting motor behaviors. Journal of Cognitive Systems Research, 3(1) (2002) 5-13
4. Doya, K., Samejima., K., Katagiri, K., Kawato, M: Multiple model-based reinforcement learning. Neural Computation, 14(6) (2002) 1347-69
5. Filliat, D., Girard, B., Guillot, A., Khamassi, M., Lachèze, L., Meyer, J.-A.: State of the artificial rat Psikharpax. In: Schaal, S., Ijspeert, A., Billard, A., Vijayakumar, S., Hallam, J., Meyer, J.-A. (eds): From Animals to Animats 8: Proceedings of the Seventh International Conference on Simulation of Adaptive Behavior, Cambridge, MA. MIT Press (2004) 3-12
6. Fritzke, B.: A growing neural gas network learns topologies. In: Tesauro, G, Touretzkys, D.S., Leen, K.(eds): Advances in Neural Information Processing Systems, MIT Press, (1995) 625-32
7. Geman, S., Bienenstock, E., Doursat, R.: Neural networks and the bias/variance dilemma. Neural Computation 4 (1992) 1-58
8. Gurney, K.,Prescott, T.J., Redgrave, P.: A computational model of action selection in the basal ganglia. I. A new functional anatomy. Biological Cybernetics, 84 (2001) 401-10
9. Holmström, J.: Growing neural gas: Experiments with GNG, GNG with utility and supervised GNG. Master's thesis, Uppsala University (2002)
10. Jog, M.S., Kubota, Y., Connolly, C.I., Hillegaart, V., Graybiel, A.M.: Building neural representations of habits. Science, 286(5445) (1999) 1745-9
11. Khamassi, M., Lachèze, L., Girard, B., Berthoz, A., Guillot, A: Actor-critic models of reinforcement learning in the basal ganglia: From natural to artificial rats. Adaptive Behavior, Special Issue Towards Artificial Rodents 13(2) (2005) 131-48
12. Kohonen, T.: Self-organizing maps. Springer-Verlag, Berlin (1995)
13. Lee, J. K., Kim, I. H.: Reinforcement learning control using self-organizing map and multi-layer feed-forward neural network. In: International Conference on Control Automation and Systems, ICCAS 2003 (2003)
14. Meyer, J.-A., Guillot, A., Girard, B., Khamassi, M., Pirim, P., Berthoz, A.: The Psikharpax project: Towards building an artificial rat. Robotics and Autonomous Systems 50(4) (2005) 211-23
15. Marsland, S., Shapiro, J., Nehmzow, U.-. A self-organising network that grows when required. Neural Networks, 15 (2002) 1041-58
16. Prescott, T.J., Redgrave, P., Gurney, K.: Layered control architectures in robots and vertebrates. Adaptive Behavior, 7 (1999) 99-127
17. Schultz, W., Dayan, P., Montague, P. R.: A neural substrate of prediction and reward. Science, 275 (1997) 1593-9
18. Smith, A. J.: Applications of the self-organizing map to reinforcement learning. Neural Networks 15(8-9) (2002)1107-24
19. Sutton, R. S., Barto, A. G.: Reinforcement learning: An introduction. The MIT Press Cambridge, MA. (1998)
20. Tang, B., Heywood, M. I.: Shepherd, M.: Input Partitioning to Mixture of Experts. In: IEEE/INNS International Joint Conference on Neural Networks, Honolulu, Hawaii (2002) 227-32
21. Tani, J., Nolfi, S.: Learning to perceive the world as articulated: an approach for hierarchical learning in sensory-motor systems.Neural Networks12(1999)1131-41