A hybrid generative and predictive model of the motor cortex

Neural Networks

Volumn 19, Issue 4, 2006, Pages 339-353

  Weber, Cornelius ^a   Wermter, Stefan ^a   Elshaw, Mark ^a  

^a UNIVERSITY OF SUNDERLAND   (United Kingdom)

Author keywords

Basal ganglia; Continuous attractor network; Forward model; Helmholtz machine; Motor cortex; Reinforcement learning; Supervised learning; Unsupervised learning

Indexed keywords

FUNCTIONS; MATHEMATICAL MODELS; NEUROLOGY; PERSONNEL TRAINING;

BASAL GANGLIA; CONTINUOUS ATTRACTOR NETWORK; FORWARD MODEL; HELMHOLTZ MACHINE; MOTOR CORTEX; REINFORCEMENT LEARNING; SUPERVISED LEARNING; UNSUPERVISED LEARNING;

PREDICTIVE CONTROL SYSTEMS;

ARTICLE; BASAL GANGLION; ENVIRONMENT; MODEL; MOTOR CORTEX; NERVE CELL NETWORK; PERCEPTION; PERFORMANCE; PREDICTION; PRIORITY JOURNAL; REINFORCEMENT; SENSORIMOTOR CORTEX; SENSORY STIMULATION; SIMULATION;

BRAIN MAPPING; HUMANS; MODELS, BIOLOGICAL; MODELS, PSYCHOLOGICAL; MOTOR CORTEX; NEURAL PATHWAYS; PREDICTIVE VALUE OF TESTS; PSYCHOMOTOR PERFORMANCE; REINFORCEMENT (PSYCHOLOGY);

EID: 33744918063     PISSN: 08936080     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neunet.2005.10.004     Document Type: Article

References (52)

1. Aboitiz F., Morales D., and Montiel J. The evolutionary origin of the mammalian isocortex: Towards an integrated developmental and functional approach. The Behavioral and Brain Sciences 26 5 (2003) 535-552
2. Ackley D.H., Hinton G.E., and Sejnowski T.J. A learning algorithm for Boltzmann machines. Cognitive Science 9 (1985) 147-169
3. Bell A., and Sejnowski T. The 'independent components' of natural scenes are edge filters. Vision Research 37 23 (1997) 3327-3338
4. Blundell P., Hall G., and Killcross S. Preserved sensitivity to outcome value after lesions of the basolateral amygdala. The Journal of Neuroscience 23 20 (2003) 7702-7709
5. Boyan J., and Moore A. Generalization in reinforcement learning: Safely approximating the value function. In: Tesauro G., Touretzky D., and Lee T. (Eds). Neural information processing systems 7 (1995), MIT Press, Cambridge, MA 369-376
6. Brashers-Krug T., Shadmehr R., and Bizzi E. Consolidation in human motor memory. Nature 382 (1996) 252-255
7. Dayan P., Hinton G.E., Neal R., and Zemel R.S. The Helmholtz machine. Neural Computation 7 (1995) 1022-1037
8. Demiris Y., and Hayes G. Imitation as a dual-route process featuring prediction and learning components: A biologically-plausible computational model. In: Dautenhaln K., and Nehaniv C. (Eds). Imitation in animals and artifacts (2002), MIT Press, Cambridge, MA 327-361
9. Deneve S., Latham P., and Pouget A. Reading population codes: A neural implementation of ideal observers. Nature Neuroscience 2 8 (1999) 740-745
10. Deneve S., Latham P., and Pouget A. Efficient computation and cue integration with noisy population codes. Nature Neuroscience 4 8 (2001) 826-831
11. Dickinson A. Actions and habits: The development of behavioural autonomy. Philosophical Transactions of the Royal Society of London. Series B 308 (1985) 67-78
12. Doya K. What are the computations of the cerebellum, the basal ganglia and the cerebral cortex?. Neural Networks 12 (1999) 961-974
13. Fagg A., and Arbib M. Modeling parietal-premotor interactions in primate control of grasping. Neural Networks 11 (1998) 1277-1303
14. Felleman D., and Van Essen D. Distributed hierarchical processing in the primate cerebral cortex. Cerebral Cortex 1 (1991) 1-47
15. Foster D., Morris R., and Dayan P. A model of hippocampally dependent navigation, using the temporal difference learning rule. Hippocampus 10 (2000) 1-16
16. Fukushima K., Miyake S., and Ito T. Neocognitron: A neural network model for a mechanism of visual pattern recognition. IEEE Transactions on Systems, Man, and Cybernetics 13 (1983) 826-834
17. Gallese V., Fadiga L., Fogassi L., and Rizzolatti G. Action recognition in the premotor cortex. Brain 119 (1996) 593-609
18. Gallese V., and Goldman A. Mirror neurons and the simulation theory of mind-reading. Trends in Cognitive Sciences 2 12 (1998) 493-501
19. Hikosaka O., Nakamura K., Sakai K., and Nakahara H. Central mechanisms of motor skill learning. Current Opinion in Neurobiology 12 (2002) 217-222
20. Hinton, G., Dayan, P., To, A., & Neal, R. (1995). The Helmholtz machine through time. In: F. Soulie, & R. Gallinari (Eds.), Proceedings of the ICANN (pp. 483-490).
21. Hinton G.E., Dayan P., Frey B.J., and Neal R. The wake-sleep algorithm for unsupervised neural networks. Science 268 (1995) 1158-1161
22. Jog M., Kubota Y., Connolly C., Hillegaart V., and Graybiel A. Building neural representations of habits. Science 286 (1999) 1745-1749
23. Kohler E., Keysers C., Umilta M., Fogassi L., Gallese V., and Rizzolatti G. Hearing sounds, understanding actions: Action representation in mirror neurons. Science 297 (2002) 846-848
24. Kohonen T. Self-organizing maps (2001), Springer, Berlin
25. McCallum, A. (1995). Reinforcement learning with selective perception and hidden state. PhD thesis, University of Rochester.
26. Moore A., and Atkeson C. The parti-game algorithm for variable resolution reinforcement learning in multidimensional state-spaces. Machine Learning 21 (1995) 1-36
27. Olshausen B., and Field D. Sparse coding with an overcomplete basis set: A strategy employed by V1?. Vision Research 37 (1997) 3311-3325
28. Oztop E., and Arbib M. Schema design and implementation of the grasp-related mirror neuron system. Biological Cybernetics 87 (2002) 116-140
29. Oztop, E., Wolpert, D., & Kawato, M. (2003). Mirror neurons: Key for mental simulation? In: Twelfth annual computational neuroscience meeting CNS (abstracts) (p. 81).
30. Pasupathy A., and Miller E. Different time courses of learning-related activity in the prefrontal cortex and striatum. Nature 433 (2005) 873-876
31. Plaut, D. C., & Kello, C. T. (1998). The emergence of phonology from the interplay of speech comprehension and production: A distributed connectionist approach. In: B. MacWhinney (Ed.), The emergence of language (pp. 381-415).
32. Pulvermüller F. A brain perspective on language mechanisms: From discrete neuronal ensembles to serial order. Progress in Neurobiology 67 (2002) 85-111
33. Rao R., and Ballard D. Dynamic model of visual recognition predicts neural response properties of the visual cortex. Neural Computation 9 4 (1997) 721-763
34. Ravel S., and Richmond B. Where did the time go?. Nature Neuroscience 8 6 (2005) 705-707
35. Riesenhuber M., and Poggio T. Neural mechanisms of object recognition. Current Opinion in Neurobiology 12 (2002) 162-168
36. Rizzolatti G., and Arbib M. Language within our grasp. Trends in Neurosciences 21 5 (1998) 188-194
37. Rizzolatti G., and Luppino G. The cortical motor system. Neuron 18 2 (2001) 889-901
38. Robinson F., Cohen J., May J., Sestokas A., and Glickstein M. Cerebellar targets of visual pontine cells in the cat. The Journal of Comparative Neurology 223 4 (1984) 471-482
39. Rolls E. The orbitofrontal cortex and reward. Cerebral Cortex 10 3 (2000) 284-294
40. Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986). Learning internal representations by error propagation. In: Parallel distributed processing (Vol. 1, pp. 318-362). Cambridge, MA: MIT Press.
41. Sanes J., Dimitrov B., and Hallett M. Motor learning in patients with cerebellar dysfunction. Brain 113 1 (1990) 103-120
42. Sauser E., and Billard A. Three dimensional frames of references transformations using recurrent populations of neurons. Neurocomputing 64 (2005) 5-24
43. Shadmehr R., and Holcomb H. Neural correlates of motor memory consolidation. Science 277 (1997) 821-825
44. Stringer S., Rolls E., Trappenberg T., and de Araujo I. Self-organising continuous attractor networks and motor function. Neural Networks 16 (2003) 161-182
45. Umilta M., Kohler E., Gallese V., Fogassi L., Fadiga L., Keysers C., et al. I know what you are doing: A neurophysical study. Neuron 31 (2001) 155-165
46. Uther, W., & Veloso, M. (1998). Tree based discretization for continuous state space reinforcement learning. In: Proceedings of AAAI-98 (pp. 769-774).
47. Weber C. Self-organization of orientation maps, lateral connections, and dynamic receptive fields in the primary visual cortex. In: Dorffner G., Bischof H., and Hornik K. (Eds). Proceedings of the ICANN (2001), Springer, Berlin 1147-1152
48. Weber, C., & Wermter, S. (2003). Object localization using laterally connected 'what' and 'where' associator networks. In: Proceedings of the ICANN (pp. 813-820). Berlin: Springer.
49. Weber C., Wermter S., and Zochios A. Robot docking with neural vision and reinforcement. Knowledge-Based Systems 17 2-4 (2004) 165-172
50. Wermter S., and Elshaw M. Learning robot actions based on self-organising language memory. Neural Networks 16 5-6 (2003) 661-669
51. Yin H., Knowlton B., and Balleine B. Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning. The European Journal of Neuroscience 19 1 (2004) 181-189
52. Zhang K. Representation of spatial orientation by the intrinsic dynamics of the head-direction cell ensemble: A theory. Journal of Neuroscience 16 (1996) 2112-2126