Conditional visuo-motor learning and dimension reduction

Cognitive Processing

Volumn 7, Issue 2, 2006, Pages 95-104

  Hadj Bouziane, Fadila ^a,c   Frankowska, Hélène ^b   Meunier, Martine ^a   Coquelin, Pierre Arnaud ^b   Boussaoud, Driss ^a  

^a AIX MARSEILLE UNIVERSITY   (France)

^b Centre de Recherche en Epistemologie Appliquee Ecole Polytechnique   (France)

^c NATIONAL INSTITUTE OF MENTAL HEALTH   (United States)

Author keywords

Basal ganglia; Dimension reduction; Electrophysiology; Learning strategy; Monkey; Viability theory

Indexed keywords

ARTICLE; ASSOCIATION; BASAL GANGLION; DIMENSION REDUCTION; ELECTROPHYSIOLOGY; HIPPOCAMPUS; HUMAN; LEARNING; MONKEY; NEUROMODULATION; PREFRONTAL CORTEX; PREMOTOR CORTEX; PRIORITY JOURNAL; STATE DEPENDENT LEARNING; THEORETICAL MODEL; VISUOMOTOR COORDINATION;

BASAL GANGLIA; HUMANS; LEARNING; MODELS, NEUROLOGICAL; MODELS, STATISTICAL; NEURONS; PSYCHOMOTOR PERFORMANCE;

EID: 33646501771     PISSN: 16124782     EISSN: 16124790     Source Type: Journal    
DOI: 10.1007/s10339-005-0028-4     Document Type: Article

References (48)

1. Alexander GE, DeLong MR, Strick PL (1986) Parallel organization of functionally segregated circuits linking basal ganglia and cortex. Annu Rev Neurosci 9:357-381
2. Aubin J-P (1991) Viability theory. Birkhauser, Boston
3. Aubin J-P (1996) Neural networks and qualitative physics: a viability approach. University Press, Cambridge
4. Aubin J-P (2001) Viability kernels and capture basins of sets under differential inclusions. SIAM J Control 40:853-881
5. Aubin J-P, Frankowska H (1996) The viability kernel algorithm for computing value functions of infinite horizon optimal control problems. J Math Anal Appl 201:555-576
6. Bar-Gad I, Morris G, Bergman H (2003) Information processing, dimensionality reduction and reinforcement learning in the basal ganglia. Prog Neurobiol 71:439-473
7. Barto A (1995) Adaptive critics and the basal ganglia. In: Houk JC, Davis JL, Beiser DG (eds) Models of information processing in the basal ganglia. MIT Press, Cambridge, pp 215-232
8. Boussaoud D, Wise SP (1993a) Primate frontal cortex: neuronal activity following attentional versus intentional cues. Exp Brain Res 95:15-27
9. Boussaoud D, Wise SP (1993b) Primate frontal cortex: effects of stimulus and movement. Exp Brain Res 95:28-40
10. Boussaoud D, Kermadi I (1997) The primate striatum: neuronal activity in relation to spatial attention versus motor preparation. Eur J Neurosci 9:2152-2168
11. Brasted PJ, Wise SP (2004a) Comparison of learning-related neuronal activity in the dorsal premotor cortex and striatum. Eur J Neurosci 19(3):721-740
12. Brasted PJ, Wise SP (2004b) The arbitrary mapping of sensory inputs to voluntary and involuntary movement: learning-dependant activity in the motor cortex and other telencephalic networks. In: Riehle A, Vaadia E (eds) Motor cortex in voluntary movements, pp 259-293
13. Bussey TJ, Wise SP, Murray EA (2001) The role of ventral and orbital prefrontal cortex in conditional visuomotor learning and strategy use in rhesus monkeys (Macaca mulatta). Behav Neurosci 115:971-982
14. Canavan AGM, Nixon PD, Passingham RE (1989) Motor learning in monkeys (Macaca fascicularis) with lesions in motor thalamus. Exp Brain Res 77:113-126
15. Cardaliaguet P, Quincampoix M, Saint-Pierre P (1999) Set-valued numerical methods for optimal control and differential games, in Stochastic and differential games: theory and numerical methods. Annals of the International Society of Dynamical Games, Birkhauser, pp 177-247
16. Doya K (1999) What are the computations of the cerebellum, the basal ganglia, and the cerebral cortex. Neural Netw 12:961-974
17. Doya K (2000) Reinforcement learning in continuous time and space. Neural Comput 12:219-245
18. Fiorillo CD, Tobler PN, Schultz W (2003) Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299:1898-1902
19. Frankowska H, Quincampoix M (1991) Viability kernels of differential inclusions with constraints: algorithm and applications. J Math Syst Estim Control 1:371-388
20. Genovesio A, Brasted PJ, Mitz AR, Wise SP (2005) Prefrontal cortex activity related to abstract response strategies. Neuron 47(2):307-20
21. Hadj-Bouziane F, Boussaoud D (2003) Activity of neurons in the striatum during learning of arbitrary visuo-motor associations. Exp Brain Res 18:269-277
22. Hadj-Bouziane F, Meunier M, Boussaoud D (2003) Conditional visuo-motor learning in primates: a key role for the basal ganglia. J Physiol Paris 97:567-579
23. Hadj-Bouziane F, Benatru I, Klinger H, Brousolle E, Boussaoud D, Meunier M (2004) Conditional associative learning in advanced Parkinson's disease. Soc Neurosci Abstr 710:4
24. Halsband U, Freund HJ (1990) Premotor cortex and conditional motor learning in man. Brain 113:207-222
25. Hollerman JR, Tremblay L, Schultz W (1998) Influence of reward expectation on behavior-related neuronal activity in primate striatum. J Neurophysiol 80:947-963
26. Houk JC, Adams JL, Barto AG (1995) A model of how the basal ganglia generate and use reward signals that predict reinforcement. In: Houk JC, Davis JL, Beiser DG (eds) Models of information processing in the basal ganglia. MIT Press, Cambridge, pp 249-270
27. Joel D, Weiner I (1994) The organization of the basal ganglia-thalamocortical circuits: open interconnected rather than closed segregated. Neuroscience 63:363-379
28. Kurata K, Hoffman DS (1994) Differential effects of muscimol microinjection into dorsal and ventral aspects of the premotor cortex of monkeys. J Neurophysiol 71:1151-1164
29. Ljungberg T, Apicella P, Schultz W (1992) Responses of monkey dopamine neurons during learning of behavioral reactions. J Neurophysiol 67:145-163
30. Nixon PD, McDonald KR, Gough PM, Alexander IH, Passingham RE (2004) Cortico-basal ganglia pathways are essential for the recall of well-established visuomotor associations. Eur J Neurosci 20(11):3165-78
31. Parent A (1990) Extrinsic connections of the basal ganglia. Trends Neurosci 13:254-258
32. Parent A, Hazrati LN (1995) Functional anatomy of the basal ganglia. I. The cortico-basal gangliathalamo-cortical loop. Brain Res Brain Res Rev 20:91-127
33. Passingham RE (1993) The frontal lobe and voluntary action. Oxford University Press, Oxford
34. Passingham RE, Toni I, Rushworth MF (2000) Specialization within the prefrontal cortex: the ventral prefrontal cortex and associative learning. Exp Brain Res 133:103-113
35. Petrides M (1985) Conditional learning and the primate frontal cortex. In: Perecman E (ed) The frontal lobe revisited. IBRN press, New York, pp 91-108
36. Prensa L, Cossette M, Parent A (2000) Dopaminergic innervation of human basal ganglia. J Chem Neuroanat 20:207-213
37. Saint-Pierre P (2001) Approximation of viability kernels and capture basin for hybrid systems. In: Martins de Carvalho JL (ed) Proceedings of the European Control Conference ECC 2001, pp 2776-2783
38. Saint-Pierre P (2002) Hybrid kernels and capture basins for impulse constrained systems, Communication at International Conference HSCC02, Stanford
39. Schultz W (2002) Getting formal with dopamine and reward. Neuron 36:241-263
40. Schultz W, Apicella P, Ljungberg T, Romo R, Scarnati E (1993) Reward-related activity in the monkey striatum and substantia nigra. Prog Brain Res 99:227-235
41. Smith Y, Kieval JZ (2000) Anatomy of the dopamine system in the basal ganglia. Trends Neurosci 23(Suppl 10):S28-S33
42. Sutton R, Barto A (1998) Reinforcement learning: an introduction. MIT Press, Cambridge
43. Toni I, Rowe J, Stephan KE, Passingham RE (2002) Changes of cortico-striatal effective connectivity during visuomotor learning. Cereb Cortex 12:1040-1047
44. Tremblay L, Hollerman JR, Schultz W (1998) Modifications of reward expectation-related neuronal activity during learning in primate striatum. J Neurophysiol 80:964-977
45. Wise SP, Murray EA (1999) Role of the hippocampal system in conditional motor learning: mapping antecedents to action. Hippocampus 9:101-117
46. Wise SP, Murray EA (2000) Arbitrary associations between antecedents and actions. Trends Neurosci 23(6):271-276
47. Wise SP, Murray EA, Gerfen CR (1996a) The frontal cortex basal ganglia system in primates. Crit Rev Neurobiol 10:317-356
48. Wise SP, di Pellegrino G, Boussaoud D (1996b) The premotor cortex and nonstandard sensorimotor mapping. Can J Physiol Pharmacol 74:469-482