Motor planning under unpredictable reward: Modulations of movement vigor and primate striatum activity

Frontiers in Neuroscience

Volumn , Issue MAY, 2011, Pages

  Opris, Ioan ^a   Lebedev, Mikhail ^b   Nelson, Randall J ^c  

^a WAKE FOREST SCHOOL OF MEDICINE   (United States)

^b DUKE UNIVERSITY SCHOOL OF MEDICINE   (United States)

^c UNIVERSITY OF TENNESSEE HEALTH SCIENCE CENTER   (United States)

Author keywords

Basal ganglia; Decision making; Hand movements; Movement planning; Movement vigor; Primate neostriatum; Reward; Uncertainty

Indexed keywords

ANIMAL BEHAVIOR; ANIMAL EXPERIMENT; ARTICLE; BEHAVIOR; CONTROLLED STUDY; CORPUS STRIATUM; DECISION MAKING; HAND MOVEMENT; KINEMATICS; MACACA MULATTA; MALE; MENTAL PERFORMANCE; MOTOR PERFORMANCE; MOTOR PLANNING; MOVEMENT VIGOR; NERVE CELL; NEUROMODULATION; NONHUMAN; PRIMATE; PROBABILITY; RANGE OF MOTION; REACTION TIME; RESPONSE TIME; REWARD; SENSORIMOTOR FUNCTION; TACTILE STIMULATION; UNPREDICTED REWARD; VELOCITY; VIBROTACTILE STIMULATION; VISUAL STIMULATION; WRIST;

EID: 84855273234     PISSN: 16624548     EISSN: 1662453X     Source Type: Journal    
DOI: 10.3389/fnins.2011.00061     Document Type: Article

References (65)

1. Alexander, G. E., and Crutcher, M. D. (1990). Preparation for movement: neural representations of intended direction in three motor areas of the monkey. J. Neurophysiol. 64, 133-150.
2. Beck, J. M., Ma, W. J., Kiani, R., Hanks, T., Churchland, A. K., Roitman, J., Shadlen, M. N., Latham, P. E., and Pouget, A. (2008). Probabilistic pop-ulation codes for Bayesian decision making. Neuron 60, 1142-1152.
3. Blazquez, P. M., Fujii, N., Kojima, J., and Graybiel, A. M. (2002). A network rep-resentation of response probability in the striatum. Neuron 33, 973-982.
4. Churchland, M. M., Santhanam, G., and Shenoy, K. V. (2006a). Preparatory activity in premotor and motor cor-tex reflects the speed of the upcoming reach. J. Neurophysiol. 96, 3130-3146.
5. Churchland, M. M., Afshar, A., and Shenoy, K. V. (2006b). A central source of movement variability. Neuron 52, 1085-1096.
6. Colburn, T. R., and Evarts, E. V. (1978). "Long-loop adjustments during intended movements: use of brush-less D.C. torque motors in studies of neuromuscular function," in Progress in Clinical Neurophysiology, Vol. 4, ed. J. E. Desmedt (New York: Karger), 153-166.
7. Ding, L., and Hikosaka, O. (2007). Temporal development of asymmet-ric reward-induced bias in macaques. J. Neurophysiol. 97, 57-61.
8. Ditterich, J. (2006). Evidence for time-var-iant decision making. Eur. J. Neurosci. 24, 3628-3641.
9. Fiorillo, C. D., Tobler, P. N., and Schultz, W. (2003). Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299, 1898-1902.
10. Frederick, S., Loewenstein, G., and O'Donoghue, T. (2002). Time discounting and time preference: a critical review. J. Econ. Lit. 40, 351-401.
11. Harris, C. M., and Wolpert, D. M. (1998). Signal-dependent noise determines motor planning. Nature 394, 780-784.
12. Herrnstein, R. J. (1961). Relative and abso-lute strength of response as a function of frequency of reinforcement. J. Exp. Anal. Behav. 4, 267-272.
13. Gardiner, T. W., and Nelson, R. J. (1992). Striatal neuronal activity during the initiation of hand movements made in response to visual and vibratory cues. Exp. Brain Res. 92, 15-26.
14. Gaspar, P., Stepniewska, I., and Kaas, J. H. (1992). Topography and collateraliza-tion of the dopaminergic projections to motor and lateral prefrontal cortex in owl monkeys. J. Comp. Neurol. 325, 1-21.
15. Hayden, B. Y., Nair, A., McCoy, A. N., and Platt, M. L. (2008). Posterior cingulate cortex mediates outcome-contingent allocation of behavior. Neuron 60, 19-25.
16. Hikosaka, O., and Isoda, M. (2010). Switching from automatic to con-trolled behavior: cortico-basal ganglia mechanisms. Trends Cogn. Sci. (Regul. Ed.) 14, 154-161.
17. Horak, F. B., and Anderson, M. E. (1984). Influence of globus pallidus on arm movements in monkeys. II. Effects of stimulation. J. Neurophysiol. 52, 305-322.
18. Hori, Y., Minamimoto, T., and Kimura, M. (2009). Neuronal encoding of reward value and direction of actions in the primate putamen. J. Neurophysiol. 102, 3530-3543.
19. Hoshi, E., and Tanji, J. (2000). Integration of target and body-part information in the premotor cortex when planning action. Nature 408, 466-470.
20. Kalaska, J. F., and Crammond, D. J. (1995). Deciding not to GO: neuronal corre-lates of response selection in a GO/NOGO task in primate premotor and parietal cortex. Cereb. Cortex 5, 410-428.
21. Kim, S., Hwang, J., and Lee, D. (2008). Prefrontal coding of temporally dis-counted values during intertemporal choice. Neuron 59, 161-172.
22. Kimura, M., Yamada, H., and Matsumoto, N. (2003). Tonically active neurons in the striatum encode motivational con-texts of action. Brain Dev. 25(Suppl. 1), S20-S23.
23. Kiyatkin, E. A., and Rebec, G. V. (1996). Dopaminergic modulation of glutamate-induced excitations of neu-rons in the neostriatum and nucleus accumbens of awake unrestrained rats. J. Neurophysiol. 75, 142-152.
24. Lau, B., and Glimcher, P. W. (2008). Value representations in the primate striatum during matching behavior. Neuron 58, 451-463.
25. Lauwereyns, J., Watanabe, K., Coe, B., and Hikosaka, O. (2002). A neural correlate of response bias in monkey caudate nucleus. Nature 418, 413-417.
26. Lebedev, M. A., and Nelson, R. J. (1995). Rhythmically firing, 20-50 Hz neurons in monkey primary somatosensory cortex: activity patterns during ini-tiation of vibratory-cued hand move-ments. J. Comp. Neurosci. 2, 313-334.
27. Lebedev, M. A., and Nelson, R. J. (1996). High-frequency vibratory sensitive neurons in monkey primary somato-sensory cortex: entrained and nonen-trained responses to vibration during the performance of vibratory-cued hand movements. Exp. Brain Res. 111, 313-325.
28. Lebedev, M. A., and Nelson, R. J. (1999). Rhythmically firing neostriatal neurons in monkey: activity pat-terns during reaction-time hand movements. J. Neurophysiol. 82, 1832-1842.
29. Lebedev, M. A., O'Doherty, J. E., and Nicolelis, M. A. (2008). Decoding of temporal intervals from cortical ensemble activity. J. Neurophysiol. 99, 166-186.
30. Lee, H., and Assad, J. (2003). Putaminal activity for simple reactions or self-timed movements. J. Neurophysiol. 89, 2528-2537.
31. Liu, Y., Denton, J. M., and Nelson, R. J. (2005). Neuronal activity in primary motor cortex differs when monkeys perform somatosensory and visually guided wrist movements. Exp. Brain Res. 167, 571-586.
32. Liu, Y., Denton, J. M., and Nelson, R. J. (2008). Monkey primary somatosensory cortical activity during the early reaction time period differs with cues that guide movements. Exp. Brain Res. 187, 349-358.
33. Machens, C. K., Romo, R., and Brody, C. D. (2010). Functional, but not anatomi-cal, separation of "What" and "When" in prefrontal cortex. J. Neurosci. 30, 350-360.
34. Maimon, G., and Assad, J. A. (2006). A cognitive signal for the proactive tim-ing of action in macaque LIP. Nat. Neurosci. 9, 948-955.
35. McCoy, A. N., and Platt, M. L. (2005). Expectations and outcomes: decision-making in the primate brain. J. Comp. Physiol. A Neuroethol. Sens. Neural. Behav. Physiol. 191, 201-211.
36. Miller, E. K., and Phelps, E. A. (2010). Preface: current opinion in neurobiology-cognitive neuro-science, editorial overview. Curr. Opin. Neurobiol. 20, 1-2.
37. Mirenowicz, J., and Schultz, W. (1994). Importance of unpredictability for reward responses in primate dopamine neurons. J. Neurophysiol. 72, 1024-1027.
38. Mohr, P. N., and Nagel, I. E. (2010). Variability in brain activity as an individual difference measure in neu-roscience? J. Neurosci. 30, 7755-7757.
39. Nelson, R. J., Lebedev, M. A., Opris, I., and Denton, J. M. (1996). Neostriatal neu-ronal activity becomes better related to movements when conditions become unpredictable. Soc. Neurosci. Abstr. 22, 1085.
40. Nelson, R. J., Opris, I., and Denton, J. M. (1997). Effects of the number of consecutive rewarded trials on sub-sequent movement related activity of neostriatal and sensorimotor cortical neurons. Soc. Neurosci. Abstr. 23, 464.
41. Opris, I., and Bruce, C. J. (2005). Neural circuitry of judgment and decision mechanisms. Brain Res. Rev. 48, 509-528.
42. Opris, I., Hampson, R. E., and Deadwyler, S. A. (2009). The encoding of cocaine vs. natural rewards in the striatum of nonhuman primates: categories with different activations. Neuroscience 163, 40-54.
43. O'Shea, J., Sebastian, C., Boorman, E. D., Johansen-Berg, H., and Rushworth, M. F. (2007). Functional specificity of human premotor-motor cortical interactions during action selection. Eur. J. Neurosci. 26, 2085-2095.
44. Padoa-Schioppa, C., and Assad, J. A. (2006). Neurons in the orbitofrontal cortex encode economic value. Nature 441, 223-226.
45. Pasquereau, B., Nadjar, A., Arkadir, D., Bezard, E., Goillandeau, M., Bioulac, B., Gross, C. E., and Boraud, T. (2007). Shaping of motor responses by incentive val-ues through the basal ganglia. J. Neurosci. 27, 1176-1183.
46. Platt, M. L., and Huettel, S. A. (2008). Risky business: the neuroeconomics of decision making under uncertainty. Nat. Neurosci. 11, 398-403.
47. Redgrave, P., Prescott, T. J., and Gurney, K. (1999). The basal ganglia: a vertebrate solution to the selection problem. Neuroscience 89, 1009-1023.
48. Renoult, L., Roux, S., and Riehle, A. (2006). Time is a rubber band: neu-ronal activity in monkey motor cortex in relation to time estimation. Eur. J. Neurosci. 23, 3098-3108.
49. Romo, R., Scarnati, E., and Schultz, W. (1992). Role of primate basal ganglia and frontal cortex in the internal gen-eration of movements. Exp. Brain Res. 91, 385-395.
50. Romo, R., and Schultz, W. (1990). Dopamine neurons of the monkey midbrain: Contingencies of responses to active touch during self-initiated arm movements. J. Neurophysiol. 63, 592-606.
51. Salinas, E., Opris, I., Zainos, A., Hernandez, A., and Romo, R. (2000). "Motor and non-motor roles of the cortico-basal ganglia circuitry," in Brain Dynamics and the Striatal Complex, eds R. Miller and J. Wickens (Amsterdam: Harwood Acad.), 237-255.
52. Samejima, K., Ueda, Y., Doya, K., and Kimura, M. (2005). Representation of action-specific reward values in the striatum. Science 310, 1337-13340.
53. Schall, J. D. (2003). Neural correlates of decision processes: neural and mental chronometry. Curr. Opin. Neurobiol. 13, 182-186.
54. Seideman, E., Zohary, E., and Newsome, W. T. (1998). Temporal gating of neu-ral signals during performance on a visual discrimination task. Nature 394, 72-75.
55. Shadmehr, R., Orban de Xivry, J.-J., Xu-Wilson, M., and Shih, T.-Y. (2010). Temporal discounting of reward and the cost of time in motor control. J. Neurosci. 30, 10507-10516.
56. Shidara, M., Aigner, T. G., and Richmond, B. J. (1998). Neuronal signals in the monkey ventral striatum related to progress through a predictable series of trials. J. Neurosci. 18, 2613-2625.
57. Simmons, J. M., and Richmond, B. J. (2008). Dynamic changes in repre-sentations of preceding and upcom-ing reward in monkey orbitofrontal cortex. Cereb. Cortex 18, 93-103.
58. Staddon, J. E. R. (2001). Adaptive Dynamics: The Theoretical Analysis of Behavior. Cambridge, MA: MIT/Bradford.
59. Stanford, T. R., Shankar, S., Massoglia, D. P., Costello, G. M., and Salinas, E. (2010). Perceptual decision mak-ing in less than 30 milliseconds. Nat. Neurosci. 13, 379-85.
60. Sugrue, L. P., Corrado, G. S., and Newsome, W. T. (2004). Matching behavior and the representation of value in the parietal cortex. Science 304, 1782-1787.
61. Tsujimoto, S., Genovesio, A., and Wise, S. P. (2010). Evaluating self-generated decisions in frontal pole cortex of monkeys. Nat. Neurosci. 13, 120-126.
62. Turner, R. S., and Anderson, M. E. (1997). Pallidal discharge related to the kin-ematics of reaching movements in two dimensions. J. Neurophysiol. 77, 1051-1074.
63. Turner, R. S., and Desmurget, M. (2010). Basal ganglia contributions to motor control: a vigorous tutor. Curr. Opin. Neurobiol. 20, 704-716.
64. Van der Meer, A., and Redish, D. A. (2009). Covert expectation-of-reward in rat ventral striatum at decision points. Front. Integr. Neurosci. 3:1. doi: 10.3389/neuro.07.001.2009
65. Wittmann, B. C., Daw, N. D., Seymour, B., and Dolan, R. J. (2008). Striatal activ-ity underlies novelty-based choice in humans. Neuron, 58, 967-973.