The role of striatal tonically active neurons in reward prediction error signaling during instrumental task performance

Journal of Neuroscience

Volumn 31, Issue 4, 2011, Pages 1507-1515

  Apicella, Paul ^a   Ravel, Sabrina ^a   Deffains, Marc ^a   Legallet, Eric ^a  

^a AIX MARSEILLE UNIVERSITY   (France)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMAL EXPERIMENT; ARTICLE; BEHAVIOR; CONTROLLED STUDY; CORPUS STRIATUM; ERROR; EXPERIMENTAL MONKEY; INSTRUMENTAL CONDITIONING; LEARNING; MALE; MENTAL TASK; MOVEMENT (PHYSIOLOGY); NERVE CELL; NONHUMAN; PREDICTION; PRIORITY JOURNAL; PROBABILITY; PUTAMEN; REWARD; STIMULUS RESPONSE; TASK PERFORMANCE; TONICALLY ACTIVE NEURON;

ANIMALS; ASSOCIATION LEARNING; CONDITIONING, CLASSICAL; CONDITIONING, OPERANT; MACACA FASCICULARIS; MALE; NEURONS; PROBABILITY; PSYCHOMOTOR PERFORMANCE; PUTAMEN; REWARD;

EID: 79251585919     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.4880-10.2011     Document Type: Article

References (42)

1. Aosaki T, Tsubokawa H, Ishida A, Watanabe K, Graybiel AM, Kimura M (1994) Responses of tonically active neurons in the primate's striatum undergo systematic changes during behavioral sensorimotor conditioning. J Neurosci 14:3969-3984. (Pubitemid 24174138)
2. Aosaki T, Kimura M, Graybiel AM (1995) Temporal and spatial characteristics of tonically active neurons of the primate's striatum. J Neurophysiol 73:1234-1252.
3. Apicella P (2007) Leading tonically active neurons of the striatum from reward detection to context recognition. Trends Neurosci 30:299-306.
4. Apicella P, Legallet E, Trouche E (1997) Responses of tonically discharging neurons in the monkey striatum to primary rewards delivered during different behavioral states. Exp Brain Res 116:456-466.
5. Apicella P, Deffains M, Ravel S, Legallet E (2009) Tonically active neurons in the striatum differentiate between delivery and omission of expected reward in a probabilistic task context. Eur J Neurosci 30:515-526.
6. Bennett BD, Wilson CJ (1998) Synaptic regulation of action potential timing in neostriatal cholinergic interneurons. J Neurosci 18:8539-8549.
7. Bjork JM, Hommer DW (2007) Anticipating instrumentally obtained and passively-received rewards: a factorial fMRI investigation. Behav Brain Res 177:165-170.
8. Daw ND, Doya K (2006) The computational neurobiology of learning and reward. Curr Opin Neurobiol 16:199-204.
9. Dayan P, Balleine BW (2002) Reward, motivation, and reinforcement learning. Neuron 36:285-298.
10. Deng P, Zhang Y, Xu ZC (2007) Involvement of I(h) in dopamine modulation of tonic firing in striatal cholinergic interneurons. J Neurosci 27:3148-3156.
11. Ding JB, Guzman JN, Peterson JD, Goldberg JA, Surmeier DJ (2010) Thalamic gating of corticostriatal signaling by cholinergic interneurons. Neuron 67:294-307.
12. Elliott R, Newman JL, Longe OA, Deakin JF (2003) Differential response patterns in the striatum and orbitofrontal cortex to financial reward in humans: a parametric functional magnetic resonance imaging study. J Neurosci 23:303-307. (Pubitemid 36050431)
13. Haruno M, Kawato M (2006) Different neural correlates of reward expectation and reward expectation error in the putamen and caudate nucleus during stimulus-action-reward association learning. J Neurophysiol 95:948-959.
14. Joshua M, Adler A, Mitelman R, Vaadia E, Bergman H (2008) Midbrain dopaminergic neurons and striatal cholinergic interneurons encode the difference between reward and aversive events at different epochs of probabilistic classical conditioning trials. J Neurosci 28:11673-11684.
15. Knutson B, Westdorp A, Kaiser E, Hommer D (2000) fMRI visualization of brain activity during a monetary incentive delay task. Neuroimage 12:20-27.
16. Lapper SR, Bolam JP (1992) Input from the frontal cortex and the parafascicular nucleus to cholinergic interneurons in the dorsal striatum of the rat. Neuroscience 51:533-545.
17. Matsumoto N, Minamimoto T, Graybiel AM, Kimura M (2001) Neurons in the thalamic CM-Pf complex supply striatal neuons with information about behaviorally significant sensory events. J Neurophysiol 85:960-976. (Pubitemid 32147793)
18. McClure SM, Berns GS, Montague PR (2003) Temporal prediction errors in a passive learning task activate human striatum. Neuron 38:339-346.
19. Minamimoto T, Kimura M (2002) Participation of the thalamic CM-Pf complex in attentional orienting. J Neurophysiol 87:3090-3101.
20. Montague PR, Berns GS (2002) Neural economics and the biological substrates of valuation. Neuron 36:265-284.
21. Morris G, Arkadir D, Nevet A, Vaadia E, Bergman H (2004) Coincident but distinct messages of midbrain dopamine and striatal tonically active neurons. Neuron 43:133-143.
22. Nanda B, Galvan A, Smith Y, Wichmann T (2009) Effects of stimulation of the centromedian nucleus of the thalamus on the activity of striatal cells in awake rhesus monkeys. Eur J Neurosci 29:588-598.
23. Niv Y, Schoenbaum G (2008) Dialogues on prediction errors. Trends Cogn Sci 12:265-272.
24. O'Doherty JP (2004) Reward representations and reward-related learning in the human brain: insights from neuroimaging. Curr Opin Neurobiol 14:769-776.
25. O'Doherty JP, Dayan P, Friston K, Critchley H, Dolan RJ (2003) Temporal difference models and reward-related learning in the human brain. Neuron 38:329-337.
26. O'Doherty J, Dayan P, Schultz J, Deichmann R, Friston K, Dolan RJ (2004) Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science 304:452-454. (Pubitemid 38495943)
27. Oyama K, Hernádi I, Iijima T, Tsutsui K (2010) Reward prediction error coding in dorsal striatal neurons. J Neurosci 30:11447-11457.
28. Pagnoni G, Zink CF, Montague PR, Berns GS (2002) Activity in human ventral striatum locked to errors of reward prediction. Nat Neurosci 5:97-98.
29. Pasquereau B, Nadjar A, Arkadir D, Bezard E, Goillandeau M, Bioulac B, Gross CE, Boraud T (2007) Shaping of motor responses by incentive values through the basal ganglia. J Neurosci 27:1176-1183.
30. Ravel S, Sardo P, Legallet E, Apicella P (2001) Reward unpredictability inside and outside of a task context as a determinant of the responses of tonically active neurons in the monkey striatum. J Neurosci 21:5730-5739.
31. Reynolds JN, Hyland BI, Wickens JR (2004) Modulation of an afterhyperpolarization by the substantia nigra induces pauses in the tonic firing of striatal cholinergic interneurons. J Neurosci 24:9870-9877.
32. Roesch MR, Calu DJ, Esber GR, Schoenbaum G (2010) All that glitters: dissociating attention and outcome-expectancy from prediction errors signals. J Neurophysiol 104:587-595.
33. Samejima K, Ueda Y, Doya K, Kimura M (2005) Representation of actionspecific reward values in the striatum. Science 310:1337-1340.
34. Sardo P, Ravel S, Legallet E, Apicella P (2000) Influence of the predicted time of stimuli eliciting movements on responses of tonically active neurons in the monkey striatum. Eur J Neurosci 12:1801-1816. (Pubitemid 30258888)
35. Schönberg T, Daw ND, Joel D, O'Doherty JP (2007) Reinforcement learning signals in the human striatum distinguish learners from nonlearners during reward-based decision making. J Neurosci 27:12860-12867.
36. Schultz W (2002) Getting formal with dopamine and reward. Neuron 36:241-263.
37. Schultz W, Dickinson A (2000) Neuronal coding of prediction errors. Annu Rev Neurosci 23:473-500.
38. Schultz W, Dayan P, Montague PR (1997) A neural substrate of prediction and reward. Science 275:1593-1599.
39. Sidibé M, Smith Y (1999) Thalamic inputs to striatal interneurons in monkeys: synaptic organization and co-localization of calcium binding proteins. Neuroscience 89:1189-1208.
40. Suzuki T, Miura M, Nishimura K, Aosaki T (2001) Dopamine-dependent synaptic plasticity in the striatal cholinergic interneurons. J Neurosci 21:6492-6501. (Pubitemid 32781093)
41. Tricomi EM, Delgado MR, Fiez JA (2004) Modulation of caudate activity by action contingency. Neuron 41:281-292.
42. Yamada H, Matsumoto N, Kimura M (2004) Tonically active neurons in the primate caudate nucleus and putamen differentially encode instructed motivational outcomes of action. J Neurosci 24:3500-3510.