Midbrain dopaminergic neurons and striatal cholinergic interneurons encode the difference between reward and aversive events at different epochs of probabilistic classical conditioning trials

Journal of Neuroscience

Volumn 28, Issue 45, 2008, Pages 11673-11684

  Joshua, Mati ^a,b   Adler, Avital ^a,b   Mitelman, Rea ^a,b   Vaadia, Eilon ^a,b   Bergman, Hagai ^a,b  

^a HEBREW UNIVERSITY   (Israel)

^b HEBREW UNIVERSITY OF JERUSALEM   (Israel)

Author keywords

Basal ganglia; Primate; Reinforcement; Spike train; Striatum; Substantia nigra

Indexed keywords

ANIMAL BEHAVIOR; ANIMAL EXPERIMENT; ARTICLE; AVERSION; CHOLINERGIC NERVE CELL; CONDITIONING; CORPUS STRIATUM; DOPAMINERGIC NERVE CELL; FEMALE; INTERNEURON; MALE; MESENCEPHALON; MONKEY; NONHUMAN; PRIORITY JOURNAL; REINFORCEMENT; REWARD;

ACETYLCHOLINE; ACTION POTENTIALS; ALGORITHMS; ANIMALS; AVOIDANCE LEARNING; BEHAVIOR, ANIMAL; CONDITIONING, CLASSICAL; CORPUS STRIATUM; DOPAMINE; FEMALE; MACACA FASCICULARIS; MAGNETIC RESONANCE IMAGING; MESENCEPHALON; MOUTH; MOVEMENT; NEURONS; PROBABILITY; REWARD;

EID: 58149236469     PISSN: 02706474     EISSN: 02706474     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.3839-08.2008     Document Type: Article

References (46)

1. Aebischer P, Schultz W (1984) The activity of pars compacta neurons of the monkey substantia nigra is depressed by apomorphine. Neurosci Lett 50:25-29.
2. Arbuthnott GW, Wickens J (2007) Space, time and dopamine. Trends Neurosci 30:62-69.
3. Barbeau A (1962) The pathogenesis of Parkinson's disease: a new hypothesis. Can Med Assoc J 87:802-807.
4. Bar-Gad I, Bergman H (2001) Stepping out of the box: information processing in the neural networks of the basal ganglia. Curr Opin Neurobiol 11:689-695.
5. Bayer HM, Glimcher PW (2005) Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron 47:129-141.
6. Bayer HM, Lau B, Glimcher PW (2007) Statistics of midbrain dopamine neuron spike trains in the awake primate. J Neurophysiol 98:1428-1439.
7. Berntson GG, Bigger JT Jr, Eckberg DL, Grossman P, Kaufmann PG, Malik M, Nagaraja HN, Porges SW, Saul JP, Stone PH, van der Molen MW (1997) Heart rate variability: origins, methods, and interpretive caveats. Psychophysiology 34:623-648.
8. Calabresi P, Centonze D, Gubellini P, Pisani A, Bernardi G (2000) Acetylcholine-mediated modulation of striatal function. Trends Neurosci 23:120-126.
9. Coizet V, Dommett EJ, Redgrave P, Overton PG (2006) Nociceptive responses of midbrain dopaminergic neurones are modulated by the superior colliculus in the rat. Neuroscience 139:1479-1493.
10. Day JJ, Roitman MF, Wightman RM, Carelli RM (2007) Associative learning mediates dynamic shifts in dopamine signaling in the nucleus accumbens. Nat Neurosci 10:1020-1028.
11. Fiorillo CD, Tobler PN, Schultz W (2003) Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299:1898-1902.
12. Frank MJ, Seeberger LC, O'reilly RC (2004) By carrot or by stick: cognitive reinforcement learning in parkinsonism. Science 306:1940-1943.
13. Gourévitch B, Eggermont JJ (2007) A simple indicator of nonstationarity of firing rate in spike trains. J Neurosci Methods 163:181-187.
14. Graybiel AM, Aosaki T, Flaherty AW, Kimura M (1994) The basal ganglia and adaptive motor control. Science 265:1826-1831.
15. Guarraci FA, Kapp BS (1999) An electrophysiological characterization of ventral tegmental area dopaminergic neurons during differential pavlovian fear conditioning in the awake rabbit. Behav Brain Res 99:169-179.
16. Gurney K, Prescott TJ, Wickens JR, Redgrave P (2004) Computational models of the basal ganglia: from robots to membranes. Trends Neurosci 27:453-459.
17. Horvitz JC (2000) Mesolimbocortical and nigrostriatal dopamine responses to salient non-reward events. Neuroscience 96:651-656.
18. Joshua M, Elias S, Levine O, Bergman H (2007) Quantifying the isolation quality of extracellularly recorded action potentials. J Neurosci Methods 163:267-282.
19. Kakade S, Dayan P (2002) Dopamine: generalization and bonuses. Neural Netw 15:549-559.
20. Lau B, Glimcher PW (2007) Action and outcome encoding in the primate caudate nucleus. J Neurosci 27:14502-14514.
21. Lau B, Glimcher PW (2008) Value representations in the primate striatum during matching behavior. Neuron 58:451-463.
22. Lehmann J, Langer SZ (1983) The striatal cholinergic interneuron: synaptic target of dopaminergic terminals? Neuroscience 10:1105-1120.
23. Martin RF, Bowden DM (2000) Primate brain maps: structure of the macaque brain. Amsterdam: Elsevier Science.
24. Matsui T, Koyano KW, Koyama M, Nakahara K, Takeda M, Ohashi Y, Naya Y, Miyashita Y (2007) MRI-based localization of electrophysiological recording sites within the cerebral cortex at single-voxel accuracy. Nat Methods 4:161-168.
25. Matsumoto M, Hikosaka O (2007) Lateral habenula as a source of negative reward signals in dopamine neurons. Nature 447:1111-1115.
26. Matsumoto N, Minamimoto T, Graybiel AM, Kimura M (2001) Neurons in the thalamic CM-Pf complex supply striatal neurons with information about behaviorally significant sensory events. J Neurophysiol 85:960-976.
27. Mirenowicz J, Schultz W (1996) Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli. Nature 379:449-451.
28. Moran A, Bar-Gad I, Bergman H, Israel Z (2006) Real-time refinement of subthalamic nucleus targeting using Bayesian decision-making on the root mean square measure. Mov Disord 21:1425-1431.
29. Morris G, Arkadir D, Nevet A, Vaadia E, Bergman H (2004) Coincident but distinct messages of midbrain dopamine and striatal tonically active neurons. Neuron 43:133-143.
30. Ravel S, Richmond BJ (2006) Dopamine neuronal responses in monkeys performing visually cued reward schedules. Eur J Neurosci 24:277-290.
31. Ravel S, Legallet E, Apicella P (1999) Tonically active neurons in the monkey striatum do not preferentially respond to appetitive stimuli. Exp Brain Res 128:531-534.
32. Ravel S, Legallet E, Apicella P (2003) Responses of tonically active neurons in the monkey striatum discriminate between motivationally opposing stimuli. J Neurosci 23:8489-8497.
33. Redgrave P, Gurney K (2006) The short-latency dopamine signal: a role in discovering novel actions? Nat Rev Neurosci 7:967-975.
34. Reynolds JN, Hyland BI, Wickens JR (2001) A cellular mechanism of reward-related learning. Nature 413:67-70.
35. Schultz W (1998) Predictive reward signal of dopamine neurons. J Neurophysiol 80:1-27.
36. Schultz W, Apicella P, Ljungberg T (1993) Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task. J Neurosci 13:900-913.
37. Schultz W, Dayan P, Montague PR (1997) A neural substrate of prediction and reward. Science 275:1593-1599.
38. Shimo Y, Hikosaka O (2001) Role of tonically active neurons in primate caudate in reward-oriented saccadic eye movement. J Neurosci 21:7804-7814.
39. Stoof JC, Drukarch B, de Boer P, Westerink BH, Groenewegen HJ (1992) Regulation of the activity of striatal cholinergic neurons by dopamine. Neuroscience 47:755-770.
40. Sutton RS, Barto AG (1998) Reinforcement learning - an introduction. Cambridge, MA: MIT.
41. Szabo J, Cowan WM (1984) A stereotaxic atlas of the brain of the cynomolgus monkey (Macaca fascicularis). J Comp Neurol 222:265-300.
42. Tversky A, Kahneman D (1981) The framing of decisions and the psychology of choice. Science 211:453-458.
43. Ungless MA, Magill PJ, Bolam JP (2004) Uniform inhibition of dopamine neurons in the ventral tegmental area by aversive stimuli. Science 303:2040-2042.
44. Wang Z, Kai L, Day M, Ronesi J, Yin HH, Ding J, Tkatch T, Lovinger DM, Surmeier DJ (2006) Dopaminergic control of corticostriatal long-term synaptic depression in medium spiny neurons is mediated by cholinergic interneurons. Neuron 50:443-452.
45. Yamada H, Matsumoto N, Kimura M (2004) Tonically active neurons in the primate caudate nucleus and putamen differentially encode instructed motivational outcomes of action. J Neurosci 24:3500-3510.
46. Yamada H, Matsumoto N, Kimura M (2007) History- and current instruction-based coding of forthcoming behavioral outcomes in the striatum. J Neurophysiol 98:3557-3567.