Distinct tonic and phasic anticipatory activity in lateral habenula and dopamine neurons

Neuron

Volumn 67, Issue 1, 2010, Pages 144-155

  Bromberg Martin, Ethan S ^a   Matsumoto, Masayuki ^a,b   Hikosaka, Okihide ^a  

^a NATIONAL EYE INSTITUTE   (United States)

^b KYOTO UNIVERSITY   (Japan)

Author keywords

Sysneuro

Indexed keywords

ANIMAL BEHAVIOR; ANIMAL EXPERIMENT; ARTICLE; BRAIN NERVE CELL; CELL ACTIVITY; DOPAMINERGIC NERVE CELL; HABENULA; MENTAL TASK; MOTIVATION; NEUROTRANSMISSION; NONHUMAN; PRIORITY JOURNAL; PUNISHMENT; REWARD;

ACTION POTENTIALS; ANIMALS; BEHAVIOR, ANIMAL; CONDITIONING, CLASSICAL; CONDITIONING, OPERANT; DOPAMINE; HABENULA; MACACA MULATTA; MOTIVATION; NEURAL PATHWAYS; NEURONS; PUNISHMENT; REWARD; STATISTICS AS TOPIC; TIME FACTORS;

EID: 77954484934     PISSN: 08966273     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neuron.2010.06.016     Document Type: Article

References (54)

1. Anderson A.K., Christoff K., Stappen I., Panitz D., Ghahremani D.G., Glover G., Gabrieli J.D.E., Sobel N. Dissociated neural representations of intensity and valence in human olfaction. Nat. Neurosci. 2003, 6:196-202.
2. Badia P., Harsh J., Abbott B. Choosing between predictable and unpredictable shock conditions: data and theory. Psychol. Bull. 1979, 86:1107-1131.
3. Balci F., Freestone D., Gallistel C.R. Risk assessment in man and mouse. Proc. Natl. Acad. Sci. USA 2009, 106:2459-2463.
4. Berridge K.C., Robinson T.E. What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?. Brain Res. 1998, 28:309-369.
5. Bromberg-Martin E.S., Hikosaka O. Midbrain dopamine neurons signal preference for advance information about upcoming rewards. Neuron 2009, 63:119-126.
6. Buhusi C.V., Meck W.H. What makes us tick? Functional and neural mechanisms of interval timing. Nat. Rev. Neurosci. 2006, 6:755-765.
7. Christoph G.R., Leonzio R.J., Wilcox K.S. Stimulation of the lateral habenula inhibits dopamine-containing neurons in the substantia nigra and ventral tegmental area of the rat. J. Neurosci. 1986, 6:613-619.
8. Day J.J., Roitman M.F., Wightman R.M., Carelli R.M. Associative learning mediates dynamic shifts in dopamine signaling in the nucleus accumbens. Nat. Neurosci. 2007, 10:1020-1028.
9. Fiorillo C.D., Tobler P.N., Schultz W. Discrete coding of reward probability and uncertainty by dopamine neurons. Science 2003, 299:1898-1902.
10. Fiorillo C.D., Newsome W.T., Schultz W. The temporal precision of reward prediction in dopamine neurons. Nat. Neurosci. 2008, 11:966-973.
11. Frank M.J., Doll B.B., Oas-Terpstra J., Moreno F. Prefrontal and striatal dopaminergic genes predict individual differences in exploration and exploitation. Nat. Neurosci. 2009, 12:1062-1068.
12. Goto Y., Otani S., Grace A.A. The Yin and Yang of dopamine release: a new perspective. Neuropharmacology 2007, 53:583-587.
13. Grace A.A. Phasic versus tonic dopamine release and the modulation of dopamine system responsivity: a hypothesis for the etiology of schizophrenia. Neuroscience 1991, 41:1-24.
14. Han J.S., McMahan R.W., Holland P., Gallagher M. The role of an amygdalo-nigrostriatal pathway in associative learning. J. Neurosci. 1997, 17:3913-3919.
15. Hayhoe M., Ballard D. Eye movements in natural behavior. Trends Cogn. Sci. 2005, 9:188-194.
16. Hollerman J.R., Schultz W. Dopamine neurons report an error in the temporal prediction of reward during learning. Nat. Neurosci. 1998, 1:304-309.
17. Hong S., Hikosaka O. The globus pallidus sends reward-related signals to the lateral habenula. Neuron 2008, 60:720-729.
18. Horvitz J.C. Mesolimbocortical and nigrostriatal dopamine responses to salient non-reward events. Neuroscience 2000, 96:651-656.
19. Jensen J., Smith A.J., Willeit M., Crawley A.P., Mikulis D.J., Vitcu I., Kapur S. Separate brain regions code for salience vs. valence during reward prediction in humans. Hum. Brain Mapp. 2007, 28:294-302.
20. Ji H., Shepard P.D. Lateral habenula stimulation inhibits rat midbrain dopamine neurons through a GABA(A) receptor-mediated mechanism. J. Neurosci. 2007, 27:6923-6930.
21. Joshua M., Adler A., Mitelman R., Vaadia E., Bergman H. Midbrain dopaminergic neurons and striatal cholinergic interneurons encode the difference between reward and aversive events at different epochs of probabilistic classical conditioning trials. J. Neurosci. 2008, 28:11673-11684.
22. Joshua M., Adler A., Bergman H. The dynamics of dopamine in control of motor behavior. Curr. Opin. Neurobiol. 2009, 19:615-620.
23. Lang P.J., Davis M. Emotion, motivation, and the brain: reflex foundations in animal and human research. Prog. Brain Res. 2006, 156:3-29.
24. Lecourtier L., Kelly P.H. A conductor hidden in the orchestra? Role of the habenular complex in monoamine transmission and cognition. Neurosci. Biobehav. Rev. 2007, 31:658-672.
25. Lin S.-C., Nicolelis M.A. Neuronal ensemble bursting in the basal forebrain encodes salience irrespective of valence. Neuron 2008, 59:138-149.
26. Litt A., Plassmann H., Shiv B., Rangel A. Dissociating valuation and saliency signals during decision-making. Cereb. Cortex 2010, in press. Published online May 5, 2010. 10.1093/cercor/bhq065.
27. Macdougall J.M., Van Hoesen G.W., Mitchell J.C. Anatomical organization of septal projections in maintenance of DRL behavior in rats. J. Comp. Physiol. Psychol. 1969, 68:568-575.
28. Matsumoto M., Hikosaka O. Lateral habenula as a source of negative reward signals in dopamine neurons. Nature 2007, 447:1111-1115.
29. Matsumoto M., Hikosaka O. Representation of negative motivational value in the primate lateral habenula. Nat. Neurosci. 2009, 12:77-84.
30. Matsumoto M., Hikosaka O. Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature 2009, 459:837-841.
31. Miller S.M. Monitoring and blunting: validation of a questionnaire to assess styles of information seeking under threat. J. Pers. Soc. Psychol. 1987, 52:345-353.
32. Mirenowicz J., Schultz W. Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli. Nature 1996, 379:449-451.
33. Morris G., Arkadir D., Nevet A., Vaadia E., Bergman H. Coincident but distinct messages of midbrain dopamine and striatal tonically active neurons. Neuron 2004, 43:133-143.
34. Nakahara H., Itoh H., Kawagoe R., Takikawa Y., Hikosaka O. Dopamine neurons can represent context-dependent prediction error. Neuron 2004, 41:269-280.
35. Niv Y., Duff M.O., Dayan P. Dopamine, uncertainty and TD learning. Behav. Brain Funct. 2005, 1:6.
36. Niv Y., Daw N.D., Joel D., Dayan P. Tonic dopamine: opportunity costs and the control of response vigor. Psychopharmacology (Berl.) 2007, 191:507-520.
37. Peck C.J., Jangraw D.C., Suzuki M., Efem R., Gottlieb J. Reward modulates attention independently of action value in posterior parietal cortex. J. Neurosci. 2009, 29:11182-11191.
38. Redgrave P., Gurney K. The short-latency dopamine signal: a role in discovering novel actions?. Nat. Rev. Neurosci. 2006, 7:967-975.
39. Redgrave P., Prescott T.J., Gurney K. Is the short-latency dopamine response too short to signal reward error?. Trends Neurosci. 1999, 12:146-151.
40. Roitman M.F., Wheeler R.A., Wightman R.M., Carelli R.M. Real-time chemical responses in the nucleus accumbens differentiate rewarding and aversive stimuli. Nat. Neurosci. 2008, 11:1376-1377.
41. Romo R., Schultz W. Dopamine neurons of the monkey midbrain: contingencies of responses to active touch during self-initiated arm movements. J. Neurophysiol. 1990, 63:592-606.
42. Salamone J.D., Correa M., Farrar A., Mingote S.M. Effort-related functions of nucleus accumbens dopamine and associated forebrain circuits. Psychopharmacology (Berl.) 2007, 191:461-482.
43. Satoh T., Nakai S., Sato T., Kimura M. Correlated coding of motivation and outcome of decision by dopamine neurons. J. Neurosci. 2003, 23:9913-9923.
44. Schultz W. Predictive reward signal of dopamine neurons. J. Neurophysiol. 1998, 80:1-27.
45. Schultz W. Multiple dopamine functions at different time courses. Annu. Rev. Neurosci. 2007, 30:259-288.
46. Schultz W., Romo R. Dopamine neurons of the monkey midbrain: contingencies of responses to stimuli eliciting immediate behavioral reactions. J. Neurophysiol. 1990, 63:607-624.
47. Schultz W., Dayan P., Montague P.R. A neural substrate of prediction and reward. Science 1997, 275:1593-1599.
48. Small D.M., Gregory M.D., Mak Y.E., Gitelman D., Mesulam M.M., Parrish T. Dissociation of neural representation of intensity and affective valuation in human gustation. Neuron 2003, 39:701-711.
49. Takikawa Y., Kawagoe R., Hikosaka O. A possible role of midbrain dopamine neurons in short- and long-term adaptation of saccades to position-reward mapping. J. Neurophysiol. 2004, 92:2520-2529.
50. Thornton E.W., Evans J.A. The effects of lesions of the habenula nucleus on lever press behaviour during a tandem operant schedule with contrasting response requirements. Behav. Brain Res. 1984, 12:327-334.
51. Thornton E.W., Bradbury G.E., Wickens A.P., Mottram D.R., McClelland R. Intra-habenular injection of 6-hydroxydopamine produces impaired acquisition of DRL operant behavior. Behav. Neural Biol. 1990, 53:291-297.
52. Van Damme S., Crombez G., Hermans D., Koster E.H., Eccleston C. The role of extinction and reinstatement in attentional bias to threat: a conditioning approach. Behav. Res. Ther. 2006, 44:1555-1563.
53. Waelti P., Dickinson A., Schultz W. Dopamine responses comply with basic assumptions of formal learning theory. Nature 2001, 412:43-48.
54. Wise R.A. Dopamine, learning and motivation. Nat. Rev. Neurosci. 2004, 5:483-494.