Predictable and Unpredictable Rewards Produce Similar Changes in Dopamine Tone

Behavioral Neuroscience

Volumn 121, Issue 5, 2007, Pages 887-895

  Hernandez, Giovanni ^a   Haines, Eric ^a   Rajabi, Heshmat ^a   Stewart, Jane ^a   Arvanitogiannis, Andreas ^a   Shizgal, Peter ^a  

^a and Applied Physiology   (Canada)

Author keywords

brain stimulation reward; in vivo microdialysis; medial forebrain bundle; self stimulation

Indexed keywords

3,4 DIHYDROXYPHENYLACETIC ACID; DOPAMINE; HOMOVANILLIC ACID;

ANIMAL BEHAVIOR; ANIMAL EXPERIMENT; ANIMAL TISSUE; ARTICLE; DOPAMINE RELEASE; DOPAMINERGIC SYSTEM; ELECTRODE; ELECTROSTIMULATION; FOREBRAIN; HISTOLOGY; INSTRUMENTAL CONDITIONING; MALE; MICRODIALYSIS; NONHUMAN; NUCLEUS ACCUMBENS; PREDICTION; RAT; REWARD; SELF STIMULATION;

3,4-DIHYDROXYPHENYLACETIC ACID; ANIMALS; BRAIN; CONDITIONING, OPERANT; DOPAMINE; ELECTRIC STIMULATION; ELECTRODES; HOMOVANILLIC ACID; MALE; MEDIAL FOREBRAIN BUNDLE; MICRODIALYSIS; NUCLEUS ACCUMBENS; RATS; RATS, LONG-EVANS; REINFORCEMENT SCHEDULE; REWARD; SELF STIMULATION; SIGNAL TRANSDUCTION;

EID: 35748949308     PISSN: 07357044     EISSN: None     Source Type: Journal    
DOI: 10.1037/0735-7044.121.5.887     Document Type: Article

References (39)

1. Blackburn J.R., Pfaus J.G., and Phillips A.G. Dopamine functions in appetitive and defensive behaviours. Progress in Neurobiology 39 (1992) 247-279
2. Blaha C.D., and Phillips A.G. A critical assessment of electrochemical procedures applied to the measurement of dopamine and its metabolites during drug-induced and species-typical behaviours. Behavioural Pharmacology 7 (1996) 675-708
3. Cagniard B., Beeler J.A., Britt J.P., McGehee D.S., Marinelli M., and Zhuang X. Dopamine scales performance in the absence of new learning. Neuron 51 (2006) 541-547
4. Carlsson A. A half-century of neurotransmitter research: Impact on neurology and psychiatry. In: Jörnvall H. (Ed). Nobel lectures, physiology or medicine 1996-2000 (2003), World Scientific, Singapore 303-324
5. Cheer, J. F., Heien, M. L. A. V., Garris, P. A., Carelli, R. M., & Wightman, R. M. (2005). Simultaneous dopamine and single-unit recordings reveal accumbens GABAergic responses: Implications for intracranial self-stimulation. Proceedings of the National Academy of Sciences, USA, 102, 19150-19155.
6. Conover K., and Shizgal P. Employing labor-supply theory to measure the reward value of electrical brain stimulation. Games and Economic Behavior 52 (2005) 283-304
7. Field A. Discovering statistics with SPSS. 2nd ed. (2005), Sage, London
8. Fiorillo, C. D., & Newsome, W. T. (2006, October 18). Activation of midbrain dopamine neurons by brain stimulation reward in mediodorsal thalamus. Paper presented at the 36th Annual Meeting of the Society for Neuroscience, Atlanta, GA.
9. Floresco S.B., West A.R., Ash B., Moore H., and Grace A.A. Afferent modulation of dopamine neuron firing differentially regulates tonic and phasic dopamine transmission. Nature Neuroscience 6 (2003) 968-973
10. Garris P.A., Collins L.B., Jones S.R., and Wightman R.M. Evoked extracellular dopamine in vivo in the medial prefrontal cortex. Journal of Neurochemistry 61 (1993) 637-647
11. Garris P.A., Kilpatrick M., Bunin M.A., Michael D., Walker Q.D., and Wightman R.M. Dissociation of dopamine release in the nucleus accumbens from intracranial self-stimulation. Nature 398 (1999, March 4) 67-69
12. Hernandez G., Hamdani S., Rajabi H., Conover K., Stewart J., Arvanitogiannis A., et al. Prolonged rewarding stimulation of the rat medial forebrain bundle: Neurochemical and behavioral consequences. Behavioral Neuroscience 120 (2006) 888-904
13. Hornykiewicz O. Dopamine miracle: From brain homogenate to dopamine replacement. Movement Disorders 17 (2002) 501-508
14. Kilpatrick M.R., Rooney M.B., Michael D.J., and Wightman R.M. Extracellular dopamine dynamics in rat caudate-putamen during experimenter-delivered and intracranial self-stimulation. Neuroscience 96 (2000) 697-706
15. Ljungberg T., Apicella P., and Schultz W. Responses of monkey dopamine neurons during learning of behavioral reactions. Journal of Neurophysiology 67 (1992) 145-163
16. Mirenowicz J., and Schultz W. Importance of unpredictability for reward responses in primate dopamine neurons. Journal of Neurophysiology 72 (1994) 1024-1027
17. Montague P.R., Dayan P., and Sejnowski T.J. A framework for mesencephalic dopamine systems based on predictive Hebbian learning. Journal of Neuroscience 16 (1996) 1936-1947
18. Mundl W.J. A constant-current stimulator. Physiology & Behavior 24 (1980) 991-993
19. Niv Y., Daw N., and Dayan P. How fast to work: Response vigor, motivation and tonic dopamine. In: Weiss Y., Schölkopf B., and Platt J. (Eds). Advances in neural information processing systems 18 (2006), MIT Press, Cambridge, MA 1019-1026
20. Paxinos G., and Watson C. The rat brain in stereotaxic coordinates. 4th ed. (1998), Academic Press, San Diego, CA
21. Phillips P.E., Stuber G.D., Heien M.L., Wightman R.M., and Carelli R.M. Subsecond dopamine release promotes cocaine seeking. Nature 422 (2003, April 10) 614-618
22. Reynolds J.N., Hyland B.I., and Wickens J.R. A cellular mechanism of reward-related learning. Nature 413 (2001, September 6) 67-70
23. Robinson S., Sandstrom S.M., Denenberg V.H., and Palmiter R.D. Distinguishing whether dopamine regulates liking, wanting, and/or learning about rewards. Behavioral Neuroscience 119 (2005) 5-15
24. Roitman M.F., Stuber G.D., Phillips P.E., Wightman R.M., and Carelli R.M. Dopamine operates as a subsecond modulator of food seeking. Journal of Neuroscience 24 (2004) 1265-1271
25. Romo R., and Schultz W. Dopamine neurons of the monkey midbrain: Contingencies of responses to active touch during self-initiated arm movements. Journal of Neurophysiology 63 (1990) 592-606
26. Salamone J.D. Functional significance of nucleus accumbens dopamine: Behavior, pharmacology and neurochemistry. Behavioural Brain Research 137 (2002) 1
27. Salamone J.D., Correa M., Mingote S., and Weber S.M. Nucleus accumbens dopamine and the regulation of effort in food-seeking behavior: Implications for studies of natural motivation, psychiatry, and drug abuse. Journal of Pharmacology and Experimental Therapeutics 305 (2003) 1-8
28. Salamone J.D., Cousins M.S., and Snyder B.J. Behavioral functions of nucleus accumbens dopamine: Empirical and conceptual problems with the anhedonia hypothesis. Neuroscience & Biobehavioral Reviews 21 (1997) 341-359
29. Schultz W. Predictive reward signal of dopamine neurons. Journal of Neurophysiology 80 (1998) 1-27
30. Schultz W. Getting formal with dopamine and reward. Neuron 36 (2002) 241-263
31. Schultz W., Dayan P., and Montague P.R. A neural substrate of prediction and reward. Science 275 (1997, March 14) 1593-1599
32. Schultz W., and Romo R. Dopamine neurons of the monkey midbrain: Contingencies of responses to stimuli eliciting immediate behavioral reactions. Journal of Neurophysiology 63 (1990) 607-624
33. Sourkes T.L. How dopamine was recognised as a neurotransmitter: A personal view. Parkinsonism & Related Disorders 6 (2000) 63-67
34. Stefani M.R., and Moghaddam B. Rule learning and reward contingency are associated with dissociable patterns of dopamine activation in the rat prefrontal cortex, nucleus accumbens, and dorsal striatum. Journal of Neuroscience 26 (2006) 8810-8818
35. Stuber G.D., Roitman M.F., Phillips P.E., Carelli R.M., and Wightman R.M. Rapid dopamine signaling in the nucleus accumbens during contingent and noncontingent cocaine administration. Neuropsychopharmacology 30 (2005) 853-863
36. Tryon W.W. A simplified time-series analysis for evaluating treatment interventions. Journal of Applied Behavior Analysis 15 (1982) 423-429
37. West A.R., Floresco S.B., Charara A., Rosenkranz J.A., and Grace A.A. Electrophysiological interactions between striatal glutamatergic and dopaminergic systems. Annals of the New York Academy of Sciences 1003 (2003) 53-74
38. Wightman R.M., and Robinson D.L. Transient changes in mesolimbic dopamine and their association with 'reward.'. Journal of Neurochemistry 82 (2002) 721-735
39. Wise R.A., and Rompre P.P. Brain dopamine and reward. Annual Review of Psychology 40 (1989) 191-225