Adaptive coding of reward value by dopamine neurons

Science

Volumn 307, Issue 5715, 2005, Pages 1642-1645

  Tobler, Philippe N ^b   Fiorillo, Christopher D ^a   Schultz, Wolfram ^b  

^a STANFORD UNIVERSITY   (United States)

^b NONE

Author keywords

[No Author keywords available]

Indexed keywords

BIODIVERSITY; BRAIN; DOPING (ADDITIVES); INFORMATION ANALYSIS; RESOURCE ALLOCATION; SENSITIVITY ANALYSIS;

ADAPTIVE CODING; ANIMALS; DOPAMINE NEURONS; REWARD SENSITIVITY;

NEUROLOGY;

BEHAVIORAL RESPONSE; NEUROLOGY;

ANIMAL BEHAVIOR; ANIMAL CELL; ARTICLE; CELL FUNCTION; CONTROLLED STUDY; DOPAMINERGIC NERVE CELL; MESENCEPHALON; NONHUMAN; PRIORITY JOURNAL; REWARD;

ADAPTATION, PHYSIOLOGICAL; ANIMALS; DISCRIMINATION (PSYCHOLOGY); DOPAMINE; ELECTROPHYSIOLOGY; FEMALE; LEARNING; MACACA FASCICULARIS; MESENCEPHALON; NEURONS; PHOTIC STIMULATION; PROBABILITY; REWARD;

ANIMALIA;

EID: 14844349975     PISSN: 00368075     EISSN: None     Source Type: Journal    
DOI: 10.1126/science.1105370     Document Type: Article

References (29)

1. I. P. Pavlov, Conditional Reflexes (Oxford Univ. Press, Oxford, 1927).
2. E. L. Thorndike, Animal Intelligence: Experimental Studies (Macmillan, New York, 1911).
3. R. A. Rescorla, A. R. Wagner, in Classical Conditioning II: Current Research and Theory, A. Black, W. F. Prokasy, Eds. (Appleton-Century-Crofts, New York, 1972), pp. 64-99.
4. H. C. Fibiger, A. G. Phillips, in The Nervous System, vol. 4 of Handbook of Physiology, F. E. Bloom, Ed. (Williams & Wilkins, Baltimore, MD, 1986), pp. 647-675.
5. R. A. Wise, D. C. Hoffman, Synapse 10, 247 (1992).
6. T. E. Robinson, K. C. Berridge, Brain Res. Rev. 18, 247 (1993).
7. T. W. Robbins, B. J. Everitt, Curr. Opin. Neurobiol. 6, 228 (1996).
8. P. Waelti, A. Dickinson, W. Schultz, Nature 412, 43 (2001).
9. T. Satoh, S. Nakai, T. Sato, M. Kimura, J. Neurosci. 23, 9913 (2003).
10. C. D. Fiorillo, P. N. Tobler, W. Schultz, Science 299, 1898 (2003).
11. R. Kawagoe, Y. Takikawa, O. Hikosaka, J. Neurophysiol. 91, 1013 (2004).
12. Materials and methods are available as supporting material on Science Online.
13. No significant correlations were found between neuronal position in areas A8, A9, and A10 and the different types of responses in all the experiments reported; thus, the data were pooled.
14. A. Arnauld, P. Nicole, La logique, ou, L'art de penser (Librairie philosophique J. Vrin, Paris, 1981/ 1662).
15. P. W. Glimcher, Decisions, Uncertainty and the Brain (MIT Press, Cambridge, MA, 2003).
16. P. Shizgal, Curr. Opin. Neurobiol. 7, 198 (1997).
17. M. I. Leon, C. R. Gallistel, J. Exp. Psychol. Anim. Behav. Process. 24, 265 (1998).
18. All trials were separated by an average intertrial interval of 9 s, consisting of a fixed 4 s plus an interval drawn from a truncated Poisson-like distribution with a mean of 5 s. Thus, the probability that a trial would begin at any given moment was low.
19. H. Nakahara, H. Itoh, R. Kawagoe, Y. Takikawa, O. Hikosaka, Neuron 41, 269 (2004).
20. M. V. Srinivasan, S. B. Laughlin, A. Dubs, Proc. R. Soc. London Ser. B. 216, 427 (1982).
21. N. Brenner, W. Bialek, R. R. de Ruyter van Steveninck, Neuron 26, 695 (2000).
22. A. L. Fairhall, G. D. Lewen, W. Bialek, R. R. de Ruyter van Steveninck, Nature 412, 787 (2001).
23. W. Schultz, J. Neurophysiol. 80, 1 (1998).
24. W. Schultz, P. Dayan, R. R. Montague, Science 275, 1593 (1997).
25. H. B. Barlow, in Sensory Communication, W. A. Rosenblith, Ed. (MIT Press, Cambridge, MA, 1961), pp. 217-234.
26. S. B. Laughlin, Z. Naturforsch. Teil C Biochem. Biophys. Biol. Virol. 36, 910 (1981).
27. I. Ohzawa, G. Sclar, R. D. Freeman, Nature 298, 266 (1982).
28. S. M. Smirnakis, M. J. Berry, D. K. Warland, W. Bialek, M. Meister, Nature 386, 69 (1997).
29. We thank K. I. Tsutsui, I. Hernadi, A. Dickinson, and S. B. Laughlin for helpful comments. Supported by the Wellcome Trust, Swiss National Science Foundation (W.S. and P.N.T.), Roche Research Foundation (P.N.T.), Janggen-Poehn Foundation (P.N.T.), and Human Frontiers Science Program (C.D.F.).