Midbrain dopamine neurons: A retina of the reward system?

Neuroeconomics

Volumn , Issue , 2009, Pages 321-329

  Schultz, Wolfram ^a  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84866003856     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1016/B978-0-12-374176-9.00021-X     Document Type: Chapter

References (47)

1. Bayer H.M., Glimcher P.W. Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron 2005, 47:129-141.
2. Bayer H.M., Lau B., Glimcher P.W. Statistics of dopamine neuron spike trains in the awake primate. J. Neurophysiol. 2007, 98:1428-1439.
3. Bernoulli D. Specimen theoriae novae de mensura sortis. Comentarii Academiae Scientiarum Imperialis Petropolitanae. Papers Imp. Acad. Sci. St Petersburg 1738, 5:175-192. Translated as: (1954) Exposition of a new theory on the measurement of risk. Econometrica 22, 23-36.
4. Breiter H.C., Aharon I., Kahneman D., et al. Functional imaging of neural responses to expectancy and experience of monetary gains and losses. Neuron 2001, 30:619-639.
5. Cromwell H.C., Hassani O.K., Schultz W. Relative reward processing in primate striatum. Exp. Brain Res. 2005, 162:520-525.
6. Day J.J., Roitman M.F., Wightman R.M., Carelli R.M. Associative learning mediates dynamic shifts in dopamine signaling in the nucleus accumbens. Nat. Neurosci. 2007, 10:1020-1028.
7. Fiorillo C.D., Tobler P.N., Schultz W. Discrete coding of reward probability and uncertainty by dopamine neurons. Science 2003, 299:1898-1902.
8. Hassani O.K., Cromwell H.C., Schultz W. Influence of expectation of different rewards on behavior-related neuronal activity in the striatum. J. Neurophysiol. 2001, 85:2477-2489.
9. Hollerman J.R., Tremblay L., Schultz W. Influence of reward expectation on behavior-related neuronal activity in primate striatum. J. Neurophysiol. 1998, 80:947-963.
10. Horvitz J.C., Stewart T., Jacobs B.L. Burst activity of ventral tegmental dopamine neurons is elicited by sensory stimuli in the awake cat. Brain Res. 1997, 759:251-258.
11. Hosokawa T., Kato K., Inoue M., Mikami A. Neurons in the macaque orbitofrontal cortex code relative preference of both rewarding and aversive outcomes. Neurosci. Res. 2007, 57:434-445.
12. Kamin L.J. Selective association and conditioning. Fundamental Issues in Instrumental Learning 1969, 42-64. Dalhousie University Press, Dalhousie, NB. N.J. Mackintosh, W.K. Honig (Eds.).
13. Kawagoe R., Takikawa Y., Hikosaka O. Expectation of reward modulates cognitive signals in the basal ganglia. Nat. Neurosci. 1998, 1:411-416.
14. Levy H., Markowitz H.M. Approximating expected utility by a function of mean and variance. Am. Econ. Rev. 1979, 69:308-317.
15. Ljungberg T., Apicella P., Schultz W. Responses of monkey dopamine neurons during learning of behavioral reactions. J. Neurophysiol. 1992, 67:145-163.
16. Marr D. Vision 1982, Freeman, San Francisco, CA.
17. Mirenowicz J., Schultz W. Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli. Nature 1996, 379:449-451.
18. Montague P.R., Dayan P., Sejnowski T.J. A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J. Neurosci. 1996, 16:1936-1947.
19. Morris G., Arkadir D., Nevet A., et al. Coincident but distinct messages of midbrain dopamine and striatal tonically active neurons. Neuron 2004, 43:133-143.
20. Morris G., Nevet A., Arkadir D., et al. Midbrain dopamine neurons encode decisions for future action. Nat. Neurosci. 2006, 9:1057-1063.
21. Nakahara H., Itoh H., Kawagoe R., et al. Dopamine neurons can represent context-dependent prediction error. Neuron 2004, 41:269-280.
22. Nieuwenhuis S., Heslenfeld D.J., Alting van Geusau N., et al. Activity in human reward-sensitive brain areas is strongly context dependent. NeuroImage 2005, 25:1302-1309.
23. Padoa-Schioppa C., Assad J.A. Neurons in the orbitofrontal cortex encode economic value. Nature 2006, 441:223-226.
24. Padoa-Schioppa C., Assad J.A. The representation of economic value in the orbitofrontal cortex is invariant for changes of menu. Nat. Neurosci. 2008, 11:95-102.
25. Pan W.-X., Schmidt R., Wickens J.R., Hyland B.I. Dopamine cells respond to predicted events during classical conditioning: Evidence for eligibility traces in the reward-learning network. J. Neurosci. 2005, 25:6235-6242.
26. Platt M.L., Glimcher P.W. Neural correlates of decision variables in parietal cortex. Nature 1999, 400:233-238.
27. Preuschoff K., Bossaerts P. Adding prediction risk to the theory of reward learning. Ann. NY Acad. Sci. 2007, 1104:135-146.
28. Rao R.P.N., Ballard D.H. Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. Nat. Neurosci. 1999, 2:79-87.
29. Ravel S., Legallet E., Apicella P. Responses of tonically active neurons in the monkey striatum discriminate between motivationally opposing stimuli. J. Neurosci. 2003, 23:8489-8497.
30. Rescorla R.A., Wagner A.R. A theory of Pavlovian conditioning: variations in the effectiveness of reinforcement and nonreinforcement. Classical Conditioning II: Current Research and Theory 1972, 64-99. Appleton Century Crofts, New York, NY. A.H. Black, W.F. Prokasy (Eds.).
31. Roesch M.R., Calu D.J., Schoenbaum G. Dopamine neurons encode the better option in rats deciding between differently delayed or sized rewards. Nat. Neurosci. 2007, 10:1615-1624.
32. Samejima K., Ueda Y., Doya K., Kimura M. Representation of action-specific reward values in the striatum. Science 2005, 310:1337-1340.
33. Satoh T., Nakai S., Sato T., Kimura M. Correlated coding of motivation and outcome of decision by dopamine neurons. J. Neurosci. 2003, 23:9913-9923.
34. Schultz W. Multiple dopamine functions at different time courses. Ann. Rev. Neurosci. 2007, 30:259-288.
35. Schultz W., Romo R. Dopamine neurons of the monkey midbrain: contingencies of responses to stimuli eliciting immediate behavioral reactions. J. Neurophysiol. 1990, 63:607-624.
36. Schultz W., Dayan P., Montague R.R. A neural substrate of prediction and reward. Science 1997, 275:1593-1599.
37. Sugrue L.P., Corrado G.S., Newsome W.T. Matching behavior and the representation of value in the parietal cortex. Science 2004, 304:1782-1787.
38. Suri R., Schultz W. A neural network with dopamine-like reinforcement signal that learns a spatial delayed response task. Neuroscience 1999, 91:871-890.
39. Sutton R.S., Barto A.G. Toward a modern theory of adaptive networks: expectation and prediction. Psychol. Rev. 1981, 88:135-170.
40. Takikawa Y., Kawagoe R., Hikosaka O. A possible role of midbrain dopamine neurons in short- and long-term adaptation of saccades to position-reward maping. J. Neurophysiol. 2004, 92:2520-2529.
41. Thorpe S.J., Rolls E.T., Maddison S. The orbitofrontal cortex: neuronal activity in the behaving monkey. Exp. Brain Res. 1983, 49:93-115.
42. Tobler P.N., Dickinson A., Schultz W. Coding of predicted reward omission by dopamine neurons in a conditioned inhibition paradigm. J. Neurosci. 2003, 23:10402-10410.
43. Tobler P.N., Fiorillo C.D., Schultz W. Adaptive coding of reward value by dopamine neurons. Science 2005, 307:1642-1645.
44. Tremblay L., Schultz W. Relative reward preference in primate orbitofrontal cortex. Nature 1999, 398:704-708.
45. Waelti P., Dickinson A., Schultz W. Dopamine responses comply with basic assumptions of formal learning theory. Nature 2001, 412:43-48.
46. Wallis J.D., Miller E.K. Neuronal activity in primate dorsolateral and orbital prefrontal cortex during performance of a reward preference task. Eur. J. Neurosci. 2003, 18:2069-2081.
47. Watanabe M. Reward expectancy in primate prefrontal neurons. Nature 1996, 382:629-632.