A computational role for dopamine delivery in human decision-making

Journal of Cognitive Neuroscience

Volumn 10, Issue 5, 1998, Pages 623-630

  Egelman, David M ^a   Person, Christophe ^a   Montague, P Read ^a  

^a BAYLOR COLLEGE OF MEDICINE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DOPAMINE;

ARTICLE; DECISION MAKING; DOPAMINERGIC SYSTEM; DOPAMINERGIC TRANSMISSION; HUMAN; HUMAN EXPERIMENT; LEARNING; MESENCEPHALON; NORMAL HUMAN; PRIORITY JOURNAL; TIME;

CEREBRAL CORTEX; CHOICE BEHAVIOR; DECISION MAKING; DOPAMINE; HUMANS; LEARNING; MESENCEPHALON; MODELS, NEUROLOGICAL; MODELS, PSYCHOLOGICAL; PROBABILITY; REACTION TIME; THINKING;

EID: 0031788392     PISSN: 0898929X     EISSN: None     Source Type: Journal    
DOI: 10.1162/089892998563022     Document Type: Article

References (38)

1. Agid, Y., Cervera, P., Hirsch, E., Javoy-Agid, F., Lehericy, S., Raisman, R., & Ruberg, M. (1989). Biochemistry of Parkinson's disease 28 years later: A critical review. Movement Disorders, 4 Suppl 1, S126-144.
2. Aston-Jones, G., Rajkowski, J., Kubiak, P., & Alexinsky, T. (1994). Locus coeruleus neurons in monkey are selectively activated by attended cues in a vigilance task. Journal of Neuroscience, 14, 4467.
3. Bechara, A., Damasio, A. R., Damasio, H., & Anderson, S. W. (1994). Insensitivity to future consequences following damage to human prefrontal cortex. Cognition, 50, 7-15.
4. Bechara, A., Tranel, D., Damasio, H., Adolphs, R., Rockland, C., & Damasio, A. R. (1995). Double dissociation of conditioning and declarative knowledge relative to the amygdala and hippocampus in humans. Science, 269, 1115-1118.
5. Bechara, A., Damasio, H., Tranel, D., & Damasio, A. R. (1997). Deciding advantageously before knowing the advantageous strategy. Science, 275, 1293-1295.
6. Bernoulli, D. (1738). Specimen theoriae novae de mensura sortis. Commentarii academiae scientiarum imperalis petropolitanae, 5, 175-192.
7. Berns, G. S., & Sejnowski, T. J. (1996). How the basal ganglia make decisions. In A. Damasio (Ed.), Neurobiology of decision-making (pp. 101-113). Berlin: Springer-Verlag.
8. Borgstrom, R. S., & Kosaraju, S. R. (1993). Proceedings, ACM Simposium an Theory of Computing, 25, 130.
9. Busemeyer, J. R.,& Townsend, J. T. (1993). Decision field theory: A dynamic-cognitive approach to decision making in an uncertain environment. Psychological Review, 100, 432.
10. Carpenter, R. H. S., & Williams, M. L. L. (1995). Neural computations of log likelihood in control of saccadic eye movements. Nature, 377, 59-62.
11. Damasio, A. R. (1985). Descartes' error. New York: Putnam.
12. Damasio, A. R., Tranel, D., and Damasio, H. (1990). Individuals with sociopathic behavior caused by frontal damage fail to respond autonomically to social stimuli. Behavioral Brain Research, 41, 81-94.
13. Egelman, D. M., Person, C., & Montague, P. R. (1995). A predictive model for diffuse systems matches human choices in a simple decision-making task. Society for Neuroscience Abstracts, 21, 2087.
14. Eslinger, P. J., & Damasio, A. R. (1985). Severe disturbance of higher cognition after bilateral frontal lobe ablation: Patient EVR. Neurology, 35, 1731-1741.
15. Grossberg, S., & Gutowski, W. E. (1987). Neural dynamics of decision making under risk: Affective balance and cognitive-emotional interactions. Psychological Review, 94, 300-318.
16. Herrnstein, R. J. (1990). Rational choice theory: Necessary but not sufficient. American Psychologist, 45, 356.
17. Herrnstein, R. J. (1991). Experiments on stable suboptimality in individual behavior. AEA Papers and Proceedings, 81, 360-364.
18. Hornykiewicz, O., & Kish, S. J. (1987). Biochemical pathophysiology of Parkinson's disease. Advances in Neurology, 45, 19-34.
19. Kahneman, D., & Tversky, A. (1979). Prospect theory: An analysis of decision under risk. Econometrica, 47, 263.
20. Kahneman, D., &. Tversky, A. (1984). Choices, values and frames. American Psychologist, 39, 341-350.
21. Kilian, J., Land, K. J., & Pearlmutter, B. A. (1994). Playing the matching-shonlders lob-pass game with logarithmic regret. Seventh Annual ACM Workshop on Computer Learning Theory, 159.
22. Ljungberg, T., Apicella, P., & Schultz, W. (1992). Responses of monkey dopamine neurons during learning of behavioral reactions. Journal of Neurophysiology, 67, 145.
23. Luce, R., & Raiffa, H. (1957). Games and decisions: Introduction and critical survey (New York: Dover).
24. Mirenowicz, J., & Schultz, W. (1996). Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli. Nature, 379, 449.
25. Montague, P. R., Dayan, P., & Sejnowski, T. J. (1996). A framework for mesencephalic dopamine systems based on predictive hebbian learning. Journal of Neuroscience, 16, 1936-1947.
26. Montague, P. R., Person, C., Dayan, P., & Sejnowski, T. J. (1995). Bee foraging in uncertain environments using predictive hebbian learning. Nature, 377, 725-728.
27. Quartz, S. R., Dayan, P., Montague, P. R., & Sejnowski, T. J. (1992). Expectation learning in the brain using diffuse ascending projections. Society for Neuroscience Abstracts, 18, 1210.
28. Romo, R., & Schultz, W. (1990). Dopamine neurons of the monkey midbrain: Contingincies of responses to active touch during self-initiated arm movements. Journal of Neurophysiology, 63, 592.
29. Schultz, W. (1992). Activity of dopamine neurons in the behaving primate. Seminars in Neuroscience, 4, 129-138.
30. Schultz, W., Apicella, P., & Ljungberg, T. (1993). Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task. Journal of Neuroscience, 13, 900-913.
31. Schultz, W., Dayan, P., & Montague, P. R. (1997). A neural substrate of prediction and reward. Science, 275, 1593-1599.
32. Sutton, R. S. (1988). Learning to predict by the method of temporal differences. Machine Learning, 3, 9-44.
33. Sutton, R. S., & Barto, A. G. (1987). A temporal-difference model of classical conditioning. Proceedings, Ninth Annual Conference of the Cognitive Science Society.
34. Sutton, R. S., & Barto, A. G. (1990). Time-derivative models of Pavlovian reinforcement. In M. Gabriel & J. Moore (Eds.), Learning and computational neuroscience (pp. 497-537). Cambridge: MIT Press.
35. Vaughan, W. & Herrnstein, R. J. (1987). Stability, melioration, and natural selection. In L. Green & J. H. Kagel (Eds.), Advances in behavioral economics, Vol. 1, (pp. 185-215). Norwood, NJ: Ablex.
36. von Neumann, J., & Morgenstern, O. (1947). Theory of games and economic behavior. Princeton, NJ: Princeton University Press.
37. Wise, R. A. (1980). Action of drugs of abuse on brain reward systems. Pharmacology, Biochemistry and Behavior, 13 Suppl. 1, 213-223.
38. Wise, R. A., & Bozarth, M. A. (1984). Brain reward circuitry: Four circuit elements "wired" in apparent series. Brain Research Bulletin, 12, 203.