Neuroeconomics: A view from neuroscience

Functional Neurology

Volumn 22, Issue 4, 2007, Pages 219-234

  Montague, P Read ^a  

^a Department of Neuroscience   (United States)

Author keywords

Computational psychiatry; Neuroeconomics; Trust games; Ultimatum games; Valuation

Indexed keywords

DOPAMINE;

ACCURACY; ARTICLE; BEHAVIOR; BRAIN ELECTROPHYSIOLOGY; COGNITION; CORPUS STRIATUM; DECISION MAKING; ECONOMIC ASPECT; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; INFORMATION PROCESSING; MENTAL FUNCTION; NEUROIMAGING; NEUROPHYSIOLOGY; NEUROSCIENCE; NONHUMAN; NUCLEUS ACCUMBENS; ORBITAL CORTEX; PAIN; PARKINSON DISEASE; QUANTITATIVE ANALYSIS; REINFORCEMENT; REWARD; TASK PERFORMANCE;

ANIMALS; ASSOCIATION LEARNING; CEREBRAL CORTEX; CHOICE BEHAVIOR; COMPUTATIONAL BIOLOGY; DECISION MAKING; ENERGY METABOLISM; HUMANS; MODELS, ECONOMIC; NEUROSCIENCES; PROBABILITY LEARNING; REINFORCEMENT (PSYCHOLOGY);

EID: 38949124688     PISSN: 03935264     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (96)

1. Glimcher PW. Making choices: the neurophystology of visual-saccadic decision making. Trends Neurosci 2001;24: 654-659
2. Montague PR, Berns GS. Neural economics and the biological substrates of valuation. Neuron 2002;36:265-284
3. Glimcher PW. The neurobiology of visual-saccadic decision making. Annu Rev Neurosci 2003;26:133-179
4. Glimcher PW, Rustichini A. Neuroeconomics: the consilience of brain and decision. Science 2004;306:447-452
5. Camerer CF, Fehr E. When does 'economic' man dominate social behavior? Science 2006;311:47-52
6. Montague PR. Why Choose This Book? New York NY; Penguin Group Inc. 2006
7. Bialek W. Physical limits to sensation and perception. Annu Rev Biophys Biophys Chem 1987;16:455-478
8. Laughlin SB. Matching coding, circuits, cells, and molecules to signals. General principles of retinal design in the fly's eye. Progress in Retinal and Eye Research 1994;13: 65-196
9. Barlow HB. Possible principles underlying the transformation of sensory messages. In: Rosenblith W ed Sensory Communication. Cambridge, MA; MIT Press 1961:217-234
10. Barlow HB. Redundancy reduction revisited. Network: Computation in Neural Systems 2001;12:241-253
11. Atick JJ. Could information theory provide an ecological theory of sensory processing? Network: Computation in Neural Systems 1992;3: 213-251
12. Simoncelli EP, Olshausen BA. Natural image statistics and neural representation. Aranu Rev Neurosci 2001;24:1193-1216
13. Levy WB, Baxter R. A. Energy efficient neural codes. Neural Comput 1996;8:531-543
14. Laughlin SB, de Ruyter van Steveninck RR, Anderson JC. The metabolic cost of neural information. Nat Neurosci 1998;1:36-41
15. Laughlin SB. Energy as a constraint on the coding and processing of sensory information. Curr Opin Neurobiol 2001;11:475-480
16. Attwell D, Laughlin SB. An energy budget for signaling in the grey matter of the brain. J Cereb Blood Flow Metab 2001;21:1133-1145
17. Laughlin SB The implications of metabolic energy requirements in the representation of information in neurons. In: Gazzaniga MS ed The Cognitive Neurosciences III. Cambridge, MA: MIT Press 2004:187-196
18. Ruderman DL. The statistics of natural images. Network 1994;5:517-548
19. Kamil AC, Krebs JR, Pulliam HR. Foraging Behavior. New York; Plenum Press 1987
20. Smith JM. Evolution and the Theory of Games. Cambridge; Cambridge University Press 1982
21. Krebs JR, Kacelnik A., Taylor P. Tests of optimal sampling by foraging great tits. Nature 1978;275:27-31
22. Sutton RS, Barto AG. Reinforcement Learning. Cambridge, MA; MIT Press 1998
23. Daw ND, Doya K. The computational neurobiology of learning and reward. Curr Opin Neurobiol 2006;16:199-204
24. Montague PR, Dayan P, Nowlan SJ, Pouget A, Sejnowski TJ. Using aperiodic reinforcement for directed self-organization. Advances in Neural Information Processing Systems 1993;5:969-976
25. Montague PR, Sejnowksi TJ. The predictive brain: temporal coincidence and temporal order in synaptic learning mechanisms. Learn Main 1994:1:1-33
26. Montague P, Dayan PR., Sejnowski TJ. A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J Neurosci 1996;16:1936-1947
27. Schultz W, Dayan P, Montague PR.. A neural substrate of prediction and reward. Science 1997;275:1593-1599
28. Dayan P, Balleine BW. Reward, motivation and reinforcement learning. Neuron 2002;36:285-298
29. Montague PR, McClure SM, Baldwin PR et al. Dynamic gain control of dopamine delivery in freely moving animals. J Neurosci 2004;24:1754-1759
30. Radish AD. Addiction as a computational process gone awry. Science 2004;306:1944-1947
31. Ljungberg T, Apicella P, Schultz W. Responses of monkey dopamine neurons during learning of behavioral reactions. J Neurophysiol 1992;67:145-163
32. Quartz S, Dayan P, Montague PR, Sejnowski T. Expectation learning in the brain using diffuse ascending connections. Soc Neurosci 1992;18:1210 (abstract)
33. Montague PR, Dayan P, Sejnowski TJ. Foraging In an Uncertain Environment Using Predictive Hebbian Learning. Advances in Neural Information Processing Systems 1994;6:598-605
34. Montague PR, Dayan P, Person C, Sejnowski TJ. Bee foraging in uncertain environments using predictive hebbian learning. Nature 1995;377:72-728
35. Schultz W. Predictive reward signal of dopamine neurons. J Neurophysiol 1998;80:1-27
36. Schultz W, Dickinson A. Neuronal coding of prediction errors. Annu Rev Neurosci 2000;23:473-500
37. Waelti P, Dickinson A, Schultz W. Dopamine responses comply with basic assumptions of formal learning theory. Nature 2001;412:43-48
38. Dayan P, Abbott LF. Theoretical Neuroscience. Cambridge MA; MIT Press 2001
39. Bayer HM, Glimcher PW. Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron 2005;47:129-141
40. Delgado MR, Nystrom LE, Fissell C, Noli DC, Flez JA. Tracking the hemodynamic responses to reward and punishment in the striatum. J Neurophysiol 2000;84:3072-3077
41. Montague PR, Hyman SE, Cohen JD. Computational roles for dopamine in behavioural control. Nature 2004;431:760-767
42. Ikemoto S. Panksepp J. The role of nucleus accumbens dopamine in motivated behavior: a unifying interpretation with special reference to reward-seeking. Brain Res Brain Res Rev 1999;31:6-41
43. Redgrave P, Prescott TJ, Gurney K. Is the short-latency dopamine response too short to signal reward error? Trends Neurosci 1999;22:148-151
44. Dayan P, Sejnowski TJ. Exploration bonuses and dual control. Machine Learning 1996:25 5-22
45. Kakade S, Dayan P. Dopamine: generalization and bonuses. Neural Netw 2002;15:549-559
46. Redgrave P, Gurney K. The short-latency dopamine signal: a role in discovering novel actions? Nat Rev Neurosci 2006;7:967-975
47. Morris G, Nevet A, Arkadir D, Vaadia E, Bergman H. Mid-brain dopamine neurons encode decisions for future action. Nat Neurosci 2006;9:1057-1063
48. Kaelbling LP, Littman ML, Moore AW. Reinforcement learning: a survey. Journal of Artificial Intelligence Research 1996;4:237-285
49. Tobler PN, Fiorillo CD, Schultz W. Adaptive coding of reward value by dopamine neurons. Science 2005;307: 1542-1645
50. Preuschoff K, Bossaerts P, Quartz SR. Neural differentiation of expected reward and risk in human subcortical structures. Neuron 2006;51:381-390
51. Knutson B, Westdorp A, Kaiser E, Hommer D. FMRI visualization of brain activity during a monetary incentive delay task. Neuroimage 2000;12:20-27
52. Knutson B, Fong GW, Adams CM, Varner JL, Hommer D. Dissociation of reward anticipation and outcome with event-related fMRI. Neuroreport 2001;12:3683-3687
53. Berns GS., McClure SM., Pagnoni G, Montague PR. Predictability modulates human brain response to reward. J Neurosci 2001;21:2793-2798
54. McClure SM, Berns GS, Montague PR. Temporal prediction activates human striatum. Neuron 2003;38:339-346
55. O'Doherty JP, Dayan P, Friston K, Critchtey H, Dolan RJ. Temporal difference models and reward related learning in the human brain. Neuron 2003;38:329-337
56. O'Doherty JP, Dayan P, Schultz J, Deichmann R, Friston K, Dolan R.J. Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science 2004;304:452-454
57. O'Doherty JP. Reward representations and reward-related learning in the human brain:Insights from neuroimaging. Curr Opin Neurobiol 2004;14:769-776
58. Montague PR, King-Cases B, Cohen JD. Imaging valuation models in human choice. Annu Rev Neurosci 2006;29: 417-448
59. Herrnstein RJ, Preiec D. Melloration: a theory of distributed choice. Journal of Economic Perspectives 1991;5: 137-156
60. Egelman DM, Person C, Montague PR. A computational role for dopamine delivery in human decision-making. J Cogn Neurosci 1998;10:623-630
61. LI J, McClure SM, King-Casas B, Montague PR. Policy adjustment in a dynamic economic game. PLoS One 2006; 1:e103
62. Lohrenz T, McCabe K, Camerer CF, Montague PR. Neural signature of fictive learning signals in a sequential investment task. Proc Natl Acad Sci (USA) 2007;104: 9493-9498
63. Friston KJ, Jezzard P, Turner R. The analysis of functional MRI time-series. Hum Brain Mapp 1994;1:153-171
64. Ashburner J, Friston KJ. Nonlinear spatial normalization using basis functions. Hum Brain Mapp 1999; 7:254-266
65. Breiter HG, Gollub RL, Weisskoff RM, Kennedy DN, Makris N, Berke JD et al. Acute effects of cocaine oh human brain activity and emotion. Neuron 1997;19:591-611
66. Breiter HC, Aharon I, Kahneman D, Dale A, Shizgal P. Functional imaging of neural responses to expectancy and experience of monetary gains and losses. Neuron 2001; 30;619-630
67. Thut G, Schultz W, Roelcke et al. Activation of the human brain by monetary reward. Neuroreport 1997;8:1225-1228
68. Elliott R., Newman JL, Longe OA, Deakin JF. Differential response patterns in the striatum and orbitofrontal cortex to financial reward in humans: a parametric functional magnetic resonance imaging study. J Neurosci 2003;23: 303-307
69. Wickens J. A Theory of the Striatum. Oxford; Pergamon Press 1993
70. Gamerer CF. Behavioral Game Theory. Princeton; Princeton University Press 2003
71. Rilling JK, Gutman DA, Zeh TR, Pagnoni G, Berns GS, Kilts CD. A neural basis far social cooperation. Neuron 2002;35:395-405
72. Rilling JK, Sanfey AG, Aronson JA, Nystrom LE, Cohen JD. The neural correlates of theory of mind within interpersonal interactions. Neuroimage 2004;22:1694-1703
73. Rilling JK, Sanfey AG, Aronson JA, Nystrom LE, Cohen JD. Opposing BOLD responses to reciprocated and unreciprocated altruism in putative reward pathways. Neuroreport 2004;15:2539-2543
74. de Quervain DJ, Fischbacher U, Treyer V et al. The neural basis of altruistic punishment. Science 2004;305:1254-1258
75. King-Casas B, Tomlin D, Anen C, Camerer CF, Quartz SR., Montague PR. Getting to know you: reputation and trust in a two-person economic exchange. Science 2005; 308:78-83
76. Singer T, Seymour B, O'Doherty JP, Stephan KE, Dolan RJ, Frith CD. Empathic neural responses are modulated by the perceived fairness of others. Nature 2006;439:466-469
77. Tomlin D, Kayali MA, King-Casas B et al. Agent-specific responses in the cingulate cortex during economic exchanges. Science 2006;312:1047-1050
78. Pessiglione M, Schmidt L, Draganski B et al. How the brain translates money into force: a neuroimaging study at subliminal motivation. Science 2007;316:904-906
79. Berns GS, Chappelow J, Zink CF, Pagnoni G, Martin-Skurski ME, Richards J. Neurobiological correlates of social conformity and independence during mental rotation. Biol Psychiatry 2005;58:245-253
80. Asch SE. Effects of group pressure upon the modification and distortion at judgment. In: Guetzkow H ed Groups, Leadership and Men. Pittsburgh, PA: Carnegie Press 1951
81. Güth W, Schmittberger R, Schwarze B. An experimental analysis of ultimatum bargaining. Journal of Economic Behavior and Organization 1982; 3: 367-388
82. Sanfey AG, Rilling JK, Aronson JA, Nystrom LE, Cohen JD. The neural basis of economic decision-making in the Ultimatum Game. Science 2003;300:1755-1758
83. Damasio AR, Grabowski TJ, Bechara A. et al. Subcortical and cortical brain activity during the feeling of self-generated emotions. Nat Neurosci 2000;3:2978-2986
84. Phillips ML, Young AW, Senior C et al. A specific neural substrate for perceiving facial expressions of disgust. Nature 1997;389:495-498
85. Dani JA, Montague PR. Disrupting addiction through the loss of drug-associated internal states. Nat Neurosci 2007; 10:403-404
86. Naqvi NH, Rudrauf D, Damasio H, Bechara A. Damage to the insula disrupts addiction to cigarette smoking. Science 2007;315:531-534
87. Camerer CF, Weigelt K. Reputation and corporate strategy: a review of recent theory and applications. Strategic Management Joumal 1988;9:443-454
88. Berg J, Dickhaut J, McCabe K. Trust, reciprocity, and social history. Games and Economic Behavior 1995;10:122-142
89. Montague PR, Berns GS, Cohen JD, McClure SM, Pagnoni G. Hyperscanning: simultaneous fMRI during linked social interactions. Neuroimage 2002;16:1159-1164
90. Delgado MR, Frank RH, Phelps EA. Perceptions of moral character modulate the neural systems of reward during the trust game. Nat Neurosci 2005;8:1611-1618
91. Miller EK, Cohen JD. An integrative theory of prefrontal cortex function. Annu Rev Neurosci 2001;24:167-202
92. O'Reilly RC, Braver TS, Cohen JD. A biologically-based neural network model of working memory. In: Miyake A, Shah P eds Models of Working Memory: Mechanisms of Active Maintenance and Executive Control. New York, NY; Cambridge University Press 1999:375-411
93. O'Reilly RC, Noelle DC, Braver TS, Cohen JD. Prefrontal cortex and dynamic categorization tasks: representational organization and neuromodulatory control. Cereb Cortex 2002;12:246-257
94. Singer R, Seymour B, O'Doherty J, Kaube H, Dolan RJ, Frith CD. Empathy for pain involves the affective but not sensory components of pain. Science 2004;303:1157-1162
95. Radish AD. Addiction as a computational process gone awry. Science 2004 306:1944-1947
96. Fehr E, Schmidt KM. A Theory of fairness, competition and cooperation. Quarterly Journal of Economics 1999;114: 817-868