The Effect of Context on Choice and Value

Neuroscience of Preference and Choice

Volumn , Issue , 2012, Pages 93-119

  De Martino, Benedetto ^a  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

Choice behavior; Contextual modulation; Loss aversion; Neural computations,value signals

Indexed keywords

EID: 84882512689     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1016/B978-0-12-381431-9.00005-X     Document Type: Chapter

References (96)

1. Adolphs R., Tranel D., Damasio H., Damasio A.R. Fear and the human amygdala. The Journal of Neuroscience 1995, 15(9):5879-5891.
2. Allais M. La psychologie de l'home rationnel devant le risque: Critique des postulats et axiomes de l'école Américaine. Econometrica 1953, 21(4):503-546.
3. Amaral P., Price J.L., Pitkanen A., Carmichael S.T. The amygdala: Neurobiological aspects of emotion, memory and mental dysfunction 1992, Wiley-Liss, Inc, New York, NY.
4. Balleine B., Killcross S. Parallel incentive processing: An integrated view of amygdala function. Trends in Neurosciences 2006, 29(5):272-279.
5. Baxter M., Parker A., Lindner C., Izquierdo A., Murray E. Control of response selection by reinforcer value requires interaction of amygdala and orbital prefrontal cortex. The Journal of Neuroscience 2000, 20(11):4311-4319.
6. Baxter M.G., Murray E.A. The amygdala and reward. Nature Reviews Neuroscience 2002, 3(7):563-573.
7. Becker G.M., Degroot M.H., Marschak J. Measuring utility by a single-response sequential method. Behavioral Science 1964, 9(3):226-232.
8. Brown P., Jenkins H. Auto-shaping of the pigeon's key-peck. Journal of the Experimental Analysis of Behavior 1968, 11(1):1-8.
9. Cardinal R., Parkinson J., Hall J., Everitt B. Emotion and motivation: The role of the amygdala, ventral striatum, and prefrontal cortex. Neuroscience and Biobehavioral Reviews 2002, 26(3):321-352.
10. Chen M., Bargh J. Consequences of automatic evaluation: Immediate behavioral predispositions to approach or avoid the stimulus. Personality and Social Psychology Bulletin 1999, 25(2):215-224.
11. Chib V., Rangel A., Shimojo S., O'Doherty J. Evidence for a common representation of decision values for dissimilar goods in human ventromedial prefrontal cortex. The Journal of Neuroscience 2009, 29(39):12315-12320.
12. Clifford C., Webster M., Stanley G., Stocker A., Kohn A., Sharpee T., et al. Visual adaptation: Neural, psychological and computational aspects. Vision Research 2007, 47(25):3125-3131.
13. Colwill R., Rescorla R. Associations between the discriminative stimulus and the reinforcer in instrumental learning. Journal of Experimental Psychology Animal Behavior Processes 1988, 14(2):155-164.
14. Corbit L.H., Balleine B.W. Double dissociation of basolateral and central amygdala lesions on the general and outcome-specific forms of Pavlovian-instrumental transfer. The Journal of Neuroscience 2005, 25(4):962-970.
15. Dayan P. Goal-directed control and its antipodes. Neural Networks 2009, 22(3):213-219.
16. Dayan P., Niv Y., Seymour B., Daw N. The misbehavior of value and the discipline of the will. Neural Networks 2006, 19(8):1153-1160.
17. De Martino B., Kumaran D., Seymour B., Dolan R. Frames, biases, and rational decision-making in the human brain. Science 2006, 313(5787):684-687.
18. De Martino B., Harrison N., Knafo S., Bird G., Dolan R. Explaining enhanced logical consistency during decision making in autism. The Journal of Neuroscience 2008, 28(42):10746-10750.
19. De Martino B., Kumaran D., Holt B., Dolan R. The neurobiology of reference-dependent value computation. The Journal of Neuroscience 2009, 29(12):3833-3842.
20. De Martino B., Camerer C., Adolphs R. Amygdala damage eliminates monetary loss aversion. Proceedings of the National Academy of Sciences of the United States of America 2010, 107(8):3788-3792.
21. Delgado M., Nearing K., LeDoux J., Phelps E. Neural circuitry underlying the regulation of conditioned fear and its relation to extinction. Neuron 2008, 59(5):829-838.
22. Dolan R.J. Emotion, cognition, and behavior. Science 2002, 298(5596):1191-1194.
23. Duranti A., Goodwin C. Rethinking context: An introduction. Rethinking context: Language as an interactive phenomenon 1992, 1-42. Cambridge University Press, New York, NY. C. Goodwin, A. Duranti (Eds.).
24. Eldridge G., Pear J. Topographical variations in behavior during autoshaping, automaintenance, and omission training. Journal of the Experimental Analysis of Behavior 1987, 47(3):319-333.
25. Estes W. Discriminative conditioning. I. A discriminative property of conditioned anticipation. Journal of Experimental Psychology 1943, 32(2):150-155.
26. Everitt B.J., Parkinson J.A., Olmstead M.C., Arroyo M., Robledo P., Robbins T.W. Associative processes in addiction and reward. The role of amygdala-ventral striatal subsystems. Annals of the New York Academy of Sciences United States of America 1999, 877:412-438.
27. Ferry A., Öngür D., An X., Price J. Prefrontal cortical projections to the striatum in macaque monkeys: Evidence for an organization related to prefrontal networks. The Journal of Comparative Neurology 2000, 425(3):447-470.
28. Fleming S., Thomas C., Dolan R. Overcoming status quo bias in the human brain. Proceedings of the National Academy of Sciences of the United States of America 2010, 107(13):6005-6009.
29. Frank M. Hold your horses: A dynamic computational role for the subthalamic nucleus in decision making. Neural Networks 2006, 19(8):1120-1136.
30. Gallagher M., McMahan R., Schoenbaum G. Orbitofrontal cortex and representation of incentive value in associative learning. The Journal of Neuroscience 1999, 19(15):6610-6614.
31. Guitart-Masip M., Talmi D., Dolan R.J. Conditioned associations and economic decision biases. Neuroimage 2010, 53(1):206-214.
32. Gurney K., Prescott T., Redgrave P. A computational model of action selection in the basal ganglia. I. A new functional anatomy. Biological Cybernetics 2001, 84(6):401-410.
33. Gurney K., Prescott T., Redgrave P. A computational model of action selection in the basal ganglia. II. Analysis and simulation of behaviour. Biological Cybernetics 2001, 84(6):411-423.
34. Haigh M., List J. Do professional traders exhibit myopic loss aversion? An experimental analysis. Journal of Finance 2005, 60(1):523-534.
35. Hare T.A., O'Doherty J., Camerer C.F., Schultz W., Rangel A. Dissociating the role of the orbitofrontal cortex and the striatum in the computation of goal values and prediction errors. The Journal of Neuroscience 2008, 28(22):5623-5630.
36. Hariri A., Mattay V., Tessitore A., Kolachana B., Fera F., Goldman D., et al. Serotonin transporter genetic variation and the response of the human amygdala. Science 2002, 297(5580):400-403.
37. Hartley C., Phelps E. Changing fear: The neurocircuitry of emotion regulation. Neuropsychopharmacology 2009, 35(1):136-146.
38. Hatfield T., Han J., Conley M., Gallagher M., Holland P. Neurotoxic lesions of basolateral, but not central, amygdala interfere with Pavlovian second-order conditioning and reinforcer devaluation effects. The Journal of Neuroscience 1996, 16(16):5256-5265.
39. Houthakker H. Revealed preference and the utility function. Economica 1950, 17(66):159-174.
40. Isoda M., Hikosaka O. Role for subthalamic nucleus neurons in switching from automatic to controlled eye movement. The Journal of Neuroscience 2008, 28(28):7209-7218.
41. Johnson E., Goldstein D. Do defaults save lives?. Science 2003, 302:1338-1339.
42. Kahneman D., Knetsch J.L., Thaler R.H. Experimental tests of the endowment effect and the Coase theorem. The Journal of Political Economy 1990, 98(6):1325-1348.
43. Kahneman D., Knetsch J.L., Thaler R.H. Anomalies - the endowment effect, loss aversion, and status-quo bias. The Journal of Economic Perspectives 1991, 5(1):193-206.
44. Kahneman D., Tversky A. Choices, values, and frames 2000, Cambridge University Press, New York, NY.
45. Kahneman D., Frederick S. Frames and brains: Elicitation and control of response tendencies. Trends in Cognitive Sciences 2007, 11(2):45-46.
46. Koszegi B., Rabin M. A model of reference-dependent preferences. The Quarterly Journal of Economics 2006, 121(4):1133-1165.
47. Laughlin S. The role of sensory adaptation in the retina. The Journal of Experimental Biology 1989, 146:39-62.
48. LeDoux J.E. The emotional brain 1996, Simon & Schuster, New York, NY.
49. LeDoux J.E. Emotion circuits in the brain. Annual Review of Neuroscience 2000, 23:155-184.
50. Lesch K., Bengel D., Heils A., Sabol S., Greenberg B., Petri S., et al. Association of anxiety-related traits with a polymorphism in the serotonin transporter gene regulatory region. Science 1996, 274(5292):1527.
51. Logothetis N.K. The neural basis of the blood-oxygen-level-dependent functional magnetic resonance imaging signal. Philosophical Transactions of the Royal Society of London Series B: Biological Sciences 2002, 357(1424):1003-1037.
52. Logothetis N.K., Pauls J., Augath M., Trinath T., Oeltermann A. Neurophysiological investigation of the basis of the fMRI signal. Nature 2001, 412:150-157.
53. Luce R. Individual choice behavior: A theoretical analysis 1959, 115. Wiley, New York, NY, 191-243.
54. McNeil B.J., Pauker S.G., Sox H.C., Tversky A. On the elicitation of preferences for alternative therapies. The New England Journal of Medicine 1982, 306(21):1259-1262.
55. Mercer J. Prospect theory and political science. Political Science 2005, 8(1):1-21.
56. Mogenson G., Jones D., Yim C. From motivation to action: Functional interface between the limbic system and the motor system. Progress in Neurobiology 1980, 14(2-3):69-97.
57. Morrison S.E., Salzman C.D. Re-valuing the amygdala. Current Opinion in Neurobiology 2010, 20(2):221-230.
58. Nicolle A., Fleming S., Bach D., Driver J., Dolan R. A regret-induced status quo bias. The Journal of Neuroscience 2011, 31(9):3320.
59. Noonan M., Walton M., Behrens T., Sallet J., Buckley M., Rushworth M. Separate value comparison and learning mechanisms in macaque medial and lateral orbitofrontal cortex. Proceedings of the National Academy of Sciences of the United States of America 2010, 107(47):20547-20552.
60. Ongur D., Price J. The organization of networks within the orbital and medial prefrontal cortex of rats, monkeys and humans. Cerebral Cortex 2000, 10(3):206.
61. Padoa-Schioppa C. Range-adapting representation of economic value in the orbitofrontal cortex. The Journal of Neuroscience 2009, 29(44):14004-14014.
62. Padoa-Schioppa C., Assad J.A. The representation of economic value in the orbitofrontal cortex is invariant for changes of menu. Nature Neuroscience 2008, 11(1):95-102.
63. Paton J.J., Belova M.A., Morrison S.E., Salzman C.D. The primate amygdala represents the positive and negative value of visual stimuli during learning. Nature 2006, 439(7078):865-870.
64. Phelps E.A., Delgado M.R., Nearing K.I., LeDoux J.E. Extinction learning in humans: Role of the amygdala and vmPFC. Neuron 2004, 43(6):897-905.
65. Phelps E.A., LeDoux J.E. Contributions of the amygdala to emotion processing: From animal models to human behavior. Neuron 2005, 48(2):175-187.
66. Pickens C.L., Saddoris M.P., Setlow B., Gallagher M., Holland P.C., Schoenbaum G. Different roles for orbitofrontal cortex and basolateral amygdala in a reinforcer devaluation task. The Journal of Neuroscience 2003, 23(35):11078-11084.
67. Plassmann H., O'Doherty J., Rangel A. Orbitofrontal cortex encodes willingness to pay in everyday economic transactions. The Journal of Neuroscience 2007, 27(37):9984-9988.
68. Plassmann H., O'Doherty J., Shiv B., Rangel A. Marketing actions can modulate neural representations of experienced pleasantness. Proceedings of the National Academy of Sciences of the United States of America 2008, 105(3):1050-1054.
69. Quiggin J. Generalized expected utility theory: The rank-dependent model 1993, Kluwer Academic Pub, Boston, MA.
70. Quirk G., Mueller D. Neural mechanisms of extinction learning and retrieval. Neuropsychopharmacology 2007, 33(1):56-72.
71. Rangel A., Camerer C., Montague P.R. A framework for studying the neurobiology of value-based decision making. Nature Reviews Neuroscience 2008, 9(7):545-556.
72. Rangel A., Hare T. Neural computations associated with goal-directed choice. Current Opinion in Neurobiology 2010, 20(2):262-270.
73. Ray P. Independence of irrelevant alternatives. Econometrica: Journal of the Econometric Society 1973, 41(5):987-991.
74. Rescorla R. Transfer of instrumental control mediated by a devalued outcome. Animal Learning & Behavior 1994, 22(1):27-33.
75. Rescorla R., Solomon R. Two-process learning theory: Relationships between Pavlovian conditioning and instrumental learning. Psychological Review 1967, 74(3):151-182.
76. Rescorla R.A., Wagner A.R. A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement. Classical conditioning II: Current research and theory 1972, 64-99. Appleton Century Crofts, New York. A.H. Black, W.F. Prokasy (Eds.).
77. Roiser J., De Martino B., Tan G., Kumaran D., Seymour B., Wood N., et al. A genetically mediated bias in decision making driven by failure of amygdala control. The Journal of Neuroscience 2009, 29(18):5985-5991.
78. Salzman C.D., Fusi S. Emotion, cognition, and mental state representation in amygdala and prefrontal cortex. Annual Review of Neuroscience 2010, 33(1):173-202.
79. Samuelson P. Consumption theory in terms of revealed preference. Economica 1948, 15(60):243-253.
80. Schoenbaum G., Roesch M., Stalnaker T. Orbitofrontal cortex, decision-making and drug addiction. Trends in Neurosciences 2006, 29(2):116-124.
81. Schoenbaum G., Roesch M., Stalnaker T., Takahashi Y. A new perspective on the role of the orbitofrontal cortex in adaptive behaviour. Nature Reviews Neuroscience 2009, 10:885-892.
82. Sokol-Hessner P., Hsu M., Curley N., Delgado M., Camerer C., Phelps E. Thinking like a trader selectively reduces individuals' loss aversion. Proceedings of the National Academy of Sciences of the United States of America 2009, 106(13):5035-5040.
83. Sotres-Bayon F., Cain C., LeDoux J. Brain mechanisms of fear extinction: Historical perspectives on the contribution of prefrontal cortex. Biological Psychiatry 2006, 60(4):329-336.
84. Talmi D., Seymour B., Dayan P., Dolan R. Human Pavlovian instrumental transfer. The Journal of Neuroscience 2008, 28(2):360-368.
85. Thaler R. Toward a positive theory of consumer choice. Journal of Economic Behavior & Organization 1980, 1(1):39-60.
86. Tom S.M., Fox C.R., Trepel C., Poldrack R.A. The neural basis of loss aversion in decision-making under risk. Science 2007, 315(5811):515-518.
87. Tovar P. The effects of loss aversion on trade policy: Theory and evidence. Journal of International Economics 2009, 78(1):154-167.
88. Tremblay L., Schultz W. Relative reward preference in primate orbitofrontal cortex. Nature 1999, 398(6729):661-663.
89. Tulving E. Encoding specificity and retrieval processes in episodic memory. Psychological Review 1973, 80(5):352-373.
90. Tversky A., Kahneman D. Judgment under uncertainty: Heuristics and biases. Science 1974, 185(4157):1124-1131.
91. Tversky A., Kahneman D. The framing of decisions and the psychology of choice. Science 1981, 211(4481):453-458.
92. Tye K., Janak P. Amygdala neurons differentially encode motivation and reinforcement. The Journal of Neuroscience 2007, 27(15):3937-3945.
93. von Neumann J., Morgestern O. Theory of games and economic behavior 1944, Princeton University Press, New Jersey.
94. Weber B., Rangel A., Wibral M., Falk A. The medial prefrontal cortex exhibits money illusion. Proceedings of the National Academy of Sciences of the United States of America 2009, 106(13):5025-5028.
95. Williams D., Williams H. Auto-maintenance in the pigeon: Sustained pecking despite contingent non-reinforcement. Journal of the Experimental Analysis of Behavior 1969, 12(4):511-520.
96. Yu R., Mobbs D., Seymour B., Calder A. Insula and striatum mediate the default bias. The Journal of Neuroscience 2010, 30(44):14702-14707.