Neural signatures of intransitive preferences

Frontiers in Human Neuroscience

Volumn 4, Issue , 2010, Pages

  Kalenscher, Tobias ^a   Tobler, Philippe N ^b   Huijbers, Willem ^a   Daselaar, Sander M ^a   Pennartz, Cyriel M A ^a  

^a UNIVERSITY OF AMSTERDAM   (Netherlands)

^b UNIVERSITY OF OXFORD   (United Kingdom)

Author keywords

Decision making; Heuristics; Irrational; Neuroeconomics; Risk; Utility; Value

Indexed keywords

ADULT; ARTICLE; ATTITUDE TO LIFE; BEHAVIORISM; BRAIN DEPTH STIMULATION; CONTROLLED STUDY; DECISION MAKING; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; INSULA; MALE; MATHEMATICAL COMPUTING; MATHEMATICAL MODEL; MENTAL TASK; NERVE CONDUCTION; NEUROIMAGING; PARIETAL CORTEX; POSTERIOR CINGULATE; PREFRONTAL CORTEX; RISK BENEFIT ANALYSIS; SENSITIVITY ANALYSIS; TASK PERFORMANCE;

EID: 79953010833     PISSN: 16625161     EISSN: 16625161     Source Type: Journal    
DOI: 10.3389/fnhum.2010.00049     Document Type: Article

References (85)

1. Afriat, S. N. (1967). The construction of utility functions from expenditure data. Int. Econ. Rev 8, 67-77.
2. Afriat, S. N. (1972). Efficiency estimation of production functions. Int. Econ. Rev. 13, 568-598.
3. Bernoulli, D. (1954). Exposition of a new theory on the measurement of risk. Econometrica 22, 23-36.
4. Boorman, E. D., Behrens, T. E., Woolrich, M. W., and Rushworth, M. F. (2009). How green is the grass on the other side? Frontopolar cortex and the evidence in favor of alternative courses of action. Neuron 62, 733-743.
5. Brandstätter, E., Gigerenzer, G., and Hertwig, R. (2006). The priority heuristic: making choices without trade-offs. Psychol. Rev. 113, 409-432.
6. Camille, N., Coricelli, G., Sallet, J., Pradat-Diehl, P., Duhamel, J. R., and Sirigu, A. (2004). The involvement of the orbitofrontal cortex in the experience of regret. Science 304,1167-1170.
7. Carter, C. S., Braver, T. S., Barch, D. M., Botvinick, M. M., Noll, D., and Cohen, J. D. (1998). Anterior cingulate cortex, error detection, and the online monitoring of performance. Science 280, 747-749.
8. Chandrasekhar, P. V., Capra, C. M., Moore, S., Noussair, C., and Berns, G. S. (2008). Neurobiological regret and rejoice functions for aversive outcomes. Neuroimage 39, 1472-1484.
9. Choi, S., Fisman, R., Gale, D., and Kariv, S. (2007a). Consistency and heterogeneity of individual behavior under uncertainty. Am. Econ. Rev. 97, 1921-1938.
10. Choi, S., Fisman, R., Gale, D., and Kariv, S. (2007b). Revealing preferences graphically: an old method gets a new tool kit. Am. Econ. Rev. 97, 153-158.
11. Coricelli, G., Critchley, H. D., Joffily, M., O'Doherty, J. P., Sirigu, A., and Dolan, R. J. (2005). Regret and its avoidance: a neuroimaging study of choice behavior. Nat. Neurosci. 8, 1255-1262.
12. Craig, A. D. (2002). How do you feel? Interoception: the sense of the physiological condition of the body. Nat. Rev. Neurosci. 3, 655-666.
13. Davidson, D. (2001). "How is weakness of will possible," in Essays on Actions and Events, ed. D. Davidson (Oxford: Oxford University Press), 21-42.
14. De Martino, B., Kumaran, D., Holt, B., and Dolan, R. J. (2009). The neurobiology of reference-dependent value computation. J. Neurosci. 29, 3833-3842.
15. Dorris, M. C., and Glimcher, P. W. (2004). Activity in posterior parietal cortex is correlated with the relative subjective desirability of action. Neuron 44, 365-378.
16. Elliott, R., Agnew, Z., and Deakin, J. F. (2008). Medial orbitofrontal cortex codes relative rather than absolute value of financial rewards in humans. Eur. J. Neurosci. 27, 2213-2218.
17. Ernst, M., and Paulus, M. P. (2005). Neurobiology of decision making: a selective review from a neurocognitive and clinical perspective. Biol. Psychiatry 58, 597-604.
18. Fecteau, S., Knoch, D., Fregni, F., Sultani, N., Boggio, P., and Pascual-Leone, A. (2007). Diminishing risk-taking behavior by modulating activity in the prefrontal cortex: a direct current stimulation study. J. Neurosci. 27, 12500-12505.
19. Fishburn, P. C. (1982). Nontransitive measurable utility. J. Math. Psychol. 26, 31-67.
20. Friston, K., Ashburner, J. D., Frith, C. D., Poline, J.-B., Heather, J. D., and Frackowiak, R. S. J. (1995). Spatial reg-istration and normalization of images. Hum. Brain Mapp. 3, 165-189.
21. Fujiwara, J., Tobler, P. N., Taira, M., Iijima, T., and Tsutsui, K. (2009) A parametric relief signal in human ventrolateral prefrontal cortex. Neuroimage 44, 1163-1170.
22. Hardin, M. G., Pine, D. S., and Ernst, M. (2009). The influence of context valence in the neural coding of monetary outcomes. Neuroimage 48, 249-257.
23. Hare, T. A., Camerer, C. F., and Rangel, A. (2009). Self-control in decision-making involves modulation of the vmPFC valuation system. Science 324, 646-648.
24. Hare, T. A., O'Doherty, J., Camerer, C. F., Schultz, W., and Rangel, A. (2008). Dissociating the role of the orbitofrontal cortex and the striatum in the computation of goal values and prediction errors. J. Neurosci. 28, 5623-5630.
25. Heldmann, M., Vogt, B., Heinze, H. J., and Munte, T. F. (2009). Different methods to define utility functions yield similar results but engage different neural processes. Front. Behav. Neurosci. 3:43. doi: 10.3389/neuro.08.043.2009.
26. Herrnstein, R. J. (1961). Relative and absolute strength of response as a function of frequency of reinforcement. J. Exp. Anal. Behav. 4, 267-272.
27. Herrnstein, R. J. (1970). On the law of effect. J. Exp. Anal. Behav. 2, 243-266.
28. Hey, J. D. (1995). Experimental investigations of errors in decision making under risk. Eur. Econ. Rev. 39, 633-640.
29. Houston, A. I. (1997). Natural selection and context-dependent values. Proc. R. Soc. Lond., B, Biol. Sci. 264, 1539-1541.
30. Houston, A. I., McNamara, J. M., and Steer, M. D. (2007). Violations of transitivity13under fitness maximization. Biol. Lett. 3, 365-367.
31. Huettel, S. A., Stowe, C. J., Gordon, E. M., Warner, B. T., and Platt, M. L. (2006). Neural signatures of economic preferences for risk and ambiguity. Neuron 49, 765-775.
32. Hume, D., Selby-Bigge, L. A., and Nidditch, P. H. (1978). A Treatise of Human Nature. Oxford: Oxford University Press.
33. Kable, J. W., and Glimcher, P. W. (2007). The neural correlates of subjective value during intertemporal choice. Nat. Neurosci. 10, 1625-1633.
34. Kalenscher, T., Diekamp, B., and Güntürkün, O. (2003). Neural architecture of choice behaviour in a concurrent interval schedule. Eur. J. Neurosci. 18, 2627-2637.
35. Kalenscher, T., and Pennartz, C. M. (2008). Is a bird in the hand worth two in the future? The neuroeconomics of intertemporal decision-making. Prog. Neurobiol. 84, 284-315.
36. Kalenscher, T., Windmann, S., Diekamp, B., Rose, J., Güntürkün, O., and Colombo, M. (2005). Single units in the pigeon brain integrate reward amount and time-to-reward in an impulsive choice task. Curr. Biol. 15, 594-602.
37. Kalis, A., Mojzisch, A., Schweizer, T. S., and Kaiser, S. (2008). Weakness of will, akrasia, and the neuropsychiatry of decision making: an interdisciplinary perspective. Cogn. Affect. Behav. Neurosci. 8, 402-417.
38. Kim, J. N., and Shadlen, M. N. (1999). Neural correlates of a decision in the dorsolateral prefrontal cortex of the macaque. Nat. Neurosci. 2, 176-185.
39. Kim, S., Hwang, J., and Lee, D. (2008). Prefrontal coding of temporally discounted values during intertemporal choice. Neuron 59, 161-172.
40. Knoch, D., Gianotti, L. R., Pascual-Leone, A., Treyer, V., Regard, M., Hohmann, M., and Brugger, P. (2006). Disruption of right prefrontal cortex by low-frequency repetitive transcranial magnetic stimulation induces risk-taking behavior. J. Neurosci. 26, 6469-6472.
41. Koyama, T., McHaffie, J. G., Laurienti, P. J., and Coghill, R. C. (2005). The subjective experience of pain: where expectations become reality. Proc. Natl. Acad. Sci. U.S.A. 102, 12950-12955.
42. Lee, L., Amir, O., and Ariely, D. (2006). In Search of Homo Economicus: Preference Consistency, Emotions, and Cognition.
43. Lee, L., Amir, O., and Ariely, D. (2009). In search of homo economicus: cognitive noise and the role of emotion in preference consistency. J. Consum. Res. 36, 173-187.
44. Li, X., Lu, Z. L., D'Argembeau, A., Ng, M., and Bechara, A. (2009). The Iowa Gambling Task in fMRI images. Hum. Brain Mapp. 31, 410-423.
45. Loomes, G., Starmer, C., and Sugden, R. (1991). Observing violations of transitivity by experimental methods. Econometrica 59, 425-439.
46. Louie, K., and Glimcher, P. W. (2010). Separating value from choice: delay discounting activity in the lateral intraparietal area. J. Neurosci. 30, 5498-5507.
47. McClure, S. M., Laibson, D. I., Loewenstein, G., and Cohen, J. D. (2004). Separate neural systems value immediate and delayed monetary rewards. Science 306, 503-507.
48. McCoy, A. N., and Platt, M. L. (2005). Risk-sensitive neurons in macaque posterior cingulate cortex. Nat. Neurosci 8, 1220-1227.
49. Miller, E. K., and Cohen, J. D. (2001). An integrative theory of prefrontal cortex function. Annu. Rev. Neurosci. 24, 167-202.
50. Montague, P. R., and Berns, G. S. (2002). Neural economics and the biological substrates of valuation. Neuron 36, 265-284.
51. Navarick, D. J., and Fantino, E. (1972). Transitivity as a property of choice. J. Exp. Anal. Behav. 18, 389-401.
52. Navarick, D. J., and Fantino, E. (1975). Stochastic transitivity and the unidimensional control of choice. Learn. Motiv. 6, 179-201.
53. Padoa-Schioppa, C., and Assad, J. A. (2006). Neurons in the orbitofrontal cortex encode economic value. Nature 441, 223-226.
54. Padoa-Schioppa, C., and Assad, J. A. (2008). The representation of economic value in the orbitofrontal cortex is invariant for changes of menu. Nat. Neurosci. 11, 95-102.
55. Paulus, M. P., Hozack, N., Zauscher, B., McDowell, J. E., Frank, L., Brown, G. G., and Braff, D. L. (2001). Prefrontal, parietal, and temporal cortex networks underlie decision-making in the presence of uncertainty. Neuroimage 13, 91-100.
56. Pesaran, B., Nelson, M. J., and Andersen, R. A. (2008). Free choice activates a decision circuit between frontal and parietal cortex. Nature 453, 406-409.
57. Pessoa, L. (2008). On the relationship between emotion and cognition. Nat. Rev. Neurosci. 9, 148-158.
58. Plassmann, H., O'Doherty, J., and Rangel, A. (2007). Orbitofrontal cortex encodes willingness to pay in everyday economic transactions. J. Neurosci. 27, 9984-9988.
59. Platt, M. L., and Glimcher, P. W. (1999). Neural correlates of decision variables in parietal cortex. Nature 400, 233-238.
60. Ploghaus, A., Tracey, I., Gati, J. S., Clare, S., Menon, R. S., Matthews, P. M., and Rawlins, J. N. (1999). Dissociating pain from its anticipation in the human brain. Science 284, 1979-1981.
61. Rangel, A., Camerer, C., and Montague, P. R. (2008). A framework for studying the neurobiology of value-based decision making. Nat. Rev. Neurosci. 9, 545-556.
62. Ridderinkhof, K. R., Ullsperger, M., Crone, E. A., and Nieuwenhuis, S. (2004). The role of the medial frontal cortex in cognitive control. Science 306, 443-447.
63. Roelofsma, P. H. M. P., and Read, D. (2000). Intransitive intertemporal choice. J. Behav. Decis. Mak. 13, 161-177.
64. Russo, J. E., and Dosher, B. A. (1983). Strategies for multiattribute binary choice. J. Exp. Psychol. Learn. Mem. Cogn. 9, 676-696.
65. Samuelson, P. A. (1938). A note on the pure theory of consumer's behavior. Economica 5, 61-71.
66. Schall, J. D., Stuphorn, V., and Brown, J. W. (2002). Monitoring and control of action by the frontal lobes. Neuron 36, 309-322.
67. Shafir, S. (1994). Intransitivity of preferences in honey bees: support for 'comparative' evaluation of foraging options. Anim. Behav. 48, 55-67.
68. Shizgal, P. (1997). Neural basis of utility estimation. Curr. Opin. Neurobiol. 7, 198-208.
69. Smith, B. W., Mitchell, D. G., Hardin, M. G., Jazbec, S., Fridberg, D., Blair, R. J., and Ernst, M. (2009). Neural substrates of reward magnitude, probability, and risk during a wheel of fortune decision-making task. Neuroimage 44, 600-609.
70. Stephens, D. W., and Krebs, J. R. (1986). Foraging Theory. Monographs in Behavior and Ecology. Princeton, NJ: University Press.
71. Sugrue, L. P., Corrado, G. S., and Newsome, W. T. (2004). Matching behavior and the representation of value in the parietal cortex. Science 304, 1782-1787.
72. Tanaka, S. C., Doya, K., Okada, G., Ueda, K., Okamoto, Y., and Yamawaki, S. (2004). Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops. Nat. Neurosci. 7, 887-893.
73. Tobler, P. N., Christopoulos, G. I., O'Doherty, J. P., Dolan, R. J., and Schultz, W. (2009). Risk-dependent reward value signal in human prefrontal cortex. Proc. Natl. Acad. Sci. U.S.A. 106, 7185-7190.
74. Tobler, P. N., O'Doherty, J. P., Dolan, R. J., and Schultz, W. (2007). Reward value coding distinct from risk attitude-related uncertainty coding in human reward systems. J. Neurophysiol. 97, 1621-1632.
75. Tremblay, L., and Schultz, W. (1999). Relative reward preference in primate orbitofrontal cortex. Nature 398, 704-708.
76. Tversky, A. (1969). Intransitivity of preferences. Psychol. Rev. 76, 31-48.
77. Varian, H. R. (1982). The nonparametric approach to demand analysis. Econometrica 50, 945-973.
78. Venkatraman, V., Payne, J. W., Bettman, J. R., Luce, M. F., and Huettel, S. A. (2009). Separate neural mechanisms underlie choices and strategic preferences in risky decision making. Neuron 62, 593-602.
79. Volz, K. G., Schooler, L. J., Schubotz, R. I., Raab, M., Gigerenzer, G., and von Cramon, D.Y. (2006). Why you think milan is larger than modena: neural correlates of the recognition heuristic. J. Cogn. Neurosci. 18, 1924-1936.
80. von Neumann, J., and Morgenstern, O. (1944). Theory of Games and Economic Behavior. Princeton, NJ: University Press.
81. Waite, T. A. (2001). Intransitive preferences in hoarding gray jays (Perisoreus canadensis). Behav. Ecol. Sociobiol. 50, 116-121.
82. Weller, J. A., Levin, I. P., Shiv, B., and Bechara, A. (2009). The effects of insula damage on decision-making for risky gains and losses. Soc. Neurosci. 4, 347-358.
83. Wittmann, M., Leland, D. S., and Paulus, M. P. (2007). Time and decision making: differential contribution of the posterior insular cortex and the striatum during a delay discounting task. Exp. Brain Res. 179, 643-653.
84. Xue, G., Lu, Z., and Bechara, A. (2009). The insular cortex and risky decision-making: is there an urge in risk taking? In Annual Meeting of the Society for Neuroscience (Chicago: Society for Neuroscience).
85. Yang, T., and Shadlen, M. N. (2007). Probabilistic reasoning by neurons. Nature 447, 1075-1080.