Review. Neuroethology of reward and decision making

Philosophical Transactions of the Royal Society B: Biological Sciences

Volumn 363, Issue 1511, 2008, Pages 3825-3835

  Watson, Karli K ^a,b   Platt, Michael L ^a,b  

^a DUKE UNIVERSITY SCHOOL OF MEDICINE   (United States)

^b DUKE UNIVERSITY   (United States)

Author keywords

Foraging; Game theory; Neuroeconomics; Neuroethology; Risk; Social reward

Indexed keywords

ANIMAL; COGNITION; DECISION MAKING; EVOLUTIONARY BIOLOGY; FITNESS; FORAGING BEHAVIOR; GAME THEORY; NATURAL SELECTION; NEUROLOGY; OPTIMIZATION; RISK ASSESSMENT;

ANIMALIA;

ANIMAL; ARTICLE; DECISION MAKING; ETHOLOGY; EVOLUTION; HUMAN; PHYSIOLOGY; REWARD; SOCIAL BEHAVIOR;

ANIMALS; DECISION MAKING; ETHOLOGY; EVOLUTION; HUMANS; REWARD; SOCIAL BEHAVIOR;

EID: 57349141888     PISSN: 09628436     EISSN: None     Source Type: Journal    
DOI: 10.1098/rstb.2008.0159     Document Type: Review

References (104)

1. Aharon, I., Etcoff, N., Ariely, D., Chabris, C. F., O'Connor, E. & Breiter, H. C. 2001 Beautiful faces have variable reward value: fMRI and behavioral evidence. Neuron 32, 537-551.
2. Anderson, O. 1984 Optimal foraging by largemouth bass in structured environments. Ecology 65, 851-861.
3. Aston-Jones, G. & Cohen, J. D. 2005 An integrative theory of locus coeruleus-norepinephrine function: adaptive gain and optimal performance. Annu. Rev. Neurosci. 28, 403-450.
4. Aston-Jones, G., Rajkowski, J. & Cohen, J. 1999 Role of locus coeruleus in attention and behavioral flexibility. Biol. Psychiatry 46, 1309-1320.
5. Barnard, C. J., Brown, C. A. J. & Gray-Wallis, J. 1983 Time and energy budgets and competition in the common shrew (Sorex araneus L). Behav. Ecol. Sociobiol. 13, 13-18.
6. Barraclough, D. J., Conroy, M. L. & Lee, D. 2004 Prefrontal cortex and decision making in a mixed-strategy game. Nat. Neurosci. 7, 404-410.
7. Bateson, M. & Kacelnik, A. 1998 Risk-sensitive foraging: decision making in variable environments. In Cognitive ecology: the evolutionary ecology of information processing and decision making (ed. R. Dukas), pp. 297-341. Chicago, IL: The University of Chicago Press.
8. Belovsky, G. E. 1978 Diet optimization in a generalist herbivore-moose. Theor. Popul. Biol. 14, 105-134.
9. Bernoulli, D. 1954 (1738) Exposition of a new theory on the measurement of risk. Econometrica 22, 23-36.
10. Bickel, W. K., Giordano, L. A. & Badger, G. J. 2004 Risksensitive foraging theory elucidates risky choices made by heroin addicts. Addiction 99, 855-861.
11. Blood, A. J. & Zatorre, R. J. 2001 Intensely pleasurable responses to music correlate with activity in brain regions implicated in reward and emotion. Proc. Natl Acad. Sci. USA 98, 11 818-11 823.
12. Bray, S. & O'Doherty, J. 2007 Neural coding of rewardprediction error signals during classical conditioning with attractive faces. J. Neurophysiol. 97, 3036-3045.
13. Caraco, T. 1981 Energy budgets, risk and foraging preferences in dark-eyed juncos ( Junco hyemalis). Behav. Ecol. Sociobiol. 8, 213-217.
14. Caraco, T., Martindale, S. & Whittam, T. S. 1980 An empirical demonstration of risk-sensitive foraging preferences. Anim. Behav. 28, 820-830.
15. Carlezon, W. A. & Chartoff, E. H. 2007 Intracranial selfstimulation (ICSS) in rodents to study the neurobiology of motivation. Nat. Protocols 2, 2987-2995.
16. Cartar, R. V. & Dill, L. M. 1990 Colony energy-requirements affect the foraging currency of bumble bees. Behav. Ecol. Sociobiol. 27, 377-383.
17. Charnov, E. L. 1976 Optimal foraging, marginal value theorem. Theor. Popul. Biol. 9, 129-136.
18. Cheney, D. L. & Seyfarth, R. M. 1990 How monkeys see the world. Chicago, IL: University of Chicago Press.
19. Cosmides, L. & Tooby, J. 1994 Better than rational - evolutionary psychology and the invisible hand. Am. Econ. Rev. 84, 327-332.
20. Cowie, R. J. 1977 Optimal foraging in great tits (Parus major). Nature 268, 137-139.
21. Davies, N. B. 1977 Prey selection and search strategy of spotted flycatcher (Muscicapa striata) - field-study on optimal foraging. Anim. Behav. 25, 1016-1033.
22. Deaner, R. O., Khera, A. V. & Platt, M. L. 2005 Monkeys pay per view: adaptive valuation of social images by rhesus macaques. Curr. Biol. 15, 543-548.
23. de Quervain, D. J. et al. 2004 The neural basis of altruistic punishment. Science 305, 1254-1258.
24. Diaz-Fleischer, F. 2005 Predatory behaviour and preycapture decision-making by the web-weaving spider Micrathena sagittata. Can. J. Zool. Revue Canadienne De Zoologie 83, 268-273.
25. Dixson, A. F. 1983 Observations on the evolution and behavioral significance of sexual skin in female primates. Adv. Stud. Behav. 13, 63-106.
26. Domb, L. G. & Pagel, M. 2001 Sexual swellings advertise female quality in wild baboons. Nature 410, 204-206.
27. Fiorillo, C. D., Tobler, P. N. & Schultz, W. 2003 Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299, 1898-1902.
28. Foote, S. L., Bloom, F. E. & Aston-Jones, G. 1983 Nucleus locus ceruleus: new evidence of anatomical and physiological specificity. Physiol. Rev. 63, 844-914.
29. Frank, R. A. & Stutz, R. M. 1984 Self-deprivation - a review. Psychol. Bull. 96, 384-393.
30. Ghazanfar, A. A. & Santos, L. R. 2004 Primate brains in the wild: the sensory bases for social interactions. Nat. Rev. Neurosci. 5, 603-616.
31. Glimcher, P. W. 2003 Decisions, uncertainty, and the brain: the science of neuroeconomics. Cambridge, MA: The MIT Press.
32. Gold, J. I. & Shadlen, M. N. 2001 Neural computations that underlie decisions about sensory stimuli. Trends Cogn. Sci. 5, 10-16.
33. Goss-Custard, J. D. 1977 Responses of redshank, Tringa totanus, to absolute and relative densities of 2 prey species. J. Anim. Ecol. 46, 867-874.
34. Hadland, K. A., Rushworth, M. F. S., Gaffan, D. & Passingham, R. E. 2003 The effect of cingulate lesions on social behaviour and emotion. Neuropsychologia 41, 919-931.
35. Harvey, S. M. 1987 Female sexual-behavior - fluctuations during the menstrual-cycle. J. Psychosom. Res. 31, 101-110.
36. Haselton, M. G., Mortezaie, M., Pillsworth, E. G., Bleske-Rechek, A. & Frederick, D. A. 2007 Ovulatory shifts in human female ornamentation: near ovulation, women dress to impress. Horm. Behav. 51, 40-45.
37. Havlicek, J., Dvorakova, R., Bartoš, L. & Flegr, J. 2006 Nonadvertized does not mean concealed: body odour changes across the human menstrual cycle. Ethology 112, 81-90.
38. Hawkes, K., Hill, K. & O'Connell, J. 1982 Why hunters gather - optimal foraging and the ache of eastern Paraguay. Am. Ethnol. 9, 379-398.
39. Hinde, R. A. 1982 Ethology: its nature and relations with other sciences. NewYork, NY; Oxford, UK: Oxford University Press.
40. Hornak, J., O'Doherty, J., Rolls, E. T., Morris, R. G., O'Doherty, J., Bullock, P. R. & Polkey, C. E. 2004 Reward-related reversal learning after surgical excisions in orbito-frontal or dorsolateral prefrontal cortex in humans. J. Cognit. Neurosci. 16, 463-478.
41. Hrdy, S. B. & Whitten, P. L. 1987 The patterning of sexual activity among primates. In Primate societies (eds B. Smuts, D. L. Cheney, R. M. Seyfarth, R. Wrangham & T. Struhsaker), pp. 370-384. Chicago, IL: University of Chicago Press.
42. Hsu, M., Bhatt, M., Adolphs, R., Tranel, D. & Camerer, C. F. 2005 Neural systems responding to degrees of uncertainty in human decision-making. Science 310, 1680-1683.
43. Huettel, S. A., Song, A. W. & McCarthy, G. 2005 Decisions under uncertainty: probabilistic context influences activation of prefrontal and parietal cortices. J. Neurosci. 25, 3304-3311.
44. Huettel, S. A., Stowe, C. J., Gordon, E. M., Warner, B. T. & Platt, M. L. 2006 Neural signatures of economic preferences for risk and ambiguity. Neuron 49, 765-775.
45. Ishai, A. 2007 Sex, beauty and the orbitofrontal cortex. Int. J. Psychophysiol. 63, 181-185.
46. Ito, M., Takatsuru, S. & Saeki, D. 2000 Choice between constant and variable alternatives by rats: effects of different reinforcer amounts and energy budgets. J. Exp. Anal. Behav. 73, 79-92.
47. Jones, B. C., Little, A. C., Penton-Voak, I. S., Tiddeman, B. P., Burt, D. M. & Perrett, D. I. 2001 Facial symmetry and judgements of apparent health - support for a "good genes" explanation of the attractiveness-symmetry relationship. Evol. Hum. Behav. 22, 417-429.
48. Kacelnik, A. & Bateson, M. 1996 Risky theories - the effects of variance on foraging decisions. Am. Zool. 36, 402-434.
49. Kim, J. N. & Shadlen, M. N. 1999 Neural correlates of a decision in the dorsolateral prefrontal cortex of the macaque. Nat. Neurosci. 2, 176-185.
50. Klein, J. T., Deaner, R. O. & Platt, M. L. 2008 Neural correlates of social target value in macaque parietal cortex. Curr. Biol. 18, 419-424.
51. Krebs, J. R. & Davies, N. B. 1993 An introduction to behavioural ecology. Oxford, UK: Wiley-Blackwell.
52. Krebs, J. R., Erichsen, J. T., Webber, M. I. & Charnov, E. L. 1977 Optimal prey selection in great tit (Parus major). Anim. Behav. 25, 30-38.
53. Kringelbach, M. L. & Rolls, E. T. 2003 Neural correlates of rapid reversal learning in a simple model of human social interaction. Neuroimage 20, 1371-1383.
54. Lee, D., Rushworth, M. F. S., Walton, M. E., Watanabe, M. & Sakagami, M. 2007 Functional specialization of the primate frontal cortex during decision making. J. Neurosci. 27, 8170-8173.
55. Lima, S. L. 1983 Downy woodpecker foraging behavior - foraging by expectation and energy-intake rate. Oecologia 58, 232-237.
56. MacArthur, R. H. & Pianka, E. R. 1966 On optimal use of a patchy environment. Am. Nat. 100, 603-609.
57. Maestripieri, D. 2007 Macachiavellian intelligence: how rhesus macaques and humans have conquered the world. Chicago, IL: University Of Chicago Press.
58. Manning, J. T., Scutt, D., Whitehouse, G. H., Leinster, S. J. &Walton, J. M. 1996 Asymmetry and the menstrual cycle in women. Ethol. Sociobiol. 17, 129-143.
59. Matteo, S. & Rissman, E. F. 1984 Increased sexual-activity during the midcycle portion of the human menstrualcycle. Horm. Behav. 18, 249-255.
60. Maynard Smith, J. & Price, G. R. 1973 The logic of animal conflict. Nature 246, 15-18.
61. McCoy, A. N. & Platt, M. L. 2005 Risk-sensitive neurons in macaque posterior cingulate cortex. Nat. Neurosci. 8, 1220-1227.
62. Meunier, M., Bachevalier, J. & Mishkin, M. 1997 Effects of orbital frontal and anterior cingulate lesions on object and spatial memory in rhesus monkeys. Neuropsychologia 35, 999-1015.
63. Miller, G., Tybur, J. M. & Jordan, B. D. 2007 Ovulatory cycle effects on tip earnings by lap dancers: economic evidence for human estrus? Evol. Hum. Behav. 28, 375-381.
64. Milton, K. 1979 Factors influencing leaf choice by howler monkeys - test of some hypotheses of food selection by generalist herbivores. Am. Nat. 114, 362-378.
65. Mobbs, D., Greicius, M. D., Abdel-Azim, E., Menon, V. & Reiss, A. L. 2003 Humor modulates the mesolimbic reward centers. Neuron 40, 1041-1048.
66. Montague, P. R. & Berns, G. S. 2002 Neural economics and the biological substrates of valuation. Neuron 36, 265-284.
67. Nunn, C. L. 1999 The evolution of exaggerated sexual swellings in primates and the graded-signal hypothesis. Anim. Behav. 58, 229-246.
68. O'Doherty, J., Kringelbach, M. L., Rolls, E. T., Hornak, J. & Andrews, C. 2001 Abstract reward and punishment representations in the human orbitofrontal cortex. Nat. Neurosci. 4, 95-102.
69. O'Doherty, J., Winston, J., Critchley, H. D., Perrett, D. I., Burt, D. M. & Dolan, R. J. 2003 Beauty in a smile: the role of medial orbitofrontal cortex in facial attractiveness. Neuropsychologia 41, 147-155.
70. Olds, J. & Milner, P. 1954 Positive reinforcement produced by electrical stimulation of septal area and other regions of rat brain. J. Comp. Physiol. Psychol. 47, 419-427.
71. Pietras, C. J., Locey, M. L. & Hackenberg, T. D. 2003 Human risky choice under temporal constraints: tests of an energy-budget model. J. Exp. Anal. Behav. 80, 59-75.
72. Platt, M. L. & Glimcher, P. W. 1999 Neural correlates of decision variables in parietal cortex. Nature 400, 233-238.
73. Rhodes, G. 2006 The evolutionary psychology of facial beauty. Annu. Rev. Psychol. 57, 199-226.
74. Rhodes, L., Argersinger, M. E., Gantert, L. T., Friscino, B. H., Hom, G., Pikounis, B., Hess,D. L. & Rhodes,W. L. 1997 Effects of administration of testosterone, dihydrotestosterone, oestrogen and fadrozole, an aromatase inhibitor, on sex skin colour in intact male rhesus macaques. J. Reprod. Fertil. 111, 51-57.
75. Rilling, J., Gutman, D., Zeh, T. R., Pagnoni, G., Berns, G. S. & Kilts, C. D. 2002 A neural basis for social cooperation. Neuron 35, 395-405.
76. Robbins, T. W. & Everitt, B. J. 1996 Neurobehavioural mechanisms of reward and motivation. Curr. Opin. Neurobiol. 6, 228-236.
77. Roberts, S. C., Havlicek, J., Flegr, J., Hruskova, M., Little, A. C., Jones, B. C., Perrett,D. I. & Petrie, M. 2004 Female facial attractiveness increases during the fertile phase of the menstrual cycle. Proc. R. Soc. B 271, S270-S272.
78. Routtenberg, A. & Lindy, J. 1965 Effects of availability of rewarding septal and hypothalamic stimulation on bar pressing for food under conditions of deprivation. J. Comp. Physiol. Psychol. 60, 158-161.
79. Rudebeck, P. H., Buckley,M. J.,Walton, M. E. & Rushworth, M. F. S. 2006 A role for the macaque anterior cingulate gyrus in social valuation. Science 313, 1310-1312.
80. Sanfey, A. G., Loewenstein, G., McClure, S. M. & Cohen, J. D. 2006 Neuroeconomics: cross-currents in research on decision-making. Trends Cognit. Sci. 10, 108-116.
81. Schultz, W. 2000 Multiple reward signals in the brain. Nat. Rev. Neurosci. 1, 199-207.
82. Schultz, W. & Dickinson, A. 2000 Neuronal coding of prediction errors. Annu. Rev. Neurosci. 23, 473-500.
83. Schultz, W., Dayan, P. & Montague, P. R. 1997 A neural substrate of prediction and reward. Science 275, 1593-1599.
84. Schultz, W., Tremblay, L. & Montague, P. R. 2000 Reward processing in primate orbitofrontal cortex and basal ganglia. Cereb. Cortex 10, 272-284.
85. Seo, H. & Lee,D. 2007 Temporal filtering of reward signals in the dorsal anterior cingulate cortex during a mixedstrategy game. J. Neurosci. 27, 8366-8377.
86. Shima, K. & Tanji, J. 1998 Role for cingulate motor area cells in voluntary movement selection based on reward. Science 282, 1335-1338.
87. Singer, T., Kiebel, S. J., Winston, J. S., Dolan, R. J. & Frith, C. D. 2004 Brain responses to the acquired moral status of faces. Neuron 41, 653-662.
88. Singh, D. & Bronstad, P. M. 2001 Female body odour is a potential cue to ovulation. Proc. R. Soc. B 268, 797-801.
89. Skinner, B. F. 1938 The behavior of organisms. New York, NY: Appleton-Century-Crofts.
90. Small, D. M., Zatorre, R. J., Dagher, A., Evans, A. C. & Jones-Gotman, M. 2001 Changes in brain activity related to eating chocolate - from pleasure to aversion. Brain 124, 1720-1733.
91. Smith, J. M. 1982 Evolution and the theory of games. Cambridge, UK: Cambridge University Press.
92. Soler, C., Nunez, M., Gutierrez, R., Nunez, J., Medina, P., Sancho, M., Alvarez, J. & Nunez, A. 2003 Facial attractiveness in men provides clues to semen quality. Evol. Hum. Behav. 24, 199-207.
93. Stephens, D. W. & Krebs, J. R. 1986 Foraging theory. Princeton, NJ: Princeton University Press.
94. Sugrue, L. P., Corrado, G. S. & Newsome, W. T. 2004 Matching behavior and the representation of value in the parietal cortex. Science 304, 1782-1787.
95. Tobler, P. N., Fiorillo, C. D. & Schultz, W. 2005 Adaptive coding of reward value by dopamine neurons. Science 307, 1642-1645.
96. Trivers, R. L. 2002 Natural selection and social theory: selected papers of Robert L. Trivers. Oxford, UK: Oxford University Press.
97. Van Hoof, J. A. R. A. M. 1967 The facial displays of the catarrhine monkeys and apes. In Primate ethology (ed. D. Morris), pp. 7-68. Chicago, IL: Aldine.
98. Vandenberghe, P. L. & Frost, P. 1986 Skin color preference, sexual dimorphism and sexual selection - a case of gene culture coevolution. Ethnic Racial Stud. 9, 87-113.
99. Waddington, K.D. & Holden, L. R. 1979 Optimal foraging - flower selection by bees. Am. Nat. 114, 179-196.
100. Waitt, C. & Little, A. C. 2006 Preferences for symmetry in conspecific facial shape among Macaca mulatta. Int. J. Primatol. 27, 133-145.
101. Waitt, C., Little, A. C., Wolfensohn, S., Honess, P., Brown, A. P., Buchanan-Smith, H. M. & Perret, D. I. 2003 Evidence from rhesus macaques suggests that male coloration plays a role in female primate mate choice. Proc. R. Soc. B 270, S144-S146.
102. Watson, K. K., Matthews, B. J. & Allman, J. M. 2007 Brain activation during sight gags and language-dependent humor. Cereb. Cortex 17, 314-324.
103. Winston, J. S., Strange, B. A., O'Doherty, J. & Dolan, R. J. 2002 Automatic and intentional brain responses during evaluation of trustworthiness of faces. Nat. Neurosci. 5, 277-283.
104. Young, R. J., Clayton, H. & Barnard, C. J. 1990 Risk-sensitive foraging in bitterlings, Rhodeus sericus-effects of food requirement and breeding site quality. Anim. Behav. 40, 288-297.