Neural coding of reward-prediction error signals during classical conditioning with attractive faces

Journal of Neurophysiology

Volumn 97, Issue 4, 2007, Pages 3036-3045

  Bray, Signe ^a   O'Doherty, John ^a  

^a CALIFORNIA INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; BEHAVIOR; CONDITIONED REFLEX; CONTROLLED STUDY; CORRELATION ANALYSIS; FACE; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; LEARNING; MALE; MONEY; NERVE CELL; PREDICTION; PRIORITY JOURNAL; QUESTIONNAIRE; REACTION TIME; REGRESSION ANALYSIS; REWARD; SCORING SYSTEM; SEXUAL ORIENTATION; SIGNAL TRANSDUCTION; STIMULUS RESPONSE; VISUAL STIMULATION;

ADOLESCENT; ADULT; CONDITIONING, CLASSICAL; DATA INTERPRETATION, STATISTICAL; FACE; FEMALE; FRACTALS; HUMANS; LEARNING; MAGNETIC RESONANCE IMAGING; MALE; MODELS, NEUROLOGICAL; NEOSTRIATUM; PHOTIC STIMULATION; PSYCHOMOTOR PERFORMANCE; QUESTIONNAIRES; REACTION TIME; REWARD; SEXUAL BEHAVIOR;

EID: 34147146369     PISSN: 00223077     EISSN: 15221598     Source Type: Journal    
DOI: 10.1152/jn.01211.2006     Document Type: Article

References (55)

1. Adolphs R. The neurobiology of social cognition. Curr Opin Neurobiol 11: 231-239, 2001.
2. Aharon I, Etcoff N, Ariely D, Chabris CF, O'Connor E, Breiter HC. Beautiful faces have variable reward value: fMRI and behavioral evidence. Neuron 32: 537-551, 2001.
3. Andersson JL, Hutton C, Ashburner J, Turner R, Friston K. Modeling geometric deformations in EPI time series. Neuroimage 13: 903-919, 2001.
4. Baeyens F, Hermans D, Eelen P. The role of CS-US contingency in human evaluative conditioning. Behav Res Ther 31: 731-737, 1993.
5. Baker MJ, Churchill GAJ. The impact of physically attractive models on advertising evaluations. J Market Res XIV: 538-555, 1977.
6. Bitterman ME, Reed P, Krauskopf J. The effect of the duration of the unconditioned stimulus upon conditioning and extinction. Am J Psychol 65: 256-262, 1952.
7. Blair RJR. Facial expressions, their communicatory functions and neurocognitive substrates. Philos Trans R Soc Lond B Biol Sci 358: 561-572, 2003.
8. Buchel C. Brain systems mediating aversive conditioning: an event-related fMRI study. Neuron 20: 947-957, 1998.
9. Cox SM, Andrade A, Johnsrude IS. Learning to like: a role for human orbitofrontal cortex in conditioned reward. J Neurosci 25: 2733-2740, 2005.
10. Critchley HD, Mathias CJ, Dolan RJ. Fear conditioning in humans: the influence of awareness and autonomic arousal on functional neuroanatomy. Neuron 33: 653-663, 2002.
11. Cunningham MR, Roberts AR, Barbee AP, Druen PB, Wu C-H. Their ideas of beauty are, on the whole, the same as ours: consistency and variability on the cross-cultural perception of female physical attractiveness. J Personality Social Psychol 68: 261-279, 1995.
12. Deichmann R, Gottfried JA, Hutton C, Turner R. Optimized EPI for fMRI studies of the orbitofrontal cortex. Neuroimage 19: 430-441, 2003.
13. Delgado MR, Nystrom LE, Fissell C, Noll DC, Fiez JA. Tracking the hemodynamic responses to reward and punishment in the striatum. J Neurophysiol 84: 3072-3077, 2000.
14. Dion K, Bersheid E, Walster E. What is beautiful is good. J Personality Social Psychol 24: 285-290, 1972.
15. Dipboye RL, Arvey RD, Terpstra DE. Sex and physical attractiveness of raters and applicants as determinants of resume evaluations. J Appl Psychol 4: 288-294, 1977.
16. Folkman S, Lazarus RS, Dunkel-Schetter C, DeLongis A, Gruen RJ. Dynamics of a stressful encounter: cognitive appraisal, coping, and encounter outcomes. J Personality Social Psychol 50: 992-1003, 1986.
17. Friston KJ, Ashburner J, Poline JB, Frith CD, Heather JD, Frackowiak RS. Spatial registration and normalisation of images. Hum Brain Mapp 2: 165-189, 1995.
18. Garavan H, Pendergrass JC, Ross TJ, Stein EA, Risinger RC. Amygdala response to both positively and negatively valenced stimuli. Neuroreport 12: 2779-2783, 2001.
19. Gorn GJ, Goldberg ME, Basu K. Mood, awareness, and product evaluation. J Consum Psychol 2: 237-256, 1993.
20. Gottfried JA, O'Doherty JP, Dolan RJ. Appetitive and aversive olfactory learning in humans studied using event-related functional magnetic resonance imaging. J Neurosci 22: 10829-10837, 2002.
21. Gottfried JA, O'Doherty J, Dolan RJ. Encoding predictive reward value in human amygdala and orbitofrontal cortex. Science 301: 1104-1107, 2003.
22. Hamann SB, Ely TD, Grafton ST, Kilts CD. Amygdala activity related to enhanced memory for pleasant and aversive stimuli. Nat Neurosci 2: 289-293, 1999.
23. Hamermesh DS, Biddle JE. Beauty and the labor market. Am Econom Rev 84: 1174-1194, 1994.
24. Haxby JV, Hoffman EA, Gobbini IM. The distributed human neural system for face perception. Trends Cogn Sci 4: 223-233, 2000.
25. Hollerman JR, Schultz W. Dopamine neurons report an error in the temporal prediction of reward during learning. Nat Neurosci 1: 304-309, 1998.
26. Ishai A, Schmidt CF, Boseiger P. Face perception is mediated by a distributed cortical network. Brain Res Bull 67: 87-93, 2005.
27. Johnsrude IS, Owen AM, White NM, Zhao WV, Bohbot V. Impaired preference conditioning after anterior temporal lobe resection in humans. J Neurosci 20: 2649-2656, 2000.
28. Kanwisher N, McDermott J, Chun M. The fusiform face area: a module in human extrastriate cortex specialized for the perception of faces. J Neurosci 17: 4302-4311, 1997.
29. Kawai N, Imada H. Between- and within-subject effects of US duration on conditioned suppression in rats: contrast makes otherwise unnoticed duration dimension stand out. Learn Motiv 27: 92-111, 1996.
30. Kim H, Shimojo S, O'Doherty JP. Is avoiding an aversive outcome rewarding? Neural substrates of avoidance learning in the human brain. PLoS Biol 4: 1453-1461, 2006.
31. Knutson B, Taylor J, Kaufman M, Peterson R, Glover G. Distributed neural representation of expected value. J Neurosci 25: 4806-4812, 2005.
32. Kranz F, Ishai A. Face perception is modulated by sexual preference. Curr Biol 16: 63-68, 2006.
33. LaBar KDM. Human amygdala activation during conditioned fear acquisition and extinction: a mixed-trial fMRI study. Neuron 20: 937-945, 1998.
34. McClure SM, Berns GS, Montague PR. Temporal prediction errors in a passive learning task activate human striatum. Neuron 38: 339-346, 2003.
35. O'Doherty JP, Buchanan TW, Seymour B, Dolan RJ. Predictive neural coding of reward preference involves dissociable responses in human ventral midbrain and ventral striatum. Neuron 49: 157-166, 2006.
36. O'Doherty JP, Dayan P, Friston K, Critchley H, Dolan RJ. Temporal difference models and reward-related learning in the human brain. Neuron 38: 329-337, 2003a.
37. O'Doherty J, Dayan P, Schultz J, Deichmann R, Friston K, Dolan RJ. Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science 304: 452-454, 2004.
38. O'Doherty J, Winston J, Critchley H, Perrett D, Burt DM, Dolan RJ. Beauty in a smile: the role of medial orbitofrontal cortex in facial attractiveness. Neuropsychologia 41: 147-155, 2003b.
39. Olson IR, Marshuetz C. Facial attractiveness is appraised at a glance. Emotion 5: 186-201, 2005.
40. Paton JJ, Belova MA, Morrison SE, Salzman CD. The primate amygdala represents the positive and negative value of visual stimuli during learning. Nature 439: 865-870, 2006.
41. Pessiglione M, Seymour B, Flandin G, Dolan RJ, Frith CD. Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans. Nature 442: 1042-1045, 2006.
42. Rescorla RA, Wagner AR. A theory of Pavlovian conditioning: Variations in effectiveness of reinforcement and nonreinforcement. In: Classical Conditioning II: Current Research and Theory, edited by Black AH, Prokasy WF. New York: Appleton Century-Crofts, 1972.
43. Rhodes G. The evolutionary psychology of facial beauty. Annu Rev Psychol 57: 199-226, 2006.
44. Rhodes G, Simmons LW, Peters M. Attractiveness and sexual behavior: does attractiveness enhance mating success? Evol Hum Behav 26: 186-201, 2005.
45. Rolls ET. The orbitofrontal cortex and reward. Cereb Cortex 10: 284-294, 2000.
46. Schultz W, Dayan P, Montague PR. A neural substrate of prediction and reward. Science 275: 1593-1599, 1997.
47. Seymour B, O'Doherty JP, Dayan P, Koltzenburg M, Jones AK, Dolan RJ, Friston KJ, Frackowiak RS. Temporal difference model describes higher-order learning in humans. Nature 429: 664-667, 2004.
48. Smith GH, Engel R. Influence of a female model on perceived characteristics of an automobile. 76th Annual Convention American Psychological Association, San Francisco, CA, 1968.
49. Sutton RS. Learning to predict by the methods of temporal differences. Machine Learn 3: 9-44, 1988.
50. Sutton RS, Barto AG. Time derivative models of Pavlovian reinforcement. In: Learning and Computational Neuroscience: Foundations of adaptive networks, edited by Gabriel M, Moore J. Cambridge, MA: MIT Press, 1990, p. 497-537.
51. Tait RW, Kehoe EJ, Gormezano I. Effects of unconditioned stimulus-duration on classical-conditioning of the rabbits nictitating-membrane response. J Exp Psychol Anim Behav Process 9: 91-101, 1983.
52. Thornhill H, Gangestad SW. Facial attractiveness. Trends Cogn Sci 3: 452-460, 1999.
53. Tobler PN, O'Doherty JP, Dolan RJ, Schultz W. Human neural learning depends on reward prediction errors in the blocking paradigm. J Neurophysiol 95: 301-310, 2006.
54. Whalen PJ, Rauch SL, Etcoff NL, McInerney SC, Lee MB, Jenike MA. Masked presentations of emotional facial expressions modulate amygdala activity without explicit knowledge. J Neurosci 18: 411-418, 1998.
55. Winston JS, O'Doherty J, Dolan RJ. Common and distinct neural responses during direct and incidental processing of multiple facial emotions. Neuroimage 20: 84-97, 2003.