Behavioral and neural properties of social reinforcement learning

Journal of Neuroscience

Volumn 31, Issue 37, 2011, Pages 13039-13045

  Jones, Rebecca M ^a   Somerville, Leah H ^a   Li, Jian ^b   Ruberry, Erika J ^a   Libby, Victoria ^a   Glover, Gary ^c   Voss, Henning U ^a   Ballon, Douglas J ^a   Casey, B J ^a  

^a WEILL CORNELL MEDICAL COLLEGE   (United States)

^b NEW YORK UNIVERSITY   (United States)

^c STANFORD UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ANTERIOR CINGULATE; ARTICLE; ASSOCIATION; BEHAVIORAL SCIENCE; BRAIN FUNCTION; CORPUS STRIATUM; CORRELATIONAL STUDY; EVENT RELATED POTENTIAL; FEMALE; FRONTAL CORTEX; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; MALE; NEUROIMAGING; NEUROMODULATION; NORMAL HUMAN; ORBITAL CORTEX; PRIORITY JOURNAL; REINFORCEMENT; RESPONSE TIME; SOCIAL LEARNING; TASK PERFORMANCE;

ADOLESCENT; ADULT; BRAIN; BRAIN MAPPING; CONDITIONING, OPERANT; FACIAL EXPRESSION; FEMALE; HUMANS; MAGNETIC RESONANCE IMAGING; MALE; PEER GROUP; PHOTIC STIMULATION; PSYCHOMOTOR PERFORMANCE; REINFORCEMENT (PSYCHOLOGY); SOCIAL BEHAVIOR; VISUAL PERCEPTION;

EID: 80052957741     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.2972-11.2011     Document Type: Article

References (53)

1. Alexander GE, DeLong MR, Strick PL (1986) Parallel organization of functionally segregated circuits linking basal ganglia and cortex. Annu Rev Neurosci 9:357-381.
2. Bandura A, Walters RH (1963) Social learning and personality development. New York: Holt, Rinehart and Winston.
3. Baumeister RF, Leary MR (1995) The need to belong: desire for interpersonal attachments as a fundamental human motivation. Psychol Bull 117:497-529.
4. Berns GS, McClure SM, Pagnoni G, Montague PR (2001) Predictability modulates human brain response to reward. J Neurosci 21:2793-2798.
5. Botvinick M, Nystrom LE, Fissell K, Carter CS, Cohen JD (1999) Conflict monitoring versus selection-for-action in anterior cingulate cortex. Nature 402:179-181.
6. Botvinick MM, Cohen JD, Carter CS (2004) Conflict monitoring and anterior cingulate cortex: an update. Trends Cogn Sci 8:539-546.
7. Bray S, O'Doherty J (2007) Neural coding of reward-prediction error signals during classical conditioning with attractive faces. J Neurophysiol 97:3036-3045.
8. Cox RW (1996) AFNI: Software for analysis and visualization of functional magnetic resonance neuroimages. Comput Biomed Res 29:162-173.
9. D'Ardenne K, McClure SM, Nystrom LE, Cohen JD (2008) BOLD responses reflecting dopaminergic signals in the human ventral tegmental area. Science 319:1264-1267.
10. Daw ND, Doya K (2006) The computational neurobiology of learning and reward. Curr Opin Neurobiol 16:199-204.
11. Daw ND, O'Doherty JP, Dayan P, Seymour B, Dolan RJ (2006) Cortical substrates for exploratory decisions in humans. Nature 441:876-879.
12. Eisenberger NI, Lieberman MD, Williams KD (2003) Does rejection hurt? An FMRI study of social exclusion. Science 302:290-292.
13. Fiorillo CD, Tobler PN, Schultz W (2003) Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299:1898-1902.
14. First MB, Spitzer RL, Gibbon M, Williams JB (2007) Structured Clinical Interview for DSM-IV-TR Axis I Disorders: non-patient edition (SCID-I/NP, 1/2007 revision). New York: Biometrics Research, New York State Psychiatric Institute.
15. Galvan A, Hare TA, Parra CE, Penn J, Voss H, Glover G, Casey BJ (2006) Earlier development of the accumbens relative to orbitofrontal cortex might underlie risk-taking behavior in adolescents. J Neurosci 26:6885-6892.
16. Gardner M, Steinberg L (2005) Peer influence on risk taking, risk preference, and risky decision making in adolescence and adulthood: an experimental study. Dev Psychol 41:625-635.
17. Glover GH, Thomason ME (2004) Improved combination of spiral-in/out images for BOLD fMRI. Magn Reson Med 51:863-868.
18. Güroǧlu B, Haselager GJ, van Lieshout CF, Takashima A, Rijpkema M, Fernández G (2008) Why are friends special? Implementing a social interaction simulation task to probe the neural correlates of friendship. Neuroimage 39:903-910.
19. Guyer AE, McClure-Tone EB, Shiffrin ND, Pine DS, Nelson EE (2009) Probing the neural correlates of anticipated peer evaluation in adolescence. Child Dev 80:1000-1015.
20. Haber SN, Knutson B (2010) The reward circuit: linking primate anatomy and human imaging. Neuropsychopharmacology 35:4-26.
21. Hare TA, Camerer CF, Knoepfle DT, Rangel A (2010) Value computations in ventral medial prefrontal cortex during charitable decision making incorporate input from regions involved in social cognition. J Neurosci 30:583-590.
22. Harris LT, Fiske ST (2010) Neural regions that underlie reinforcement learning are also active for social expectancy violations. Soc Neurosci 5:76-91.
23. Hester R, Murphy K, Brown FL, Skilleter AJ (2010) Punishing an error improves learning: the influence of punishment magnitude on error-related neural activity and subsequent learning. J Neurosci 30:15600-15607.
24. King-Casas B, Tomlin D, Anen C, Camerer CF, Quartz SR, Montague PR (2005) Getting to know you: reputation and trust in a two-person economic exchange. Science 308:78-83.
25. Klucharev V, Hytönen K, Rijpkema M, Smidts A, Fernández G (2009) Reinforcement learning signal predicts social conformity. Neuron 61:140-151.
26. Knutson B, Taylor J, Kaufman M, Peterson R, Glover G (2005) Distributed neural representation of expected value. J Neurosci 25:4806-4812.
27. Li J, Daw ND (2011) Signals in human striatum are appropriate for policy update rather than value prediction. J Neurosci 31:5504-5511.
28. Li J, Delgado MR, Phelps EA (2011) How instructed knowledge modulates the neural systems of reward learning. Proc Natl Acad Sci U S A 108:55-60.
29. Lin A, Adolphs R, Rangel A (2011) Social and monetary reward learning engage overlapping neural substrates. Soc Cogn Affect Neurosci. Advance online publication. Retrieved March 22, 2011. doi:10.1093/scan/nsr006.
30. Liu X, Powell DK, Wang H, Gold BT, Corbly CR, Joseph JE (2007) Functional dissociation in frontal and striatal areas for processing of positive and negative reward information. J Neurosci 27:4587-4597.
31. McClure SM, Berns GS, Montague PR (2003) Temporal prediction errors in a passive learning task activate human striatum. Neuron 38:339-346.
32. O'Doherty JP (2007) Lights, camembert, action! The role of human orbito-frontal cortex in encoding stimuli, rewards, and choices. Ann N Y Acad Sci 1121:254-272.
33. O'Doherty JP, Dayan P, Friston K, Critchley H, Dolan RJ (2003) Temporal difference models and reward-related learning in the human brain. Neuron 38:329-337.
34. O'Doherty JP, Buchanan TW, Seymour B, Dolan RJ (2006) Predictive neural coding of reward preference involves dissociable responses in human ventral midbrain and ventral striatum. Neuron 49:157-166.
35. Palminteri S, Boraud T, Lafargue G, Dubois B, Pessiglione M (2009) Brain hemispheres selectively track the expected value of contralateral options. J Neurosci 29:13465-13472.
36. Phan KL, Sripada CS, Angstadt M, McCabe K (2010) Reputation for reciprocity engages the brain reward center. Proc Natl Acad Sci U S A 107:13099-13104.
37. Redcay E, Dodell-Feder D, Pearrow MJ, Mavros PL, Kleiner M, Gabrieli JD, Saxe R (2010) Live face-to-face interaction during fMRI: a new tool for social cognitive neuroscience. Neuroimage 50:1639-1647.
38. Rescorla RA, Wagner AR (1972) A theory of Pavlovian conditioning: variations in the effectiveness of reinforcement and nonreinforcement. In: Classical conditioning II: current research and theory (Black AH, Prokasy WF, eds), pp 64-99. New York: Appleton Century Crofts.
39. Rudebeck PH, Buckley MJ, Walton ME, Rushworth MF (2006) A role for the macaque anterior cingulate gyrus in social valuation. Science 313:1310-1312.
40. Rushworth MF, Behrens TE (2008) Choice, uncertainty and value in pre-frontal and cingulate cortex. Nat Neurosci 11:389-397.
41. Schönberg T, Daw ND, Joel D, O'Doherty JP (2007) Reinforcement learning signals in the human striatum distinguish learners from nonlearners during reward-based decision making. J Neurosci 27:12860-12867.
42. Schultz W, Dayan P, Montague PR (1997) A neural substrate of prediction and reward. Science 275:1593-1599.
43. Seymour B, O'Doherty JP, Dayan P, Koltzenburg M, Jones AK, Dolan RJ, Friston KJ, Frackowiak RS (2004) Temporal difference models describe higher-order learning in humans. Nature 429:664-667.
44. Somerville LH, Heatherton TF, Kelley WM (2006) Anterior cingulate cortex responds differentially to expectancy violation and social rejection. Nat Neurosci 9:1007-1008.
45. Somerville LH, Hare T, Casey BJ (2011) Frontostriatal maturation predicts cognitive control failure to appetitive cues in adolescents. J Cogn Neuro-sci 23:2123-2134.
46. Spear LP (2000) The adolescent brain and age-related behavioral manifestations. Neurosci Biobehav Rev 24:417-463.
47. Spicer J, Galvan A, Hare TA, Voss H, Glover G, Casey B (2007) Sensitivity of the nucleus accumbens to violations in expectation of reward. Neuroim-age 34:455-461.
48. Steinberg L (2008) A social neuroscience perspective on adolescent risk-taking. Dev Rev 28:78-106.
49. Sul JH, Kim H, Huh N, Lee D, Jung MW (2010) Distinct roles of rodent orbitofrontal and medial prefrontal cortex in decision making. Neuron 66:449-460.
50. Takahashi YK, Roesch MR, Stalnaker TA, Haney RZ, Calu DJ, Taylor AR, Burke KA, Schoenbaum G (2009) The orbitofrontal cortex and ventral tegmental area are necessary for learning from unexpected outcomes. Neuron 62:269-280.
51. Talairach J, Tournoux P (1988) Co-planar stereotaxic atlas of the human brain. New York: Thieme Medical Publishers.
52. Tanaka SC, Doya K, Okada G, Ueda K, Okamoto Y, Yamawaki S (2004) Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops. Nat Neurosci 7:887-893.
53. Valentin VV, O'Doherty JP (2009) Overlapping prediction errors in dorsal striatum during instrumental learning with juice and money reward in the human brain. J Neurophysiol 102:3384-3391.