How glitter relates to gold: Similarity-dependent reward prediction errors in the human striatum

Journal of Neuroscience

Volumn 32, Issue 46, 2012, Pages 16521-16529

  Kahnt, Thorsten ^a   Park, Soyoung Q ^a   Burke, Christopher J ^a   Tobler, Philippe N ^a  

^a UNIVERSITY OF ZURICH   (Switzerland)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; BEHAVIOR; COMPUTER MODEL; CONDITIONING; CORPUS STRIATUM; EVOKED VISUAL RESPONSE; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HIPPOCAMPUS; HUMAN; HUMAN EXPERIMENT; MALE; NERVE CELL NETWORK; NORMAL HUMAN; PREDICTION; PRIORITY JOURNAL; REINFORCEMENT; REWARD; STIMULUS GENERALIZATION; TASK PERFORMANCE; VISUAL DISCRIMINATION; VISUAL ORIENTATION; VISUAL STIMULATION;

CONDITIONING, OPERANT; DATA INTERPRETATION, STATISTICAL; EXTINCTION, PSYCHOLOGICAL; FEMALE; FORECASTING; GENERALIZATION (PSYCHOLOGY); HIPPOCAMPUS; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MAGNETIC RESONANCE IMAGING; MALE; MODELS, NEUROLOGICAL; NEOSTRIATUM; PHOTIC STIMULATION; PSYCHOMOTOR PERFORMANCE; REINFORCEMENT (PSYCHOLOGY); REWARD; VISUAL PERCEPTION; YOUNG ADULT;

EID: 84869006764     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.2383-12.2012     Document Type: Article

References (46)

1. Burke CJ, Tobler PN, Baddeley M, Schultz W (2010) Neural mechanisms of observational learning. Proc Natl Acad Sci U S A 107:14431-14436.
2. Cheng K, Spetch ML, Johnston M (1997) Spatial peak shift and generalization in pigeons. J Exp Psychol Anim Behav Process 23:469-481.
3. Chumbley JR, Flandin G, Bach DR, Daunizeau J, Fehr E, Dolan RJ, Friston KJ (2012) Learning and generalization under ambiguity: an fMRI study. PLoS Comput Biol 8:e1002346.
4. Daw ND, Gershman SJ, Seymour B, Dayan P, Dolan RJ (2011) Model-based influences on humans' choices and striatal prediction errors. Neuron 69:1204-1215.
5. Derenne A (2010) Shifts in postdiscrimination gradients within a stimulus dimension based on bilateral facial symmetry. J Exp Anal Behav 93:485-494.
6. Eichenbaum H (2000) A cortical-hippocampal system for declarative memory. Nat Rev Neurosci 1:41-50.
7. Frank MJ, Claus ED (2006) Anatomy of a decision: striato-orbitofrontal interactions in reinforcement learning, decision making, and reversal. Psychol Rev 113:300-326.
8. Frank MJ, O'Reilly RC, Curran T (2006) When memory fails, intuition reigns: midazolam enhances implicit inference in humans. Psychol Sci 17:700-707.
9. Friston KJ, Buechel C, Fink GR, Morris J, Rolls E, Dolan RJ (1997) Psychophysiological and modulatory interactions in neuroimaging. Neuroimage 6:218-229.
10. Ghirlanda S, Enquist M (2003) A century of generalization. Anim Behav 66:15-36.
11. Grace AA, Floresco SB, Goto Y, Lodge DJ (2007) Regulation of firing of dopaminergic neurons and control of goal-directed behaviors. Trends Neurosci 30:220-227.
12. Guillette LM, Farrell TM, Hoeschele M, Nickerson CM, Dawson MR, Sturdy CB (2010) Mechanisms of call note-type perception in black-capped chickadees (Poecile atricapillus): peak shift in a note-type continuum. J Comp Psychol 124:109-115.
13. Guttman N, Kalish H (1956) Discriminability and stimulus generalization. J Exp Psychol 51:79-88.
14. Hanson HM (1959) Effects of discrimination training on stimulus generalization. J Exp Psychol 58:321-334.
15. Kahnt T, Park SQ, Cohen MX, Beck A, Heinz A, Wrase J (2009) Dorsal striatal-midbrain connectivity in humans predicts how reinforcements are used to guide decisions. J Cogn Neurosci 21:1332-1345.
16. Kahnt T, Grueschow M, Speck O, Haynes JD (2011) Perceptual learning and decision-making in human medial frontal cortex. Neuron 70:549-559.
17. Kelley AE, Domesick VB (1982) The distribution of the projection from the hippocampal formation to the nucleus accumbens in the rat: an anterograde- and retrograde-horseradish peroxidase study. Neuroscience 7:2321-2335.
18. Li J, Schiller D, Schoenbaum G, Phelps EA, Daw ND (2011) Differential roles of human striatum and amygdala in associative learning. Nat Neurosci 14:1250-1252.
19. Lyons J, Klipec WD, Steinsul G (1973) Effect of chlorpromazine on discrimination performance and peak shift. J Comp Physiol Psychol 1:121-124.
20. McLaren DG, Ries ML, Xu G, Johnson SC (2012) A generalized form of context-dependent psychophysiological interactions (gPPI): a comparison to standard approaches. Neuroimage 61:1277-1286.
21. Montague PR, Hyman SE, Cohen JD (2004) Computational roles for dopamine in behavioural control. Nature 431:760-767.
22. Moustafa AA, Keri S, Herzallah MM, Myers CE, Gluck MA (2010) A neural model of hippocampal-striatal interactions in associative learning and transfer generalization in various neurological and psychiatric patients. Brain Cogn 74:132-144.
23. Norman KA, O'Reilly RC (2003) Modeling hippocampal and neocortical contributions to recognition memory: a complementary-learningsystems approach. Psychol Rev 110:611-646.
24. O'Doherty JP, Dayan P, Friston K, Critchley H, Dolan RJ (2003) Temporal difference models and reward-related learning in the human brain. Neuron 38:329-337.
25. O'Donnell P, Grace AA (1995) Synaptic interactions among excitatory afferents to nucleus accumbens neurons: hippocampal gating of prefrontal cortical input. J Neurosci 15:3622-3639.
26. Park SQ, Kahnt T, Beck A, Cohen MX, Dolan RJ, Wrase J, Heinz A (2010) Prefrontal cortex fails to learn from reward prediction errors in alcohol dependence. J Neurosci 30:7749-7753.
27. Park SQ, Kahnt T, Talmi D, Rieskamp J, Dolan RJ, Heekeren HR (2012) Adaptive coding of reward prediction errors is gated by striatal coupling. Proc Natl Acad Sci U S A 109:4285-4289.
28. Pearce JM (1994) Similarity and discrimination: a selective review and a connectionist model. Psychol Rev 101:587-607.
29. Pearce JM, Esber GR, George DN, Haselgrove M (2008) The nature of discrimination learning in pigeons. Learn Behav 36:188-199.
30. Poldrack RA, Clark J, Paré-Blagoev EJ, Shohamy D, Creso Moyano J, Myers C, Gluck MA (2001) Interactive memory systems in the human brain. Nature 414:546-550.
31. Purtle RB (1973) Peak shift: review. Psychol Bull 80:408-421.
32. Rescorla RA, Wagner AR (1972) A theory of Pavlovian conditioning: variations in the effectiveness of reinforcement and nonreinforcement. In: Classical conditioning II: current research and theory (Black AH, Prokasy WF, eds). New York: Appleton Century Crofts.
33. Saksida LM (1999) Effects of similarity and experience on discrimination learning: a nonassociative connectionist model of perceptual learning. J Exp Psychol Anim Behav Process 25:308-323.
34. Samejima K, Doya K (2007) Multiple representations of belief states and action values in corticobasal ganglia loops. Ann N Y Acad Sci 1104:213-228.
35. Schechtman E, Laufer O, Paz R (2010) Negative valence widens generalization of learning. J Neurosci 30:10460-10464.
36. Schultz W, Dayan P, Montague PR (1997) A neural substrate of prediction and reward. Science 275:1593-1599.
37. Seger CA, Miller EK (2010) Category learning in the brain. Annu Rev Neurosci 33:203-219.
38. Shohamy D, Wagner AD (2008) Integrating memories in the human brain: hippocampal-midbrain encoding of overlapping events. Neuron 60: 378-389.
39. Squire LR, Wixted JT (2011) The cognitive neuroscience of human memory since H.M. Annu Rev Neurosci 34:259-288.
40. Sutton R, Barto A (1998) Reinforcement learning: an introduction. Cambridge, MA: Massachusetts Institute of Technology.
41. Terrace HS (1966) Behavioral contrast and peak shift: effects of extended discrimination training. J Exp Anal Behav 9:613-617.
42. Tobler PN, O'Doherty JP, Dolan RJ, Schultz W (2006) Human neural learning depends on reward prediction errors in the blocking paradigm. J Neurophysiol 95:301-310.
43. Waelti P, Dickinson A, Schultz W (2001) Dopamine responses comply with basic assumptions of formal learning theory. Nature 412:43-48.
44. Wimmer GE, Daw ND, Shohamy D (2012) Generalization of value in reinforcement learning by humans. Eur J Neurosci 35:1092-1104.
45. Wisniewski MG, Church BA, Mercado E 3rd (2009) Learning-related shifts in generalization gradients for complex sounds. Learn Behav 37:325-335.
46. Wisniewski MG, Radell ML, Guillette LM, Sturdy CB, Mercado E 3rd (2012) Predicting shifts in generalization gradients with perceptrons. Learn Behav 40:128-144.