Modulation of the feedback-related negativity by instruction and experience

Proceedings of the National Academy of Sciences of the United States of America

Volumn 108, Issue 47, 2011, Pages 19048-19053

  Walsh, Matthew M ^a   Anderson, John R ^a  

^a CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTATION; ARTICLE; EVENT RELATED POTENTIAL; FEEDBACK RELATED NEGATIVITY; FEEDBACK SYSTEM; HUMAN; LEARNING; NERVE POTENTIAL; NONHUMAN; PRIORITY JOURNAL; REINFORCEMENT; REWARD; TASK PERFORMANCE;

ADAPTATION, PSYCHOLOGICAL; ADULT; EVOKED POTENTIALS; FEEDBACK, PSYCHOLOGICAL; FEMALE; HUMANS; MALE; MODELS, EDUCATIONAL; PHOTIC STIMULATION; REINFORCEMENT (PSYCHOLOGY); REWARD;

EID: 82755197358     PISSN: 00278424     EISSN: 10916490     Source Type: Journal    
DOI: 10.1073/pnas.1117189108     Document Type: Article

References (34)

1. Sutton RS, Barto AG (1998) Reinforcement Learning: An Introduction (MIT Press, Cambridge, MA).
2. Thorndike EL (1911) Animal Intelligence: Experimental Studies (MacMillan, New York).
3. Schultz W (1998) Predictive reward signal of dopamine neurons. J Neurophysiol 80: 1-27.
4. O'Doherty JP (2004) Reward representations and reward-related learning in the human brain: Insights from neuroimaging. Curr Opin Neurobiol 14:769-776.
5. Li J, Delgado MR, Phelps EA (2011) How instructed knowledge modulates the neural systems of reward learning. Proc Natl Acad Sci USA 108:55-60.
6. Doll BB, Jacobs WJ, Sanfey AG, Frank MJ (2009) Instructional control of reinforcement learning: A behavioral and neurocomputational investigation. Brain Res 1299:74-94.
7. Biele G, Rieskamp J, Gonzalez R (2009) Computational models for the combination of advice and individual learning. Cogn Sci 33:206-242.
8. Doll BB, Hutchison KE, Frank MJ (2011) Dopaminergic genes predict individual differences in susceptibility to confirmation bias. J Neurosci 31:6188-6198.
9. McClure SM, Laibson DI, Loewenstein G, Cohen JD (2004) Separate neural systems value immediate and delayed monetary rewards. Science 306:503-507. (Pubitemid 39372453)
10. Poldrack RA, et al. (2001) Interactive memory systems in the human brain. Nature 414: 546-550. (Pubitemid 33131537)
11. Frank MJ, O'Reilly RC, Curran T (2006) When memory fails, intuition reigns: Midazolam enhances implicit inference in humans. Psychol Sci 17:700-707. (Pubitemid 44179881)
12. Daw ND, Niv Y, Dayan P (2005) Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat Neurosci 8:1704-1711. (Pubitemid 41683198)
13. Gläscher J, Daw N, Dayan P, O'Doherty JP (2010) States versus rewards: Dissociable neural prediction error signals underlying model-based and model-free reinforcement learning. Neuron 66:585-595.
14. Miltner WHR, Braun CH, Coles MGH (1997) Event-related brain potentials following incorrect feedback in a time-estimation task: Evidence for a "generic" neural system for error detection. J Cogn Neurosci 9:788-798. (Pubitemid 28025194)
15. Holroyd CB, Pakzad-Vaezi KL, Krigolson OE (2008) The feedback correct-related positivity: Sensitivity of the event-related brain potential to unexpected positive feedback. Psychophysiology 45:688-697.
16. Walsh MM, Anderson JR (2011) Learning from delayed feedback: Neural responses in temporal credit assignment. Cogn Affect Behav Neurosci 11:131-143.
17. Holroyd CB, Larsen JT, Cohen JD (2004) Context dependence of the event-related brain potential associated with reward and punishment. Psychophysiology 41: 245-253. (Pubitemid 38524096)
18. Cohen MX, Ranganath C (2007) Reinforcement learning signals predict future decisions. J Neurosci 27:371-378. (Pubitemid 46106011)
19. Holroyd CB, et al. (2004) Dorsal anterior cingulate cortex shows fMRI response to internal and external error signals. Nat Neurosci 7:497-498. (Pubitemid 38544587)
20. Niki H, Watanabe M (1979) Prefrontal and cingulate unit activity during timing behavior in the monkey. Brain Res 171:213-224. (Pubitemid 10246665)
21. Rushworth MFS, Walton ME, Kennerley SW, Bannerman DM (2004) Action sets and decisions in the medial frontal cortex. Trends Cogn Sci 8:410-417. (Pubitemid 39179904)
22. Holroyd CB, Coles MGH (2002) The neural basis of human error processing: Reinforcement learning, dopamine, and the error-related negativity. Psychol Rev 109: 679-709.
23. Santesso DL, et al. (2009) Single dose of a dopamine agonist impairs reinforcement learning in humans: Evidence from event-related potentials and computational modeling of striatal-cortical function. Hum Brain Mapp 30:1963-1976.
24. Nieuwenhuis S, Holroyd CB, Mol N, Coles MGH (2004) Reinforcement-related brain potentials from medial frontal cortex: Origins and functional significance. Neurosci Biobehav Rev 28:441-448. (Pubitemid 39077932)
25. Yeung N, Holroyd CB, Cohen JD (2005) ERP correlates of feedback and reward processing in the presence and absence of response choice. Cereb Cortex 15:535-544. (Pubitemid 40577470)
26. Holroyd CB, Krigolson OE, Baker R, Lee S, Gibson J (2009) When is an error not a prediction error? An electrophysiological investigation. Cogn Affect Behav Neurosci 9:59-70.
27. Kass RE, Raftery AE (1995) Bayes factors. J Am Stat Assoc 90:773-795.
28. Johnson R, Jr. (1986) A triarchic model of P300 amplitude. Psychophysiology 23: 367-384.
29. Daw ND, Gershman SJ, Seymour B, Dayan P, Dolan RJ (2011) Model-based influences on humans' choices and striatal prediction errors. Neuron 69:1204-1215.
30. Balleine BW, O'Doherty JP (2010) Human and rodent homologies in action control: Corticostriatal determinants of goal-directed and habitual action. Neuropsychopharmacology 35:48-69.
31. Pasupathy A, Miller EK (2005) Different time courses of learning-related activity in the prefrontal cortex and striatum. Nature 433:873-876. (Pubitemid 40314896)
32. Mars RB, Shea NJ, Kolling N, Rushworth MFS (2010) Model-based analyses: Promises, pitfalls, and example applications to the study of cognitive control. Q J Exp Psychol 29: 1-16.
33. Santesso DL, et al. (2008) Individual differences in reinforcement learning: Behavioral, electrophysiological, and neuroimaging correlates. Neuroimage 42:807-816.
34. Gonzalez R, Wu G (1999) On the shape of the probability weighting function. Cognit Psychol 38:129-166.