From Feedback- to Response-based Performance Monitoring in Active and Observational Learning

Journal of Cognitive Neuroscience

Volumn 26, Issue 9, 2014, Pages 2111-2127

  Bellebaum, Christian ^a,b   Colosio, Marco ^c  

^a HEINRICH HEINE UNIVERSITY   (Germany)

^b RUHR UNIVERSITY BOCHUM   (Germany)

^c UNIVERSITY OF PADOVA   (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTIVE BEHAVIOR; ADULT; ANALYSIS OF VARIANCE; BRAIN; BRAIN MAPPING; CONTINGENT NEGATIVE VARIATION; ELECTROENCEPHALOGRAPHY; EVOKED VISUAL RESPONSE; FEMALE; HUMAN; LEARNING; MALE; OBSERVATION; PHOTOSTIMULATION; PHYSIOLOGY; REWARD; YOUNG ADULT;

ADULT; ANALYSIS OF VARIANCE; BRAIN; BRAIN MAPPING; CONTINGENT NEGATIVE VARIATION; ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS, VISUAL; FEEDBACK, PSYCHOLOGICAL; FEMALE; HUMANS; LEARNING; MALE; OBSERVATION; PHOTIC STIMULATION; REWARD; YOUNG ADULT;

EID: 84905197544     PISSN: 0898929X     EISSN: 15308898     Source Type: Journal    
DOI: 10.1162/jocn_a_00612     Document Type: Article

References (56)

1. Alexander, W. H., & Brown, J. W. (2011). Medial prefrontal cortex as an action-outcome predictor. Nature Neuroscience, 14, 1338-1344.
2. Bellebaum, C., & Daum, I. (2008). Learning related changes in reward expectancy are reflected in the feedback related negativity. European Journal of Neuroscience, 27, 1823-1835.
3. Bellebaum, C., Jokisch, D., Gizewski, E. R., Forsting, M., & Daum, I. (2012). The neural coding of expected and unexpected monetary performance outcomes: Dissociations between active and observational learning. Behavioural Brain Research, 227, 241-251.
4. Bellebaum, C., Kobza, S., Thiele, S., & Daum, I. (2010). It was not MY fault: Event related brain potentials in active and observational learning from feedback. Cerebral Cortex, 20, 2874-2883.
5. Bellebaum, C., Kobza, S., Thiele, S., & Daum, I. (2011). Processing of expected and unexpected monetary performance outcomes in healthy older subjects. Behavioral Neuroscience, 125, 241-251.
6. Berger, B., Gaspar, P., & Verney, C. (1991). Dopaminergic innervation of the cerebral cortex: Unexpected differences between rodents and primates. Trends in Neurosciences, 14, 21-27.
7. Beste, C., Saft, C., Andrich, J., Gold, R., & Falkenstein, M. (2006). Error processing in Huntington's disease. PLoS One, 1, e86.
8. Breiter, H. C., Aharon, I., Kahneman, D., Dale, A., & Shizgal, P. (2001). Functional imaging of neural responses to expectancy and experience of monetary gains and losses. Neuron, 30, 619-639.
9. Burke, C. J., Tobler, P. N., Baddeley, M., & Schultz, W. (2010). Neural mechanisms of observational learning. Proceedings of the National Academy of Sciences, U.S.A., 107, 14431-14436.
10. Camille, N., Tsuchida, A., & Fellows, L. K. (2011). Double dissociation of stimulus value and action-value learning in humans with orbitofrontal or anterior cingulate cortex damage. Journal of Neuroscience, 31, 15048-15052.
11. Canessa, N., Motterlini, M., Alemanno, F., Perani, D., & Cappa, S. F. (2011). Learning from other people's experience: A neuroimaging study of decisional interactive learning. Neuroimage, 55, 353-362.
12. De Bruijn, E. R., & von Rhein, D. T. (2012). Is your error my concern? An event-related potential study on own and observed error detection in cooperation and competition. Frontiers in Neuroscience, 6, 8.
13. Dehaene, S., Posner, M. I., & Tucker, D. M. (1994). Localization of a neural system for error detection and compensation. Psychological Science, 5, 303-305.
14. Delgado, M. R., Locke, H. M., Stenger, V. A., & Fiez, J. A. (2003). Dorsal striatum responses to reward and punishment: Effects of valence and magnitude manipulations. Cognitive Affective & Behavioral Neuroscience, 3, 27-38.
15. Endrass, T., Reuter, B., & Kathmann, N. (2007). ERP correlates of conscious error recognition: Aware and unaware errors in an antisaccade task. European Journal of Neuroscience, 26, 1714-1720.
16. Eppinger, B., Kray, J., Mock, B., & Mecklinger, A. (2008). Better or worse than expected? Aging, learning, and the ERN. Neuropsychologia, 46, 521-539.
17. Falkenstein, M., Hielscher, H., Dziobek, I., Schwarzenau, P., Hoormann, J., Sunderman, B., et al. (2001). Action monitoring, error detection, and the basal ganglia: An ERP study. NeuroReport, 12, 157-161.
18. Falkenstein, M., Hohnsbein, J., Hoormann, J., & Blanke, L. (1991). Effects of crossmodal divided attention on late ERP components. II. Error processing in choice reaction tasks. Electroencephalography and Clinical Neurophysiology, 78, 447-455.
19. Ferdinand, N. K., Mecklinger, A., Kray, J., & Gehring, W. J. (2012). The processing of unexpected positive response outcomes in the mediofrontal cortex. Journal of Neuroscience, 32, 12087-12092.
20. Frank, M. J., Seeberger, L. C., & Ocheckentity'/checkentityReilly, R. C. (2004). By carrot or by stick: Cognitive reinforcement learning in parkinsonism. Science, 306, 1940-1943.
21. Frank, M. J., Woroch, B. S., & Curran, T. (2005). Error related negativity predicts reinforcement learning and conflict biases. Neuron, 47, 495-501.
22. Gehring, W. J., Goss, B., Coles, M. G. H., Meyer, D. E., & Donchin, E. (1993). A neural system for error detection and compensation. Psychological Science, 4, 385-390.
23. Gehring, W. J., & Willoughby, A. R. (2002). The medial frontal cortex and the rapid processing of monetary gains and losses. Science, 295, 2279-2282.
24. Glascher, J., Hampton, A. N., & Ocheckentity'/checkentityDoherty, J. P. (2009). Determining a role for ventromedial prefrontal cortex in encoding action-based value signals during reward related decision making. Cerebral Cortex, 19, 483-495.
25. Guitart-Masip, M., Chowdhury, R., Sharot, T., Dayan, P., Duzel, E., & Dolan, R. J. (2012). Action controls dopaminergic enhancement of reward representations. Proceedings of the National Academy of Sciences, U.S.A., 109, 7511-7516.
26. Haber, S. N., & Fudge, J. L. (1997). The primate substantia nigra and VTA: Integrative circuitry and function. Critical Reviews in Neurobiology, 11, 323-342.
27. Hajcak, G., Moser, J. S., Holroyd, C. B., & Simons, R. F. (2007). It's worse than you thought: The feedback negativity and violations of reward prediction in gambling tasks. Psychophysiology, 44, 905-912.
28. Holroyd, C. B., & Coles, M. G. (2002). The neural basis of human error processing: Reinforcement learning, dopamine, and the error-related negativity. Psychological Review, 109, 679-709.
29. Holroyd, C. B., & Coles, M. G. (2008). Dorsal anterior cingulate cortex integrates reinforcement history to guide voluntary behavior. Cortex, 44, 548-559.
30. Holroyd, C. B., Krigolson, O. E., Baker, R., Lee, S., & Gibson, J. (2009). When is an error not a prediction error? An electrophysiological investigation. Cognitive Affective & Behavioral Neuroscience, 9, 59-70.
31. Knutson, B., & Cooper, J. C. (2005). Functional magnetic resonance imaging of reward prediction. Current Opinion in Neurology, 18, 411-417.
32. Koban, L., Pourtois, G., Bediou, B., & Vuilleumier, P. (2012). Effects of social context and predictive relevance on action outcome monitoring. Cognitive Affective & Behavioral Neuroscience, 12, 460-478.
33. Koban, L., Pourtois, G., Vocat, R., & Vuilleumier, P. (2010). When your errors make me lose or win: Event-related potentials to observed errors of cooperators and competitors. Society for Neuroscience, 5, 360-374.
34. Kobza, S., & Bellebaum, C. (2013). Mediofrontal event-related potentials following observed actions reflect an action prediction error. European Journal of Neuroscience, 37, 1435-1440.
35. Kobza, S., Ferrea, S., Schnitzler, A., Pollok, B., Sudmeyer, M., & Bellebaum, C. (2012). Dissociation between active and observational learning from positive and negative feedback in parkinsonism. PLoS One, 7, e50250.
36. Kobza, S., Thoma, P., Daum, I., & Bellebaum, C. (2011). The feedback-related negativity is modulated by feedback probability in observational learning. Behavioural Brain Research, 225, 396-404.
37. Lee, T. W., Girolami, M., & Sejnowski, T. J. (1999). Independent component analysis using an extended infomax algorithm for mixed subgaussian and supergaussian sources. Neural Computation, 11, 417-441.
38. Matsumoto, M., Matsumoto, K., Abe, H., & Tanaka, K. (2007). Medial prefrontal cell activity signaling prediction errors of action values. Nature Neuroscience, 10, 647-656.
39. Miltner, W. H., Braun, C. H., & Coles, M. G. H. (1997). Event-related brain potentials following incorrect feedback in a time-estimation task: Evidence for a generic neural system for error detection. Journal of Cognitive Neuroscience, 9, 788-798.
40. Nieuwenhuis, S., Ridderinkhof, K. R., Blom, J., Band, G. P., & Kok, A. (2001). Error-related brain potentials are differentially related to awareness of response errors: Evidence from an antisaccade task. Psychophysiology, 38, 752-760.
41. Nieuwenhuis, S., Yeung, N., Holroyd, C. B., Schurger, A., & Cohen, J. D. (2004). Sensitivity of electrophysiological activity from medial frontal cortex to utilitarian and performance feedback. Cerebral Cortex, 14, 741-747.
42. O'Connell, R. G., Dockree, P. M., Bellgrove, M. A., Kelly, S. P., Hester, R., Garavan, H., et al. (2007). The role of cingulate cortex in the detection of errors with and without awareness: A high-density electrical mapping study. European Journal of Neuroscience, 25, 2571-2579.
43. O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. J. (2004). Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science, 304, 452-454.
44. Pietschmann, M., Simon, K., Endrass, T., & Kathmann, N. (2008). Changes of performance monitoring with learning in older and younger adults. Psychophysiology, 45, 559-568.
45. Rolls, E. T., McCabe, C., & Redoute, J. (2008). Expected value, reward outcome, and temporal difference error representations in a probabilistic decision task. Cerebral Cortex, 18, 652-663.
46. Schultz, W., & Dickinson, A. (2000). Neuronal coding of prediction errors. Annual Review of Neuroscience, 23, 473-500.
47. Shiner, T., Seymour, B., Wunderlich, K., Hill, C., Bhatia, K. P., Dayan, P., et al. (2012). Dopamine and performance in a reinforcement learning task: Evidence from Parkinson's disease. Brain, 135, 1871-1883.
48. Smittenaar, P., Chase, H. W., Aarts, E., Nusselein, B., Bloem, B. R., & Cools, R. (2012). Decomposing effects of dopaminergic medication in Parkinson's disease on probabilistic action selection-Learning or performance? European Journal of Neuroscience, 35, 1144-1151.
49. Squires, N. K., Squires, K. C., & Hillyard, S. A. (1975). Two varieties of long-latency positive waves evoked by unpredictable auditory stimuli in man. Electroencephalography and Clinical Neurophysiology, 38, 387-401.
50. van Schie, H. T., Mars, R. B., Coles, M. G., & Bekkering, H. (2004). Modulation of activity in medial frontal and motor cortices during error observation. Nature Neuroscience, 7, 549-554.
51. Wu, Y., & Zhou, X. (2009). The P300 and reward valence, magnitude, and expectancy in outcome evaluation. Brain Research, 1286, 114-122.
52. Wunderlich, K., Rangel, A., & O'Doherty, J. P. (2009). Neural computations underlying action-based decision making in the human brain. Proceedings of the National Academy of Sciences, U.S.A., 106, 17199-17204.
53. Yeung, N., Holroyd, C. B., & Cohen, J. D. (2005). ERP correlates of feedback and reward processing in the presence and absence of response choice. Cerebral Cortex, 15, 535-544.
54. Yoshida, K., Saito, N., Iriki, A., & Isoda, M. (2012). Social error monitoring in macaque frontal cortex. Nature Neuroscience, 15, 1307-1312.
55. Yu, R., & Zhou, X. (2006). Brain responses to outcomes of one's own and other's performance in a gambling task. NeuroReport, 17, 1747-1751.
56. Zaghloul, K. A., Blanco, J. A., Weidemann, C. T., McGill, K., Jaggi, J. L., Baltuch, G. H., et al. (2009). Human substantia nigra neurons encode unexpected financial rewards. Science, 323, 1496-1499.