Frontal oscillatory dynamics predict feedback learning and action adjustment

Journal of Cognitive Neuroscience

Volumn 23, Issue 12, 2011, Pages 4106-4121

  van de Vijver, Irene ^a   Richard Ridderinkhof, K ^a   Cohen, Michael X ^a,b  

^a UNIVERSITY OF AMSTERDAM   (Netherlands)

^b UNIVERSITY OF ARIZONA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; BEHAVIOR; BETA RHYTHM; ELECTROENCEPHALOGRAM; ELECTROENCEPHALOGRAPHY PHASE SYNCHRONIZATION; FEEDBACK SYSTEM; FEMALE; FRONTAL CORTEX; FRONTAL LOBE; HUMAN; HUMAN EXPERIMENT; LEARNING; MALE; OSCILLATION; PREDICTION; PREFRONTAL CORTEX; PRIORITY JOURNAL; REINFORCEMENT; SENSORIMOTOR CORTEX; THETA RHYTHM;

ADOLESCENT; ADULT; BIOFEEDBACK, PSYCHOLOGY; FEMALE; FRONTAL LOBE; HUMANS; LEARNING; MALE; NEUROFEEDBACK; PREDICTIVE VALUE OF TESTS; PSYCHOMOTOR PERFORMANCE; REACTION TIME; YOUNG ADULT;

EID: 80055116609     PISSN: 0898929X     EISSN: 15308898     Source Type: Journal    
DOI: 10.1162/jocn_a_00110     Document Type: Article

References (59)

1. Akam, T., & Kullmann, D. M. (2010). Oscillations and filtering networks support flexible routing of information. Neuron, 67, 308-320.
2. Babiloni, C., Vecchio, F., Bares, M., Brazdil, M., Nestrasil, I., Eusebi, F., et al. (2008). Functional coupling between anterior prefrontal cortex (BA 10) and hand muscle contraction during intentional and imitative motor acts. Neuroimage, 39, 1314-1323.
3. Behrens, T. E., Woolrich, M. W., Walton, M. E., & Rushworth, M. F. (2007). Learning the value of information in an uncertain world. Nature Neuroscience, 10, 1214-1221.
4. Bellebaum, C., & Daum, I. (2008). Learning-related changes in reward expectancy are reflected in the feedback-related negativity. European Journal of Neuroscience, 27, 1823-1835.
5. Botvinick, M. M. (2007). Conflict monitoring and decision making: Reconciling two perspectives on anterior cingulate function. Cognitive, Affective, & Behavioral Neuroscience, 7, 356-366.
6. Botvinick, M. M., Cohen, J. D., & Carter, C. S. (2004). Conflict monitoring and anterior cingulate cortex: An update. Trends in Cognitive Sciences, 8, 539-546.
7. Brown, J. W., & Braver, T. S. (2005). Learned predictions of error likelihood in the anterior cingulate cortex. Science, 307, 1118-1121.
8. Cavanagh, J. F., Cohen, M. X, & Allen, J. J. (2009). Prelude to and resolution of an error: EEG phase synchrony reveals cognitive control dynamics during action monitoring. Journal of Neuroscience, 29, 98-105.
9. Cavanagh, J. F., Frank, M. J., Klein, T. J., & Allen, J. J. (2010). Frontal theta links prediction errors to behavioral adaptation in reinforcement learning. Neuroimage, 49, 3198-3209.
10. Chase, H. W., Swainson, R., Durham, L., Benham, L., & Cools, R. (2011). Feedback-related negativity codes prediction error but not behavioral adjustment during probabilistic reversal learning. Journal of Cognitive Neuroscience, 23, 936-946.
11. Christie, G. J., & Tata, M. S. (2009). Right frontal cortex generates reward-related theta-band oscillatory activity. Neuroimage, 48, 415-422.
12. Cohen, M. X. (2007). Individual differences and the neural representations of reward expectation and reward prediction error. Social Cognitive & Affective Neuroscience, 2, 20-30.
13. Cohen, M. X. (2011). Error-related medial frontal theta activity predicts cingulate-related structural connectivity. Neuroimage, 55, 1373-1383.
14. Cohen, M. X, Elger, C. E., & Ranganath, C. (2007). Reward expectation modulates feedback-related negativity and EEG spectra. Neuroimage, 35, 968-978.
15. Cohen, M. X, & Ranganath, C. (2007). Reinforcement learning signals predict future decisions. Journal of Neuroscience, 27, 371-378.
16. Cohen, M. X, Ridderinkhof, K. R., Haupt, S., Elger, C. E., & Fell, J. (2008). Medial frontal cortex and response conflict: Evidence from human intracranial EEG and medial frontal cortex lesion. Brain Research, 1238, 127-142.
17. Delorme, A., & Makeig, S. (2004). EEGLAB: An open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. Journal of Neuroscience Methods, 134, 9-21.
18. Engel, A. K., & Fries, P. (2010). Beta-band oscillations- signalling the status quo? Current Opinion in Neurobiology, 20, 156-165.
19. Fries, P. (2005). A mechanism for cognitive dynamics: Neuronal communication through neuronal coherence. Trends in Cognitive Sciences, 9, 474-480.
20. Gehring, W. J., & Willoughby, A. R. (2002). The medial frontal cortex and the rapid processing of monetary gains and losses. Science, 295, 2279-2282.
21. Gregoriou, G. G., Gotts, S. J., Zhou, H., & Desimone, R. (2009). High-frequency, long-range coupling between prefrontal and visual cortex during attention. Science, 324, 1207-1210.
22. Hester, R., Barre, N., Murphy, K., Silk, T. J., & Mattingley, J. B. (2008). Human medial frontal cortex activity predicts learning from errors. Cerebral Cortex, 18, 1933-1940.
23. Holroyd, C. B., & Coles, M. G. (2002). The neural basis of human error processing: Reinforcement learning, dopamine, and the error-related negativity. Psychological Review, 109, 679-709.
24. Holroyd, C. B., & Coles, M. G. (2008). Dorsal anterior cingulate cortex integrates reinforcement history to guide voluntary behavior. Cortex, 44, 548-559.
25. Jessup, R. K., Busemeyer, J. R., & Brown, J. W. (2010). Error effects in anterior cingulate cortex reverse when error likelihood is high. Journal of Neuroscience, 30, 3467-3472.
26. Kayser, J., & Tenke, C. E. (2006). Principal components analysis of Laplacian waveforms as a generic method for identifying ERP generator patterns: I. Evaluation with auditory oddball tasks. Clinical Neurophysiology, 117, 348-368.
27. Keil, J., Weisz, N., Paul-Jordanov, I., & Wienbruch, C. (2010). Localization of the magnetic equivalent of the ERN and induced oscillatory brain activity. Neuroimage, 51, 404-411.
28. Kennerley, S. W., Walton, M. E., Behrens, T. E., Buckley, M. J., & Rushworth, M. F. (2006). Optimal decision making and the anterior cingulate cortex. Nature Neuroscience, 9, 940-947.
29. Kerns, J. G. (2006). Anterior cingulate and prefrontal cortex activity in an fMRI study of trial-to-trial adjustments on the Simon task. Neuroimage, 33, 399-405.
30. Kerns, J. G., Cohen, J. D., MacDonald, A. W., III, Cho, R. Y., Stenger, V. A., & Carter, C. S. (2004). Anterior cingulate conflict monitoring and adjustments in control. Science, 303, 1023-1026.
31. Kilner, J. M., Baker, S. N., Salenius, S., Hari, R., & Lemon, R. N. (2000). Human cortical muscle coherence is directly related to specific motor parameters. Journal of Neuroscience, 20, 8838-8845.
32. Lee, D., & Seo, H. (2007). Mechanisms of reinforcement learning and decision making in the primate dorsolateral prefrontal cortex. Annals of the New York Academy of Sciences, 1104, 108-122.
33. Luk, C. H., & Wallis, J. D. (2009). Dynamic encoding of responses and outcomes by neurons in medial prefrontal cortex. Journal of Neuroscience, 29, 7526-7539.
34. Luu, P., & Tucker, D. M. (2001). Regulating action: Alternating activation of midline frontal and motor cortical networks. Clinical Neurophysiology, 112, 1295-1306.
35. Luu, P., Tucker, D. M., & Makeig, S. (2004). Frontal midline theta and the error-related negativity: Neurophysiological mechanisms of action regulation. Clinical Neurophysiology, 115, 1821-1835.
36. Marco-Pallares, J., Cucurell, D., Cunillera, T., Garcia, R., Andres-Pueyo, A., Munte, T. F., et al. (2008). Human oscillatory activity associated to reward processing in a gambling task. Neuropsychologia, 46, 241-248.
37. Marco-Pallares, J., Cucurell, D., Cunillera, T., Kramer, U. M., Camara, E., Nager, W., et al. (2009). Genetic variability in the dopamine system (dopamine receptor D4, catechol- O-methyltransferase) modulates neurophysiological responses to gains and losses. Biological Psychiatry, 66, 154-161.
38. Matsumoto, K., Suzuki, W., & Tanaka, K. (2003). Neuronal correlates of goal-based motor selection in the prefrontal cortex. Science, 301, 229-232.
39. Matsumoto, M., Matsumoto, K., Abe, H., & Tanaka, K. (2007). Medial prefrontal cell activity signaling prediction errors of action values. Nature Neuroscience, 10, 647-656.
40. McClure, S. M., Laibson, D. I., Loewenstein, G., & Cohen, J. D. (2004). Separate neural systems value immediate and delayed monetary rewards. Science, 306, 503-507.
41. Miltner, W. H. R., Braun, C. H., & Coles, M. G. H. (1997). Event-related brain potentials following incorrect feedback in a time estimation task: Evidence for a "generic" neural system for error detection. Journal of Cognitive Neuroscience, 9, 788-798.
42. Mima, T., & Hallett, M. (1999). Corticomuscular coherence: A review. Journal of Clinical Neurophysiology, 16, 501-511.
43. Mizuhara, H., & Yamaguchi, Y. (2007). Human cortical circuits for central executive function emerge by theta phase synchronization. Neuroimage, 36, 232-244.
44. Nieuwenhuis, S., Holroyd, C. B., Mol, N., & Coles, M. G. (2004). Reinforcement-related brain potentials from medial frontal cortex: Origins and functional significance. Neuroscience and Biobehavioral Reviews, 28, 441-448.
45. Philiastides, M. G., Biele, G., Vavatzanidis, N., Kazzer, P., & Heekeren, H. R. (2010). Temporal dynamics of prediction error processing during reward-based decision making. Neuroimage, 53, 221-232.
46. Quilodran, R., Rothe, M., & Procyk, E. (2008). Behavioral shifts and action valuation in the anterior cingulate cortex. Neuron, 57, 314-325.
47. Ridderinkhof, K. R., Ullsperger, M., Crone, E. A., & Nieuwenhuis, S. (2004). The role of the medial frontal cortex in cognitive control. Science, 306, 443-447.
48. Rudebeck, P. H., Behrens, T. E., Kennerley, S. W., Baxter, M. G., Buckley, M. J., Walton, M. E., et al. (2008). Frontal cortex subregions play distinct roles in choices between actions and stimuli. Journal of Neuroscience, 28, 13775-13785.
49. Rushworth, M. F., Behrens, T. E., Rudebeck, P. H., & Walton, M. E. (2007). Contrasting roles for cingulate and orbitofrontal cortex in decisions and social behaviour. Trends in Cognitive Sciences, 11, 168-176.
50. Sauseng, P., & Klimesch, W. (2008). What does phase information of oscillatory brain activity tell us about cognitive processes? Neuroscience and Biobehavioral Reviews, 32, 1001-1013.
51. Schoffelen, J. M., Oostenveld, R., & Fries, P. (2005). Neuronal coherence as a mechanism of effective corticospinal interaction. Science, 308, 111-113.
52. Srinivasan, R., Winter, W. R., Ding, J., & Nunez, P. L. (2007). EEG and MEG coherence: Measures of functional connectivity at distinct spatial scales of neocortical dynamics. Journal of Neuroscience Methods, 166, 41-52.
53. Tanaka, S. C., Samejima, K., Okada, G., Ueda, K., Okamoto, Y., Yamawaki, S., et al. (2006). Brain mechanism of reward prediction under predictable and unpredictable environmental dynamics. Neural Networks, 19, 1233-1241.
54. Trujillo, L. T., & Allen, J. J. (2007). Theta EEG dynamics of the error-related negativity. Clinical Neurophysiology, 118, 645-668.
55. Wang, C., Ulbert, I., Schomer, D. L., Marinkovic, K., & Halgren, E. (2005). Responses of human anterior cingulate cortex microdomains to error detection, conflict monitoring, stimulus-response mapping, familiarity, and orienting. Journal of Neuroscience, 25, 604-613.
56. Wang, H. P., Spencer, D., Fellous, J. M., & Sejnowski, T. J. (2010). Synchrony of thalamocortical inputs maximizes cortical reliability. Science, 328, 106-109.
57. Womelsdorf, T., Johnston, K., Vinck, M., & Everling, S. (2010). Theta-activity in anterior cingulate cortex predicts task rules and their adjustments following errors. Proceedings of the National Academy of Sciences, U.S.A., 107, 5248-5253.
58. Womelsdorf, T., Schoffelen, J. M., Oostenveld, R., Singer, W., Desimone, R., Engel, A. K., et al. (2007). Modulation of neuronal interactions through neuronal synchronization. Science, 316, 1609-1612.
59. Yasuda, A., Sato, A., Miyawaki, K., Kumano, H., & Kuboki, T. (2004). Error-related negativity reflects detection of negative reward prediction error. NeuroReport, 15, 2561-2565.