Neurocognitive mechanisms of cognitive control: The role of prefrontal cortex in action selection, response inhibition, performance monitoring, and reward-based learning

Brain and Cognition

Volumn 56, Issue 2 SPEC. ISS., 2004, Pages 129-140

  Ridderinkhof, K Richard ^a,b   Van Den Wildenberg, Wery P M ^a,c   Segalowitz, Sidney J ^d   Carter, Cameron S ^e  

^a UNIVERSITY OF AMSTERDAM   (Netherlands)

^b LEIDEN UNIVERSITY   (Netherlands)

^c CNRS   (France)

^d BROCK UNIVERSITY   (Canada)

^e UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Action selection; Cognitive control; Medial frontal cortex; Orbitofrontal cortex; Performance adjustment; Performance monitoring; Prefrontal cortex; Response inhibition; Reward based learning

Indexed keywords

BRAIN FUNCTION; BRAIN REGION; COGNITION; DECISION MAKING; HUMAN; LEARNING; ORBITAL CORTEX; PERFORMANCE; PREFRONTAL CORTEX; PRIORITY JOURNAL; REVIEW; REWARD;

EID: 7044241190     PISSN: 02782626     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.bandc.2004.09.016     Document Type: Article

References (120)

1. Allain, S., Carbonnell, L., Falkenstein, M., Burle, B., & Vidal, F. (in press). The modulation of the Ne-like wave on correct responses foreshadows errors. Neuroscience Letters
2. A.R. Aron, J.H. Dowson, B.J. Sahakian, and T.W. Robbins Methylphenidate improves response inhibition in adults with attention deficit/hyperactivity disorder Biological Psychiatry 54 2003 1465 1468
3. A.R. Aron, P.C. Fletcher, E.T. Bullmore, B.J. Sahakian, and T.W. Robbins Stop-signal inhibition disrupted by damage to right inferior frontal gyrus in humans Nature Neuroscience 6 2003 115 116
4. A.R. Aron, T.W. Robbins, and R.A. Poldrack Inhibition and the right inferior frontal cortex Trends in Cognitive Sciences 8 2004 170 177
5. G.P.H. Band, and G.J.M. van Boxtel Inhibitory motor control in stop paradigms: review and reinterpretation of neural mechanisms Acta Psychologica 101 1999 179 211
6. H. Barbas An atomic basis of cognitive-emotional interactions in the primate prefrontal cortex Neuroscience and Biobehavioral Reviews 19 1995 499 510
7. H. Barbas, and D.N. Pandya Architecture and intrinsic connections of the prefrontal cortex in the rhesus-monkey Journal of Comparative Neurology 286 1989 353 375
8. D.J. Barraclough, M.L. Conroy, and D. Lee Prefrontal cortex and decision-making in a mixed strategy game Nature Neuroscience 7 2004 404 410
9. A. Bechara, H. Damasio, and A.R. Damasio Emotion, decision-making and the orbitofrontal cortex Cerebral Cortex 10 2000 295 307
10. D. Bor, J. Duncan, R.J. Wiseman, and A.M. Owen Encoding strategies dissociate prefrontal activity from working memory demand Neuron 37 2003 361 367
11. M.M. Botvinick, T.S. Braver, D.M. Barch, C.S. Carter, and J.D. Cohen Conflict monitoring and cognitive control Psychological Review 108 2001 624 652
12. T.S. Braver, J.R. Reynolds, and D.I. Donaldson Neural mechanisms of transient and sustained cognitive control during task switching Neuron 39 2004 713 726
13. S.A. Bunge, N.M. Dudukovic, M.E. Thomason, C.J. Vaidya, and J.D.E. Gabrieli Immature frontal lobe contributions to cognitive control in children: Evidence from fMRI Neuron 33 2002 301 311
14. S.A. Bunge, E. Hazeltine, M.D. Scanlon, A.C. Rosen, and J.D.E. Gabrieli Dissociable contribution of prefrontal and parietal cortices to response selection Neuroimage 17 2002 1562 1571
15. S.A. Bunge, B. Burrows, and A.D. Wagner Prefrontal and hippocampal contributions to visual associative recognition: Interactions between cognitive control and episodic retrieval Brain and Cognition 56 2004 141 152
16. B. Burle, C.A. Possamai, F. Vidal, M. Bonnet, and T. Hasbroucq Executive control in the Simon effect: An electropmyographic and distributional analysis Psychological Research 66 2002 324 342
17. B. Burle, F. Vidal, C. Tandonnet, and T. Hasbroucq Physiological evidence for response inhibition in choice reaction time tasks Brain and Cognition 56 2004 153 164
18. D.D. Burman, and C.J. Bruce Suppression of task-related saccades by electrical stimulation in the primate's frontal eye field Journal of Neurophysiology 77 1997 2252 2267
19. G. Bush, B.A. Vogt, J. Holmes, A.M. Dale, D. Greve, and M.A. Jenike Dorsal anterior cingulate cortex: A role in reward-based decision-making Proceedings of the National Academy of Sciences of the United States of America 99 2002 523 528
20. S.T. Carmichael, and J.L. Price Sensory and premotor connections of the orbital and medial prefrontal cortex of macaque monkeys Journal of Comparative Neurology 363 1995 642 664
21. B.J. Casey, F.X. Castellanos, J.N. Giedd, W.L. Marsh, S.D. Hamburger, and B. Anne Implication of right frontostriatal circuitry in response inhibition and attention-deficit/hyperactivity disorder Journal of the American Academy of Child and Adolescent Psychiatry 36 1997 374 383
22. F.X. Castellanos, J.N. Giedd, W.L. Marsh, S.D. Hamburger, A.C Vaituzis, and D.P. Dickstein Quantitative brain magnetic resonance imaging in attention-deficit hyperactivity disorder Archives of General Psychiatry 53 1996 607 616
23. C.S. Carter, T.S. Braver, D.M. Barch, M. Botvinick, D. Noll, and J.D. Cohen Anterior cingulate cortex, error detection, and the on line monitoring of performance Science 280 1998 747 749
24. R. Cools, L. Clark, A.M. Owen, and T.W. Robbins Defining the neural mechanisms of probabilistic reversal learning using event-related functional magnetic resonance imaging Journal of Neuroscience 22 2002 4563 4567
25. H.D. Critchley, C.J. Mathias, O. Josephs, J. O'Doherty, S. Zanini, and B.-K. Dewar Human cingulate cortex and autonomic control: Converging neuroimaging and clinical evidence Brain 126 2003 2139 2152
26. M.D. Crutcher, and G.E. Alexander Movement-related neuronal activity selectively coding either direction or muscle pattern in three motor areas of the monkey Journal of Neurophysiology 64 1990 151 163
27. de Bruijn, E., Hulstijn, W., Verkes, R. J., Ruigt, G. S. F., & Sabbe, B. G. C. (in press). Drug-induced stimulation and suppression of action monitoring in healthy volunteers. Psychopharmacology
28. G.I. de Zubicaray, C. Andrew, F.O. Zelaya, S.C.R. Williams, and C. Dumanoir Motor response suppression and the prepotent tendency to respond: A parametric fMRI study Neuropsychologia 38 2000 1280 1291
29. F.C.L. Donkers, and G.J.M. van Boxtel The N2 in go/no-go tasks reflects conflict monitoring not response inhibition Brain and Cognition 56 2004 165 176
30. W.C. Drevets, J.L. Price, J.R. Simpson Jr., R.D. Todd, T. Reich, and M. Vannier Subgenual prefrontal cortex abnormalities in mood disorders Nature 386 1997 824 827
31. J. Duncan, and A.M. Owen Common regions of the human frontal lobe recruited by diverse cognitive demands Trends in Neurosciences 23 2000 475 483
32. R.M. Eenshuistra, K.R. Ridderinkhof, and M.W. van der Molen Age changes in antisaccade task performance: Inhibitory control or working-memory engagement? Brain and Cognition 56 2004 177 188
33. R. Elliot, K.J. Friston, and R.J. Dolan Dissociable neural responses in human reward systems Journal of Neuroscience 20 2000 6159 6165
34. P.C. Fletcher, T. Shallice, C.D. Frith, R.S. Frackowiak, and R.J. Dolan The functional roles of prefrontal cortex in episodic memory II. Retrieval Brain 121 1998 1249 1256
35. D.J. Freedman, M. Riesenhuber, T. Poggio, and E.K. Miller Categorical representation of visual stimuli in the primate prefrontal cortex Science 291 2001 312 316
36. H. Garavan, T.J. Ross, and E.A. Stein Right hemispheric dominance of inhibitory control: An event-related functional MRI study Proceedings of the National Academy of Sciences of the United States of America 96 1999 8301 8306
37. H. Garavan, T.J. Ross, K. Murphy, R.A. Roche, and E.A. Stein Dissociable executive functions in the dynamic control of behavior: inhibition, error detection, and correction NeuroImage 17 2002 1820 1829
38. H. Gemba, K. Sasaki, and V.B. Brooks 'Error' potentials in limbic cortex (anterior cingulate area 24) of monkeys during motor learning Neuroscience Letters 70 1986 223 227
39. J.I. Gold Linking reward expectation to behavior in the basal ganglia Trends in Neurosciences 26 2003 12 14
40. G. Goldberg Supplementary motor area structure and function: Review and hypotheses Behavioral and Brain Sciences 8 1985 567 616
41. D. Guitton, H.A. Buchtel, and R.M. Douglas Frontal lobe lesions in man cause difficulties in suppressing reflexive glances and in generating goal-directed saccades Experimental Brain Research 58 1985 455 472
42. K.A. Hadland, M.F.S. Rushworth, R.E. Passingham, M. Jahanshahi, and J.C. Rothwell Interference with performance of a response selection task that has no working memory component: An rTMS comparison of the dorsolateral prefrontal and medial frontal cortex Journal of Cognitive Neuroscience 13 2001 1097 1108
43. G. Hajcak, N. McDonald, and R.F. Simons Error-related psychophysiology and negative affect Brain and Cognition 56 2004 189 197
44. R.P. Hasegawa, B.W. Paterson, and M.E. Goldberg Prefrontal neurons coding suppression of specific saccades Neuron 43 2004 415 425
45. E. Hazeltine, R. Poldrack, and J.D.E. Gabrieli Neural activation during response competition Journal of Cognitive Neuroscience 12 2000 118 129
46. E. Hazeltine, S.A. Bunge, M.D. Scanlon, and J.D.E. Gabrieli Material-dependent and material-independent selection processes in the frontal and parietal lobes: an eventrelated fMRI investigation of response competition Neuropsychologia 41 2003 1208 1217
47. R. Hester, C. Fassbender, and H. Garavan Individual differences in error processing: A review and reanalysis of three event-related fMRI studies using the Go/NoGo task Cerebral Cortex 14 2004 986 994
48. K. Hikosaka, and M. Watanabe Delay activity of orbital and lateral prefrontal neurons of the monkey varying with different rewards Cerebral Cortex 10 2000 263 271
49. C.B. Holroyd, and M.G.H. Coles The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity Psychological Review 109 2002 679 709
50. C.B. Holroyd, S. Nieuwenhuis, R.B. Mars, and M.G.H. Coles Anterior cingulate cortex, selection for action, and error processing M.I. Posner Cognitive neuroscience of attention 2004 Guilford Press New York 281 304
51. S. Ito, V. Stuphorn, J.W. Brown, and J.D. Schall Performance monitoring by the anterior cingulate cortex during saccade countermanding Science 302 2003 120 122
52. S.D. Iversen, and M. Mishkin Perseverative interference in monkeys following selective lesions of the inferior prefrontal convexivity Experimental Brain Research 11 1970 376 386
53. Jiang, Y., & Kanwisher, N., (2003). Common neural substrates for response selection across modalities and mapping paradigms. Journal of Cognitive Neuroscience, 15, 1080-1094
54. A.M.C. Kelly, R. Hester, K. Murphy, D.C. Javitt, J.J. Foxe, and H. Garavan Prefrontalâ€"subcortical dissociations underlying inhibitory control revealed by event-related fMRI European Journal of Neuroscience 19 2004 3105 3112
55. J.G. Kerns, J.D. Cohen, A.W. MacDonald, R.Y. Cho, V.A. Stenger, and C.S. Carter Anterior cingulate conflict monitoring and adjustments in control Science 303 2004 1023 1026
56. S. Konishi, K. Nakajima, I. Uchida, H. Kikyo, M. Kameyama, and Y. Miyashita Common inhibitory mechanism in human inferior prefrontal cortex revealed by event-related fMRI Brain 122 1999 981 991
57. L. Koski, and T. Paus Functional connectivity of the anterior cingulate cortex within the human frontal lobe: A brain-mapping meta-analysis Experimental Brain Research 133 2000 55 65
58. J. Lauwereyns, K. Watanabe, B. Coe, and O. Hikosaka A neural correlate of response bias in monkey caudate nucleus Nature 418 2002 413 417
59. M.I. Leon, and M.N. Shadlen Effect of expected reward magnitude on the response of neurons in the dorsolateral prefrontal cortex of the macaque Neuron 24 1999 415 425
60. P.M. Lewinsohn, M.A. Youngren, and S.J. Grosscup Reinforcement and depression R.A. Depue The psychobiology of depressive disorders 1979 Academic Press New York 291 316
61. G.D. Logan, and W.B. Cowan On the ability to inhibit thought and action: a theory of an act of control Psychological Review 91 1984 295 327
62. K. Matsumoto, and K. Tanaka Conflict and cognitive control Science 303 2004 969 970
63. K. Matsumoto, and K. Tanaka The role of medial prefrontal cortex in achieving goals Current Opinion in Neurobiology 14 2004 178 185
64. K. Matsumoto, W. Suzuki, and K. Tanaka Neuronal correlates of goal-based motor selection in the prefrontal cortex Science 301 2003 229 232
65. E.K. Miller, and J.D. Cohen An integrative theory of prefrontal cortex function Annual Review of Neuroscience 24 2001 167 202
66. M. Mishkin Perseveration of central sets after frontal lesions in monkeys J.M. Warren K. Akert The frontal granular cortex and behavior 1964 McGraw-Hill New York 219 241
67. A.B. Mulder, R.E. Nordquist, O. Orgut, and C.M.A. Pennartz Learning-related changes in response patterns of prefrontal neurons during instrumental conditioning Behavioral and Brain Research 146 2003 77 88
68. S. Nieuwenhuis, N. Yeung, W.P.M. van den Wildenberg, and K.R. Ridderinkhof Electrophysiological correlates of anterior cingulate function in a Go/NoGo task: Effects of response conflict and trial-type frequency Cognitive, Affective, and Behavioral Neuroscience 3 2003 17 26
69. S. Nieuwenhuis, A. Broerse, M.M.A. Nielen, and R. de Jong A goal activation approach to the study of executive function: An application to antisaccade tasks Brain and Cognition 56 2004 198 214
70. J.T. Nigg Is ADHD a disinhibitory disorder? Psychological Bulletin 127 2001 571 598
71. J. O'Doherty, H. Critchley, R. Deichmann, and R.J. Dolan Dissociating valence of outcome from behavioral control in human orbital and ventral prefrontal cortices Journal of Neuroscience 23 2003 7931 7939
72. J. O'Doherty, M.L. Kringelbach, E.T. Rolls, J. Hornak, and C. Andrews Abstract reward and punishment representations in the human orbitofrontal cortex Nature Neuroscience 4 2001 95 102
73. R.T. Ollman Simple reactions with random countermanding of the "Go'" signal S. Kornblum Attention and performance IV 1973 Academic Press New York 571 581
74. D. Ö-ngür, and J.L. Price The organization of networks within the orbital and medial prefrontal cortex of rats, monkeys and humans Cerebral Cortex 10 2000 206 219
75. Pailing, P., & Segalowitz, S. J. (2004). The effects of uncertainty in error monitoring on associated ERPs. Brain and Cognition [this volume]
76. R.E. Passingham, I. Toni, and M.F.S. Rushworth Specialisation within the prefrontal cortex: The ventral prefrontal cortex and associative learning Experimental Brain Research 133 2000 103 113
77. M.P. Paulus, N. Hozack, L. Frank, and G.G. Brown Error rate and outcome predictability affect neural activation in prefrontal cortex and anterior cingulate during decision-making NeuroImage 15 2002 836 846
78. T. Paus Primate anterior cingulate cortex: where motor control, drive and cognition interface Nature Reviews Neuroscience 2 2001 417 424
79. C. Pierrot-Deseilligny, R.M. Müri, C.J. Ploner, B. Gaymard, S. Demeret, and S. Rivaud-Pechoux Decisional role of the dorsolateral prefrontal cortex in oculomotor behavior Brain 126 2003 1460 1473
80. M.L. Platt, and P.W. Glimcher Neural correlates of decision variables in parietal cortex Nature 200 1999 233 238
81. P. Rainville, G.H. Duncan, D.D. Price, B. Carrier, and M.C. Bushnell Pain affect encoded in human anterior cingulate but not somatosensory cortex Science 277 1997 968 971
82. J.R. Ramautar, A. Kok, and K.R. Ridderinkhof Effects of stop-signal probability in the stop-signal paradigm: The N2/P3 complex further validated Brain and Cognition 56 2004 234 252
83. K.R. Ridderinkhof, Y. de Vlugt, A. Bramlage, M. Spaan, and M. Elton Alcohol consumption impairs the detection of performance errors by mediofrontal cortex Science 298 2002 2209 2211
84. K.R. Ridderinkhof, S.N. Nieuwenhuis, and T.R. Bashore Errors are fore-shadowed in brain potentials associated with action monitoring in cingulate cortex Neuroscience Letters 348 2003 1 4
85. Ridderinkhof, K.R., Scheres, A., Oosterlaan, J., & Sergeant, J. (in press). Distribution-analytical techniques in the study of ADHD: Delta plot analyses reveal deficits in response suppression that are eliminated by methylphenidate treatment. Journal of Abnormal Psychology
86. K.R. Ridderinkhof, M. Ullsperger, A.E. Crone, and S. Nieuwenhuis Role of the medial frontal cortex in cognitive control Science 2004 306
87. K.R. Ridderinkhof, W.P.M. van den Wildenberg, J. Wijnen, and B. Burle Response inhibition in conflict tasks is revealed in delta plots M. Posner Cognitive neuroscience of attention 2004 Guilford Press. New York
88. T.W. Robbins, and B.J. Everitt Functions of dopamine in the dorsal and ventral striatum Seminars in Neuroscience 4 1992 119 127
89. E.T. Rolls The orbitofrontal cortex and reward Cerebral Cortex 20 2000 284 294
90. E.T. Rolls, M.L. Kringelbach, and I.E. de Araujo Different representations of pleasant and unpleasant odours in the human brain European Journal of Neuroscience 18 2003 695 703
91. H.E. Rosvold, A.F. Mirsky, L. Sarason, E.D. Bransome, and L.H. Beck A continuous performance test of brain damage Journal of Consultative Psychology 20 1956 343 350
92. J.B. Rowe, I. Toni, O. Josephs, R.S.J. Frackowiak, and R.E. Passingham The prefrontal cortex: response selection or maintenance within working memory? Science 288 2000 1656 1660
93. J.B. Rowe, and R.E. Passingham Working memory for location and time: activity in prefrontal area 46 relates to selection rather than maintenance in memory Neuroimage 14 2001 77 86
94. K. Rubia, A.B. Smith, M.J. Brammer, and E. Taylor Right inferior prefrontal cortex mediates response inhibition while mesial prefrontal cortex is responsible for error detection Neuroimage 20 2003 351 358
95. M. Sakagami, K. Tsutsui, J. Lauwereyns, M. Koizumi, S. Kobayashi, and O. Hikosaka A code for behavioral inhibition on the basis of color, but not motion, in ventrolateral prefrontal cortex of macaque monkey Journal of Neuroscience 21 2001 4801 4808
96. K. Sasaki, H. Gemba, and T. Tsujimoto Suppression of visually initiated hand movement by stimulation of the prefrontal cortex in the monkey Brain Research 495 1989 100 107
97. J.D. Schall Neural basis of deciding, choosing and acting Nature Review Neuroscience 2 2001 33 42
98. J.D. Schall, V. Stuphorn, and J.W. Brown Monitoring and control of action by the frontal lobes Neuron 36 2002 309 322
99. W. Schultz Getting formal with dopamine and reward Neuron 36 2002 241 263
100. E.H. Schumacher, P.A. Elston, and M. D'Esposito Neural evidence for stimulus specific response selection in human cortex Journal of Cognitive Neuroscience 15 2003 1111 1121
101. E.H. Schumacher, and M. D'Esposito Neural implementation of response selection in humans as revealed by localized effects of stimulus-response compatibility on brain activation Human Brain Mapping 17 2002 193 201
102. M. Shidara, and B. Richmond Anterior cingulate: single neuronal signals related to degree of reward expectancy Science 296 2002 1709 1711
103. K. Shima, and J. Tanji Role for cingulated motor area cells in voluntary movement selection based on reward Science 282 1998 1335 1338
104. E.R. Sowell, P.M. Thompson, S.E. Welcome, A.L. Henkenius, A.W. Toga, and B.S. Peterson Cortical abnormalities in children and adolescents with attention-deficit hyperactivity disorder The Lancet 362 2003 1699 1707
105. C.E. Stern, and R.E. Passingham The nucleus accumbens in monkeys (Macaca fascicularis): II. Emotion and motivation Behavioural and Brain Research 75 1996 179 193
106. P.L. Strick, R.P. Dum, and N. Picard Macro-organization of the circuits connecting the basal ganglia with the cortical areas J.C. Houk J.L. Davis D.G. Beiser Models of information processing in the basal ganglia 1995 MIT Press Cambridge, MA 117 130
107. V. Stuphorn, T.L. Taylor, and J.D. Schall Performance monitoring by the supplementary eye field Nature 408 2000 857 860
108. Tieges, Z., Ridderinkhof, K. R., Snel, J., & Kok, A. (2004). Caffeine intensifies action monitoring: Evidence from the error-related negativity. Cognitive Brain Research, 21, 87-93
109. L. Tremblay, and W. Schultz Modifications of reward expectation-related neuronal activity during learning in primate orbitofrontal cortex Journal of Neurophysiology 83 2000 1877 1885
110. S. Tsujimoto, and T. Sawaguchi Neuronal representation of response outcome in the primate prefrontal cortex Cerebral Cortex 14 2004 47 55
111. M. Ullsperger, and D.Y. von Cramon Error monitoring using external feedback: specific roles of the habenular complex, the reward system, and the cingulated motor area revealed by functional magnetic resonance imaging Journal of Neuroscience 233 2003 4308 4314
112. M. Ullsperger, and D.Y. von Cramon Neuroimaging of performance monitoring: Error detection and beyond Cortex 40 2004 593 604
113. C.J. Vaidya, G. Austin, G. Kirkorian, H.W. Ridlehuber, J.E. Desmond, and G.H. Glover Selective effects of methylphenidate in attention deficit hyperactivity disorder: A functional magnetic resonance study Proceedings of the National Academy of Sciences of the United States of America 95 1998 14494 14499
114. W.P. van den Wildenberg, M, and M.W. van der Molen Additive factors analysis of inhibitory processing in the stop-signal paradigm Brain and Cognition 56 2004 253 266
115. van den Wildenberg, W. P. M., van Boxtel, G. J. M., van der Molen, M. W., Bosch, D. A., Speelman, J. D., Brunia, C. H. M. (2004). Stimulation of the subthalamic nucleus facilitates the selection and inhibition of motor responses in Parkinson's disease (submitted for publication)
116. V. van Veen, C.B. Holroyd, J.D. Cohen, Stenger V.A, and C.S. Carter Errors without conflict: Implications for performance monitoring theories of anterior cingulate cortex Brain and Cognition 56 2004 267 276
117. P. Waelti, A. Dickinson, and W. Schultz Dopamine responses comply with basic assumptions of formal learning theory Nature 412 2001 43 48
118. Watanabe, M. (1986). Prefrontal unit activity during delayed conditional Go/No-Go discrimination in the monkey. II. Relation to Go and No-Go responses. Brain Research, 382, 15-27
119. Yeung, N., Botvinick, M. M., & Cohen, J. D. (in press). The neural basis of error detection: Conflict monitoring and the error-related negativity. Psychological Review
120. P.J. Zirnheld, C.A. Carroll, P.C. Kieffaber, B.F. O'Donnell, A. Shekhar, and W.P. Hetrick Haloperidol impairs learning and error-related negativity in humans Journal of Cognitive Neuroscience 16 2004 1098 1112