The role of the medial prefrontal cortex in achieving goals

Current Opinion in Neurobiology

Volumn 14, Issue 2, 2004, Pages 178-185

  Matsumoto, Kenji ^a   Tanaka, Keiji ^a  

^a RIKEN BRAIN SCIENCE INSTITUTE   (Japan)

Author keywords

Differential outcomes effect; DOE; ERN; Error related negativity; PFC; Prefrontal cortex

Indexed keywords

ASSOCIATION; AUDITORY STIMULATION; BRAIN FUNCTION; BRAIN NERVE CELL; CINGULATE GYRUS; CONTINGENT NEGATIVE VARIATION; DISCRIMINATION LEARNING; DISCRIMINATIVE STIMULUS; ENVIRONMENTAL FACTOR; EXPECTATION; HUMAN; MEMORY; MONKEY; NONHUMAN; PREFRONTAL CORTEX; PRIORITY JOURNAL; REVIEW; REWARD; STIMULUS RESPONSE; TASK PERFORMANCE;

ANIMALS; BEHAVIOR, ANIMAL; COGNITION; CUES; GOALS; HUMANS; LEARNING; NEURONS; PREFRONTAL CORTEX; REWARD;

EID: 1842785707     PISSN: 09594388     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.conb.2004.03.005     Document Type: Review

References (66)

1. Adams CD, Dickinson A: Actions and habits: variations in associative representations during instrumental learning. In Information Processing in Animals: Memory Mechanisms. Edited by Spear NE, Miller RR. Hillsdale NJ: Lawrence Erlbaum Associates; 1981:143-165.
2. Goel V., Grafman J. Are the frontal lobes implicated in "planning" functions? Interpreting data from the Tower of Hanoi. Neuropsychologia. 33:1995;623-642.
3. Dehaene S., Changeux J.P. A hierarchical neuronal network for planning behavior. Proc Natl Acad Sci U S A. 94:1997;13293-13298.
4. Baxter M.G., Murray E.A. The amygdala and reward. Nat Rev Neurosci. 3:2002;563-573.
5. Cardinal R.N., Parkinson J.A., Hall J., Everitt B.J. Emotion and motivation: the role of the amygdala, ventral striatum, and prefrontal cortex. Neurosci Biobehav Rev. 26:2002;321-352 The authors present a comprehensive review of the studies about conditioning. This review parses the processes of classical and instrumental conditioning and proposes which brain structures might correspond to each of the processes. This study is an excellent bridge between neuroscience and animal psychology.
6. Watanabe M. Reward expectancy in primate prefrontal neurons. Nature. 382:1996;629-632.
7. Kawagoe R., Takikawa Y., Hikosaka O. Expectation of reward modulates cognitive signals in the basal ganglia. Nat Neurosci. 1:1998;411-416.
8. Shima K., Tanji J. Role for cingulate motor area cells in voluntary movement selection based on reward. Science. 282:1998;1335-1338.
9. Leon M.I., Shadlen M.N. Effect of expected reward magnitude on the response of neurons in the dorsolateral prefrontal cortex of the macaque. Neuron. 24:1999;415-425.
10. Platt M.L., Glimcher P.W. Neural correlates of decision variables in parietal cortex. Nature. 400:1999;233-238.
11. Tremblay L., Schultz W. Relative reward preference in primate orbitofrontal cortex. Nature. 398:1999;704-708.
12. Kobayashi S., Lauwereyns J., Koizumi M., Sakagami M., Hikosaka O. Influence of reward expectation on visuospatial processing in macaque lateral prefrontal cortex. J Neurophysiol. 87:2002;1488-1498.
13. Lauwereyns J., Watanabe K., Coe B., Hikosaka O. A neural correlate of response bias in monkey caudate nucleus. Nature. 418:2002;413-417 In this study, monkeys performed an oculomotor delayed saccade task with asymmetrical reward. In trial blocks in which the reward was associated with saccades to the visual hemifield contralateral to the neuron, neurons in the caudate nucleus fired at the beginning of individual trials before the target cue appeared. This activity might represent the reward rule.
14. Matsumoto K., Suzuki W., Tanaka K. Neuronal correlates of goal-based motor selection in the prefrontal cortex. Science. 301:2003;229-232.
15. Hadland K.A., Rushworth M.F., Gaffan D., Passingham R.E. The anterior cingulate and reward-guided selection of actions. J Neurophysiol. 89:2003;1161-1164 In this study, monkeys had to perform one of two actions to get the same type reward that was presented to them at the beginning of the trial, according to a rule of action-reward correspondence. A lesion of the anterior cingulate cortex impaired the performance of this task, but not the visual discrimination learning. This was the first lesion study to show the importance of the anterior cingulate cortex in learning of reward-based action selection.
16. Bush G., Vogt B.A., Holmes J., Dale A.M., Greve D., Jenike M.A., Rosen B.R. Dorsal anterior cingulate cortex: a role in reward-based decision making. Proc Natl Acad Sci U S A. 99:2002;523-528.
17. Peterson G.B., Trapold M.A. Effects of altering outcome expectancies on Pigeons' delayed conditional discrimination performance. Learn Motiv. 11:1980;267-288.
18. Overmier J.B., Linwick D. Conditional choice-unique outcomes establish expectancies that mediate choice behavior. Integr Physiol Behav Sci. 36:2001;173-181.
19. Savage L.M. In search of the neurobiological underpinnings of the differential outcomes effect. Integr Physiol Behav Sci. 36:2001;182-195.
20. Peterson G.B., Wheeler R.L., Trapold M.A. Enhancement of pigeons' conditional discrimination performance by expectancies of reinforcement and nonreinforcement. Anim Learn Behav. 8:1980;22-30.
21. Dickinson A., Balleine B. Motivational control of goal-directed action. Anim Learn Behav. 22:1994;1-18.
22. Walton M.E., Bannerman D.M., Rushworth M.F. The role of rat medial frontal cortex in effort-based decision making. J Neurosci. 22:2002;10996-11003 By lesioning the rat medial prefrontal cortex, the authors found that it is involved in assessing the amount of effort required in executing an action in balance with the expected reward value. This is a well-controlled lesion study, which firstly showed the contribution of the medial prefrontal cortex to the assessment of balance between action efforts and reward values.
23. Walton M.E., Bannerman D.M., Alterescu K., Rushworth M.F. Functional specialization within medial frontal cortex of the anterior cingulate for evaluating effort-related decisions. J Neurosci. 23:2003;6475-6479.
24. Thut G., Schultz W., Roelcke U., Nienhusmeier M., Missimer J., Maguire R.P., Leenders K.L. Activation of the human brain by monetary reward. Neuroreport. 8:1997;1225-1228.
25. Knutson B., Fong G.W., Bennett S.M., Adams C.M., Hommer D. A region of mesial prefrontal cortex tracks monetarily rewarding outcomes: characterization with rapid event-related fMRI. Neuroimage. 18:2003;263-272.
26. O'Doherty J., Critchley H., Deichmann R., Dolan R.J. Dissociating valence of outcome from behavioral control in human orbital and ventral prefrontal cortices. J Neurosci. 23:2003;7931-7939 Using the probabilistic feedback, the authors dissociated the outcome value from the response switch. This is the first fMRI demonstration of the involvement of the ventromedial prefrontal cortex in both reward value representation and behavioral control. There was a slight difference in the precise location of activations corresponding to the two functions.
27. Niki H., Watanabe M. Prefrontal unit activity and delayed response: relation to cue location versus direction of response. Brain Res. 105:1976;79-88.
28. Thorpe S.J., Rolls E.T., Maddison S. The orbitofrontal cortex: neuronal activity in the behaving monkey. Exp Brain Res. 49:1983;93-115.
29. Watanabe M. The appropriateness of behavioral responses coded in post-trial activity of primate prefrontal units. Neurosci Lett. 101:1989;113-117.
30. Nakamura K., Mikami A., Kubota K. Activity of single neurons in the monkey amygdala during performance of a visual discrimination task. J Neurophysiol. 67:1992;1447-1463.
31. Hikosaka O., Sakamoto M., Usui S. Functional properties of monkey caudate neurons. III. Activities related to expectation of target and reward. J Neurophysiol. 61:1989;814-832.
32. Apicella P., Ljungberg T., Scarnati E., Schultz W. Responses to reward in monkey dorsal and ventral striatum. Exp Brain Res. 85:1991;491-500.
33. Bowman E.M., Aigner T.G., Richmond B.J. Neural signals in the monkey ventral striatum related to motivation for juice and cocaine rewards. J Neurophysiol. 75:1996;1061-1073.
34. Matsumura M., Kojima J., Gardiner T.W., Hikosaka O. Visual and oculomotor functions of monkey subthalamic nucleus. J Neurophysiol. 67:1992;1615-1632.
35. Schultz W. Predictive reward signal of dopamine neurons. J Neurophysiol. 80:1998;1-27.
36. Waelti P., Dickinson A., Schultz W. Dopamine responses comply with basic assumptions of formal learning theory. Nature. 412:2001;43-48.
37. Berridge K.C., Robinson T.E. Parsing reward. Trends Neurosci. 26:2003;507-513.
38. Holroyd C.B., Coles M.G. The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. Psychol Rev. 109:2002;679-709.
39. Ito S., Stuphorn V., Brown J.W., Schall J.D. Performance monitoring by the anterior cingulate cortex during saccade countermanding. Science. 302:2003;120-122.
40. Stuphorn V., Taylor T.L., Schall J.D. Performance monitoring by the supplementary eye field. Nature. 408:2000;857-860.
41. Shidara M., Richmond B.J. Anterior cingulate: single neuronal signals related to degree of reward expectancy. Science. 296:2002;1709-1711 The authors found that neurons in the ventral bank of the anterior part of the cingulate sulcus represented the position of the current trial within a multi trial reward schedule with a distinction between the preparatory steps and the final step. This is a pioneering study that examined a new aspect of motivation-cognition interaction required in executing multiple action steps to achieve a goal.
42. Fuster JM: The Prefrontal Cortex: Anatomy, Physiology, and Neuropsychology of the Frontal Lobe, edn 3. Philadelphia: Lippincott-Raven; 1997.
43. Pandya D.N., Van Hoesen G.W., Mesulam M.M. Efferent connections of the cingulate gyrus in the rhesus monkey. Exp Brain Res. 42:1981;319-330.
44. Vogt B.A., Pandya D.N. Cingulate cortex of the rhesus monkey: II. Cortical afferents. J Comp Neurol. 262:1987;271-289.
45. Morecraft R.J., Van Hoesen G.W. Frontal granular cortex input to the cingulate (M3), supplementary (M2) and primary (M1) motor cortices in the rhesus monkey. J Comp Neurol. 337:1993;669-689.
46. Petrides M., Pandya D.N. Dorsolateral prefrontal cortex: comparative cytoarchitectonic analysis in the human and the macaque brain and corticocortical connection patterns. Eur J Neurosci. 11:1999;1011-1036.
47. Cavada C., Company T., Tejedor J., Cruz-Rizzolo R.J., Reinoso-Suarez F. The anatomical connections of the macaque monkey orbitofrontal cortex. A review. Cereb Cortex. 10:2000;220-242.
48. Paus T., Castro-Alamancos M.A., Petrides M. Cortico-cortical connectivity of the human mid-dorsolateral frontal cortex and its modulation by repetitive transcranial magnetic stimulation. Eur J Neurosci. 14:2001;1405-1411.
49. Koechlin E., Corrado G., Pietrini P., Grafman J. Dissociating the role of the medial and lateral anterior prefrontal cortex in human planning. Proc Natl Acad Sci U S A. 97:2000;7651-7656.
50. Freedman D.J., Riesenhuber M., Poggio T., Miller E.K. Categorical representation of visual stimuli in the primate prefrontal cortex. Science. 291:2001;312-316.
51. Nieder A., Freedman D.J., Miller E.K. Representation of the quantity of visual items in the primate prefrontal cortex. Science. 297:2002;1708-1711.
52. Funahashi S., Bruce C.J., Goldman-Rakic P.S. Mnemonic coding of visual space in the monkey's dorsolateral prefrontal cortex. J Neurophysiol. 61:1989;331-349.
53. Miller E.K., Erickson C.A., Desimone R. Neural mechanisms of visual working memory in prefrontal cortex of the macaque. J Neurosci. 16:1996;5154-5167.
54. Rao S.C., Rainer G., Miller E.K. Integration of what and where in the primate prefrontal cortex. Science. 276:1997;821-824.
55. Ninokura Y., Mushiake H., Tanji J. Representation of the temporal order of visual objects in the primate lateral prefrontal cortex. J Neurophysiol. 89:2003;2868-2873.
56. Rainer G., Asaad W.F., Miller E.K. Selective representation of relevant information by neurons in the primate prefrontal cortex. Nature. 393:1998;577-579.
57. Sakagami M., Niki H. Encoding of behavioral significance of visual stimuli by primate prefrontal neurons: relation to relevant task conditions. Exp Brain Res. 97:1994;423-436.
58. White I.M., Wise S.P. Rule-dependent neuronal activity in the prefrontal cortex. Exp Brain Res. 126:1999;315-335.
59. Asaad W.F., Rainer G., Miller E.K. Task-specific neural activity in the primate prefrontal cortex. J Neurophysiol. 84:2000;451-459.
60. Wallis J.D., Anderson K.C., Miller E.K. Single neurons in prefrontal cortex encode abstract rules. Nature. 411:2001;953-956.
61. Isomura Y., Ito Y., Akazawa T., Nambu A., Takada M. Neural coding of 'attention for action' and 'response selection' in primate anterior cingulate cortex. J Neurosci. 23:2003;8002-8012.
62. Procyk E., Tanaka Y.L., Joseph J.P. Anterior cingulate activity during routine and non-routine sequential behaviors in macaques. Nat Neurosci. 3:2000;502-508.
63. Elliott R., Dolan R.J. Activation of different anterior cingulate foci in association with hypothesis testing and response selection. Neuroimage. 8:1998;17-29.
64. Wang Y., Shima K., Sawamura H., Tanji J. Spatial distribution of cingulate cells projecting to the primary, supplementary, and pre-supplementary motor areas: a retrograde multiple labeling study in the macaque monkey. Neurosci Res. 39:2001;39-49.
65. Luppino G., Matelli M., Camarda R., Rizzolatti G. Corticocortical connections of area F3 (SMA-proper) and area F6 (pre-SMA) in the macaque monkey. J Comp Neurol. 338:1993;114-140.
66. Nakamura K., Sakai K., Hikosaka O. Neuronal activity in medial frontal cortex during learning of sequential procedures. J Neurophysiol. 80:1998;2671-2687.