Medial prefrontal cortex predicts and evaluates the timing of action outcomes

NeuroImage

Volumn 55, Issue 1, 2011, Pages 253-265

  Forster, Sarah E ^a   Brown, Joshua W ^a  

^a INDIANA UNIVERSITY   (United States)

Author keywords

Anterior cingulate; Error signals; Medial prefrontal cortex; Performance monitoring; Reinforcement learning; Timing

Indexed keywords

ADULT; ANALYTICAL ERROR; ANTERIOR CINGULATE; ARTICLE; BRAIN REGION; CINGULATE GYRUS; COGNITION; CONTROLLED STUDY; EXPECTATION; FEEDBACK SYSTEM; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; MALE; NEGATIVE FEEDBACK; NORMAL HUMAN; PREDICTION; PREFRONTAL CORTEX; PRIORITY JOURNAL; TASK PERFORMANCE; TIME PERCEPTION;

ADOLESCENT; ADULT; CHOICE BEHAVIOR; FEMALE; HUMANS; MAGNETIC RESONANCE IMAGING; MALE; NERVE NET; PREFRONTAL CORTEX; TASK PERFORMANCE AND ANALYSIS; YOUNG ADULT;

EID: 78951484449     PISSN: 10538119     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neuroimage.2010.11.035     Document Type: Article

References (79)

1. Alexander W., Brown J. A computational neural model of learned response-outcome predictions by anterior cingulate cortex. Program No. 682.21 2008, Neuroscience Meeting Planner, Washington DC.
2. Alexander W.H., Brown J.W. Competition between learned reward and error outcome predictions in anterior cingulate cortex. Neuroimage 2010, 49(4):3210-3218.
3. Alexander W., Brown J Computational models of performance monitoring and cognitive control. Topics Cogn. Sci. 2010, 2(4):658-677.
4. Amador N., Schlag-Rey M., Schlag J. Reward-predicting and reward-detecting neuronal activity in the primate supplementary eye field. J. Neurophysiol. 2000, 84:2166-2170.
5. Andersson J.L., Hutton C., Ashburner J., Turner R., Friston K. Modeling geometric deformations in EPI time series. Neuroimage 2001, 13:903-919.
6. Behrens T.E., Woolrich M.W., Walton M.E., Rushworth M.F. Learning the value of information in an uncertain world. Nat. Neurosci. 2007, 10:1214-1221.
7. Berger B., Gaspar P., Verney C. Dopaminergic innervation of the cerebral cortex: unexpected differences between rodents and primates. TINS 1991, 14:21-27.
8. Berridge K.C., Robinson T.E. What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?. Brain Res. Brain Res. Rev. 1998, 28:309-369.
9. Botvinick M.M. Conflict monitoring and decision making: reconciling two perspectives on anterior cingulate function. Cogn. Affect. Behav. Neurosci. 2007, 7:356-366.
10. Botvinick M.M., Braver T.S., Barch D.M., Carter C.S., Cohen J.C. Conflict monitoring and cognitive control. Psychol. Rev. 2001, 108:624-652.
11. Braet W., Johnson K.A., Tobin C.T., Acheson R., Bellgrove M.A., Robertson I.H., Garavan H. Functional developmental changes underlying response inhibition and error-detection processes. Neuropsychologia 2009, 47:3143-3151.
12. Bromberg-Martin E.S., Hikosaka O. Midbrain dopamine neurons signal preference for advance information about upcoming rewards. Neuron 2009, 63:119-126.
13. Brown J.W., Braver T.S. Learned predictions of error likelihood in the anterior cingulate cortex. Science 2005, 307:1118-1121.
14. Brown J., Bullock D., Grossberg S. How the basal ganglia use parallel excitatory and inhibitory learning pathways to selectively respond to unexpected rewarding cues. J. Neurosci. 1999, 19:10502-10511.
15. Bueti D., Walsh V., Frith C., Rees G. Different brain circuits underlie motor and perceptual representations of temporal intervals. J. Cogn. Neurosci. 2008, 20:204-214.
16. Bush G., Vogt B.A., Holmes J., Dale A.M., Greve D., Jenike M.A. Dorsal anterior cingulate cortex: a role in reward-based decision making. PNAS 2002, 99:507-512.
17. Carter C.S., Braver T.S., Barch D.M., Botvinick M.M., Noll D., Cohen J.D. Anterior cingulate cortex, error detection, and the online monitoring of performance. Science 1998, 280:747-749.
18. Chevrier A.D., Noseworthy M.D., Schachar R. Dissociation of response inhibition and performance monitoring in the stop signal task using event-related fMRI. Hum. Brain Mapp. 2007, 28:1347-1358.
19. Christopoulos G.I., Tobler P.N., Bossaerts P., Dolan R.J., Schultz W. Neural correlates of value, risk, and risk aversion contributing to decision making under risk. J. Neurosci. 2009, 29:12574-12583.
20. Cohen M.X., Ranganath C. Reinforcement learning signals predict future decisions. J. Neurosci. 2007, 27:371-378.
21. Croxson P.L., Walton M.E., O'Reilly J.X., Behrens T.E., Rushworth M.F. Effort-based cost-benefit valuation and the human brain. J. Neurosci. 2009, 29:4531-4541.
22. Dale A.M. Optimal experimental design for event-related fMRI. Hum. Brain Mapp. 1999, 8:109-114.
23. Dehaene S., Posner M.I., Tucker D.M. Localization of a neural system for error detection and compensation. Psychol. Sci. 1994, 5:303-306.
24. Durston S., Davidson M.C., Thomas K.M., Worden M.S., Tottenham N., Martinez A., Watts R., Ulug A.M., Casey B.J. Parametric manipulation of conflict and response competition using rapid mixed-trial event-related fMRI. Neuroimage 2003, 20:2135-2141.
25. Eblen F., Graybiel A.M. Highly restricted origin of prefrontal cortical inputs to striosomes in the macaque monkey. J. Neurosci. 1995, 15:5999-6013.
26. Fan J., Hof P.R., Guise K.G., Fossella J.A., Posner M.I. The functional integration of the anterior cingulate cortex during conflict processing. Cereb. Cortex 2008, 18:796-805.
27. Fiala J.C., Grossberg S., Bullock D. Metabotropic glutamate receptor activation in cerebellar Purkinje cells as substrate for adaptive timing of the classically conditioned eye-blink response. J. Neurosci. 1996, 16:3760-3774.
28. Fiorillo C.D., Tobler P.N., Schultz W. Discrete coding of reward probability and uncertainty by dopamine neurons. Science 2003, 299:1898-1902.
29. Gaspar P., Berger B., Febvret A., Vigny A., Henry J.P. Catecholamine innervation of the human cerebral cortex as revealed by comparative immunohistochemistry of tyrosine hydroxylase and dopamine-beta-hydroxylase. J. Comp. Neurol. 1989, 279:249-271.
30. Gehring W.J., Goss B., Coles M.G., Meyer D.E., Donchin E. A neural system for error-detection and compensation. Psychol. Sci. 1993, 4:385-390.
31. Hester R., Fassbender C., Garavan H. Individual differences in error processing: a review and reanalysis of three event-related fMRI studies using the GO/NOGO task. Cereb. Cortex 2004, 14:986-994.
32. Hester R., Madeley J., Murphy K., Mattingley J.B. Learning from errors: error-related neural activity predicts improvements in future inhibitory control performance. J. Neurosci. 2009, 29:7158-7165.
33. Hewig J., Straube T., Trippe R.H., Kretschmer N., Hecht H., Coles M.G., Miltner W.H. Decision-making under risk: an fMRI study. J. Cogn. Neurosci. 2009, 21:1642-1652.
34. Hollerman J.R., Schultz W. Dopamine neurons report an error in the temporal prediction of reward during learning. Nat. Neurosci. 1998, 1:304-309.
35. Holroyd C.B., Coles M.G. The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. Psych. Rev. 2002, 109:679-709.
36. Holroyd C.B., Yeung N., Coles M.G., Cohen J.D. A mechanism for error detection in speeded response time tasks. J. Exp. Psychol. Gen. 2005, 134:163-191.
37. Ito S., Stuphorn V., Brown J., Schall J.D. Performance monitoring by anterior cingulate cortex during saccade countermanding. Science 2003, 302:120-122.
38. Ivry R.B., Spencer R.M. The neural representation of time. Curr. Opin. Neurobiol. 2004, 14:225-232.
39. Jessup R.K., Busemeyer J.R., Brown J.W. Error effects in anterior cingulate cortex reverse when error likelihood is high. J. Neurosci 2010, 30(9):3467-3472.
40. Kennerley S.W., Dahmubed A.F., Lara A.H., Wallis J.D. Neurons in the frontal lobe encode the value of multiple decision variables. J. Cogn. Neurosci. 2009, 21:1162-1178.
41. Li C.S., Yan P., Chao H.H., Sinha R., Paliwal P., Constable R.T., Zhang S., Lee T.W. Error-specific medial cortical and subcortical activity during the stop signal task: a functional magnetic resonance imaging study. Neuroscience 2008, 155:1142-1151.
42. Ljungberg T., Apicella P., Schultz W. Responses of monkey dopamine neurons during learning of behavioral reactions. J. Neurophysiol. 1992, 67:145-163.
43. Luu P., Flaisch T., Tucker D.M. Medial frontal cortex in action monitoring. J. Neurosci. 2000, 20:464-469.
44. Magno E., Foxe J.J., Molholm S., Robertson I.H., Garavan H. The anterior cingulate and error avoidance. J. Neurosci. 2006, 26:4769-4773.
45. Mathalon D.H., Whitfield S.L., Ford J.M. Anatomy of an error: ERP and fMRI. Biol. Psychol. 2003, 64:119-141.
46. Menon V., Adleman N.E., White C.D., Glover G.H., Reiss A.L. Error-related brain activation during a Go/NoGo response inhibition task. Hum. Brain Mapp. 2001, 12:131-143.
47. Middleton F.A., Strick P.L. Cerebellar output channels. Int. Rev. Neurobiol. 1997, 41:61-82.
48. Middleton F.A., Strick P.L. The cerebellum: an overview. Trends Neurosci. 1998, 21:367-369.
49. Middleton F.A., Strick P.L. Cerebellar projections to the prefrontal cortex of the primate. J. Neurosci. 2001, 21:700-712.
50. Miltner W.H.R., Braun C.H., Coles M.G.H. Event-related brain potentials following incorrect feedback in a time-estimation task: evidence for a "generic" neural system for error detection. J. Cogn. Neurosci. 1997, 9:788-798.
51. Mirenowicz J., Schultz W. Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli. Nature 1996, 379:449-451.
52. Modirrousta M., Fellows L.K. Dorsal medial prefrontal cortex plays a necessary role in rapid error prediction in humans. J. Neurosci. 2008, 28:14000-14005.
53. Myerson J., Green L. Discounting of delayed rewards: models of individual choice. J. Exp. Anal. Behav. 1995, 64:263-276.
54. Niki H., Watanabe M. Prefrontal and cingulate unit activity during timing behavior in the monkey. Brain Res. 1979, 171:213-224.
55. O'Doherty J.P., Hampton A., Kim H. Model-based fMRI and its application to reward learning and decision making. Ann. NY Acad. Sci. 2007, 1104:35-53.
56. Oppenheim A.V., Schafer R.W., Buck J.R. Discrete-Time Signal Processing 1999, Prentice Hall, Upper Saddle River, NJ. 2 ed.
57. O'Reilly J.X., Mesulam M.M., Nobre A.C. The cerebellum predicts the timing of perceptual events. J. Neurosci. 2008, 28:2252-2260.
58. Paulus M.P. Long-range interactions in sequences of human behavior. Phys. Rev. E 1997, 55:3249-3256.
59. Paulus M.P., Hozack N., Frank L., Brown G.G. Error rate and outcome predictability affect neural activation in prefrontal cortex and anterior cingulate during decision-making. Neuroimage 2002, 15:836-846.
60. Peyron R., Laurent B., Garcia-Larrea L. Functional imaging of brain responses to pain. A review and meta-analysis (2000). Neurophysiol. Clin. 2000, 30:263-288.
61. Picard N., Strick P.L. Imaging the premotor areas. Curr. Opin. Neurobiol. 2001, 11:663-672.
62. Ramnani N., Miall C. Expanding cerebellar horizons. Trends Cogn. Sci. 2001, 5:135-136.
63. Rescorla R.A., Wagner A.R. A theory of Pavlovian conditioning: variations in the effectiveness of reinforcement and nonreinforcment. Classical Conditioning II: Current Research and Theory 1972, 64-99. Appleton-Century-Crofts, New York, NY. A.H. Black, W.F. Prokasy (Eds.).
64. Rhodes B.J., Bullock D. A scalable model of cerebellar adaptive timing and sequencing: the recurrent slide and latch (RSL) model. Appl. Intell. 2002, 17:35-48.
65. Rushworth M.F., Walton M.E., Kennerley S.W., Bannerman D.M. Action sets and decisions in the medial frontal cortex. Trends Cogn. Sci. 2004, 8:410-417.
66. Scheffers M.K., Coles M.G. Performance monitoring in a confusing world: error-related brain activity, judgments of response accuracy, and types of errors. J. Exp. Psychol. Hum. Percept. Perform. 2000, 26:141-151.
67. Schmahmann J.D., Sherman J.C. The cerebellar cognitive affective syndrome. Brain 1998, 121(Pt 4):561-579.
68. Schultz W. Predictive reward signal of dopamine neurons. J. Neurophysiol. 1998, 80:1-27.
69. Schultz W., Apicella P., Ljungberg T. Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task. J. Neurosci. 1993, 13:900-913.
70. Schultz W., Dayan P., Montague P.R. A neural substrate of prediction and reward. Science 1997, 275:1593-1599.
71. Sutton R.S., Barto A.G. Time-derivative models of Pavlovian reinforcement. Learning and Computational Neuroscience: Foundations of Adaptive Networks 1990, 497-537. MIT Press, Cambridge, MA. M. Gabriel, J. Moore (Eds.).
72. Talbot J.D., Marrett S., Evans A.C., Meyer E., Bushnell M.C., Duncan G.H. Multiple representations of pain in human cerebral cortex. Science 1991, 251:1355-1358.
73. Timmann D., Drepper J., Frings M., Maschke M., Richter S., Gerwig M., Kolb F.P. The human cerebellum contributes to motor, emotional and cognitive associative learning. A review. Cortex 2010, 46(7):845-857.
74. Ullsperger M., Nittono H., von Cramon D.Y. When goals are missed: dealing with self-generated and externally induced failure. Neuroimage 2007, 35:1356-1364.
75. Vann S.D., Aggleton J.P., Maguire E.A. What does the retrosplenial cortex do?. Nat. Rev. Neurosci. 2009, 10:792-802.
76. Walton M.E., Devlin J.T., Rushworth M.F. Interactions between decision making and performance monitoring within prefrontal cortex. Nat. Neurosci. 2004, 7:1259-1265.
77. Wang C., Ulbert I., Schomer D.L., Marinkovic K., Halgren E. Responses of human anterior cingulate cortex microdomains to error detection, conflict monitoring, stimulus-response mapping, familiarity, and orienting. J. Neurosci. 2005, 25:604-613.
78. Williams S.M., Goldman-Rakic P.S. Widespread origin of the primate mesofrontal dopamine system. Cereb. Cortex 1998, 8:321-345.
79. Yeung N., Cohen J.D., Botvinick M.M. The neural basis of error detection: conflict monitoring and the error-related negativity. Psychol. Rev. 2004, 111:931-959.