Interacting outcome retrieval, anticipation, and feedback processes in the human brain

Cerebral Cortex

Volumn 20, Issue 2, 2010, Pages 271-281

  Walsh, Nicholas D ^a,b   Phillips, Mary L ^a,c  

^a UNIVERSITY OF PITTSBURGH SCHOOL OF MEDICINE   (United States)

^b UNIVERSITY OF CAMBRIDGE   (United Kingdom)

^c CARDIFF UNIVERSITY SCHOOL OF MEDICINE   (United Kingdom)

Author keywords

Feedback; Magnetic resonance imaging; Memory; Motivation; Reaction time

Indexed keywords

ADULT; ANTICIPATION; ARTICLE; CINGULATE GYRUS; COGNITION; FEEDBACK SYSTEM; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; GLOBUS PALLIDUS; HUMAN; HUMAN EXPERIMENT; INFORMATION RETRIEVAL; MALE; MEMORY; PREFRONTAL CORTEX; PRIORITY JOURNAL; TASK PERFORMANCE;

ADULT; BRAIN; BRAIN MAPPING; COGNITION; EXECUTIVE FUNCTION; FEEDBACK, PSYCHOLOGICAL; FEMALE; GLOBUS PALLIDUS; GYRUS CINGULI; HUMANS; JUDGMENT; LEARNING; MAGNETIC RESONANCE IMAGING; MALE; MEMORY; MOTIVATION; NEUROPSYCHOLOGICAL TESTS; PREFRONTAL CORTEX; REACTION TIME; TASK PERFORMANCE AND ANALYSIS; YOUNG ADULT;

EID: 74249117338     PISSN: 10473211     EISSN: 14602199     Source Type: Journal    
DOI: 10.1093/cercor/bhp098     Document Type: Article

References (105)

1. Berridge KC, Kringelbach ML. 2008. Affective neuroscience of pleasure: reward in humans and animals. Psychopharmacology (Berl). 199:457-480.
2. Bertelson P, Boons JP. 1960. Time uncertainty and choice reaction time. Nature. 187:531-532.
3. Braver TS, Cohen JD, Nystrom LE, Jonides J, Smith EE, Noll DC. 1997. A parametric study of prefrontal cortex involvement in human working memory. Neuroimage. 5:49-62.
4. Brett M, Anton J-L, Valabregue R, Poline JB. 2002. Region of interest analysis using an SPM toolbox. In: 8th international conference on functional mapping of the human brain. Sendai, Japan: Neuroimage.
5. Buhusi CV, Meck WH. 2005. What makes us tick? Functional and neural mechanisms of interval timing. Nat Rev Neurosci. 6:755-765.
6. Bunzeck N, Duzel E. 2006. Absolute coding of stimulus novelty in the human substantia nigra/VTA. Neuron. 51:369-379.
7. Cheng RK, Etchegaray M, Meck WH. 2007. Impairments in timing, temporal memory, and reversal learning linked to neurotoxic regimens of methamphetamine intoxication. Brain Res. 1186:255-266.
8. Christoff K, Ream JM, Geddes LP, Gabrieli JD. 2003. Evaluating self-generated information: anterior prefrontal contributions to human cognition. Behav Neurosci. 117:1161-1168.
9. Clark L, Lawrence AJ, Astley-Jones F, Gray N. 2009. Gambling near-misses enhance motivation to gamble and recruit win-related brain circuitry. Neuron. 61:481-490.
10. Cools R, Barker RA, Sahakian BJ, Robbins TW. 2001. Enhanced or impaired cognitive function in Parkinson's disease as a function of dopaminergic medication and task demands. Cereb Cortex. 11:1136-1143.
11. Cools R, Clark L, Owen AM, Robbins TW. 2002. Defining the neural mechanisms of probabilistic reversal learning using event-related functional magnetic resonance imaging. J Neurosci. 22:4563-4567.
12. Cowan N. 2001. The magical number 4 in short-term memory: a reconsideration of mental storage capacity. Behav Brain Sci. 24:87-114.
13. Critchley HD, Mathias CJ, Dolan RJ. 2001. Neural activity in the human brain relating to uncertainty and arousal during anticipation. Neuron. 29:537-545.
14. Draganski B, Kherif F, Kloppel S, Cook PA, Alexander DC, Parker GJ, Deichmann R, Ashburner J, Frackowiak RS. 2008. Evidence for segregated and integrative connectivity patterns in the human Basal Ganglia. J Neurosci. 28:7143-7152.
15. Dreher JC, Grafman J. 2002. The roles of the cerebellum and basal ganglia in timing and error prediction. Eur J Neurosci. 16:1609-1619.
16. Driver J, Haggard P, Shallice T. 2007. Introduction. Mental processes in the human brain. Philos Trans R Soc Lond B Biol Sci. 362:757-760.
17. Elliott R, Dolan RJ. 1999. Differential neural responses during performance of matching and nonmatching to sample tasks at two delay intervals. J Neurosci. 19:5066-5073.
18. Elliott R, Friston KJ, Dolan RJ. 2000. Dissociable neural responses in human reward systems. J Neurosci. 20:6159-6165.
19. Fan J, McCandliss BD, Sommer T, Raz A, Posner MI. 2002. Testing the efficiency and independence of attentional networks. J Cogn Neurosci. 14:340-347.
20. Fiorillo CD, Newsome WT, Schultz W. 2008. The temporal precision of reward prediction in dopamine neurons. Nat Neurosci. 11:966-973.
21. First MB, Spitzer RL, Gibbon M, Williams JBW. 1997. Structured clinical interview for DSM-IV axis-I disorder (SCID-I), clinician version. American Psychiatric Publishing, Inc.
22. Frank MJ, Claus ED. 2006. Anatomy of a decision: striato-orbitofrontal interactions in reinforcement learning, decision making, and reversal. Psychol Rev. 113:300-326.
23. Friston KJ, Harrison L, Penny W. 2003. Dynamic causal modelling. Neuroimage. 19:1273-1302.
24. Fuster JM. 2001. The prefrontal cortex-an update: time is of the essence. Neuron. 30:319-333.
25. Genovesio A, Tsujimoto S, Wise SP. 2006. Neuronal activity related to elapsed time in prefrontal cortex. J Neurophysiol. 95:3281-3285.
26. Habeck C, Rakitin BC, Moeller J, Scarmeas N, Zarahn E, Brown T, Stern Y. 2005. An event-related fMRI study of the neural networks underlying the encoding, maintenance, and retrieval phase in a delayed-match-to-sample task. Brain Res Cogn Brain Res. 23:207-220.
27. Habib M. 2004. Athymhormia and disorders of motivation in basal ganglia disease. J Neuropsychiatry Clin Neurosci. 16:509-524.
28. Hagmann P, Cammoun L, Gigandet X, Meuli R, Honey CJ, Wedeen VJ, Sporns O. 2008. Mapping the structural core of human cerebral cortex. PLoS Biol. 6:e159.
29. Hampshire A, Owen AM. 2006. Fractionating attentional control using event-related fMRI. Cereb Cortex. 16:1679-1689.
30. Henson R. 2007. Efficient experimental design for fMRI. In: Friston KJ, Kiebel S, Nichols TE, Penny WD, editors. Statistical parametric mapping: the analysis of functional brain images. Academic Press. p. 193-210.
31. Hong S, Hikosaka O. 2008. The globus pallidus sends reward-related signals to the lateral habenula. Neuron. 60:720-729.
32. Iversen SD, Mishkin M. 1970. Perseverative interference in monkeys following selective lesions of the inferior prefrontal convexity. Exp Brain Res. 11:376-386.
33. Jahanshahi M, Jones CR, Dirnberger G, Frith CD. 2006. The substantia nigra pars compacta and temporal processing. J Neurosci. 26:12266-12273.
34. Kassinove JI, Schare ML. 2001. Effects of the "near miss" and the "big win" on persistence at slot machine gambling. Psychol Addict Behav. 15:155-158.
35. Kerns JG, Cohen JD, MacDonald AW, 3rd, Cho RY, Stenger VA, Carter CS. 2004. Anterior cingulate conflict monitoring and adjustments in control. Science. 303:1023-1026.
36. Kirschen MP, Chen SH, Schraedley-Desmond P, Desmond JE. 2005. Load-and practice-dependent increases in cerebro-cerebellar activation in verbal working memory: an fMRI study. Neuroimage. 24:462-472.
37. Kobayashi S, Schultz W. 2008. Influence of reward delays on responses of dopamine neurons. J Neurosci. 28:7837-7846.
38. Koechlin E, Basso G, Pietrini P, Panzer S, Grafman J. 1999. The role of the anterior prefrontal cortex in human cognition. Nature. 399:148-151.
39. Koechlin E, Hyafil A. 2007. Anterior prefrontal function and the limits of human decision-making. Science. 318:594-598.
40. Koechlin E, Ody C, Kouneiher F. 2003. The architecture of cognitive control in the human prefrontal cortex. Science. 302:1181-1185.
41. Koechlin E, Summerfield C. 2007. An information theoretical approach to prefrontal executive function. Trends Cogn Sci. 11:229-235.
42. Kronhaus DM, Willshaw DJ. 2006. The cingulate as a catalyst region for global dysfunction: a dynamical modelling paradigm. Cereb Cortex. 16:1212-1224.
43. Lawrence NS, Jollant F, O'Daly O, Zelaya F, Phillips ML. 2008. Distinct roles of prefrontal cortical subregions in the Iowa gambling task. Cereb Cortex. 19:1134-1143.
44. Levy R, Dubois B. 2006. Apathy and the functional anatomy of the prefrontal cortex-basal ganglia circuits. Cereb Cortex. 16:916-928.
45. Lisman JE, Grace AA. 2005. The hippocampal-VTA loop: controlling the entry of information into long-term memory. Neuron. 46:703-713.
46. Los SA, Knol DL, Boers RM. 2001. The foreperiod effect revisited: conditioning as a basis for nonspecific preparation. Acta Psychol. 106:121-145.
47. MacDonald CJ, Meck WH. 2004. Systems-level integration of interval timing and reaction time. Neurosci Biobehav Rev. 28:747-769.
48. MacLeod CM. 1991. Half a century of research on the Stroop effect: an integrative review. Psychol Bull. 109:163-203.
49. Manoach DS, Greve DN, Lindgren KA, Dale AM. 2003. Identifying regional activity associated with temporally separated components of working memory using event-related functional MRI. Neuro-image. 20:1670-1684.
50. Mansouri FA, Buckley MJ, Tanaka K. 2007. Mnemonic function of the dorsolateral prefrontal cortex in conflict-induced behavioral adjustment. Science. 318:987-990.
51. Marzinzik F, Wahl M, Schneider GH, Kupsch A, Curio G, Klostermann F. 2008. The human thalamus is crucially involved in executive control operations. J Cogn Neurosci. 20:1903-1914.
52. McIntosh AR, Grady CL, Haxby JV, Ungerleider LG, Horwitz B. 1996. Changes in limbic and prefrontal functional interactions in a working memory task for faces. Cereb Cortex. 6:571-584.
53. McNab F, Klingberg T. 2008. Prefrontal cortex and basal ganglia control access to working memory. Nat Neurosci. 11:103-107.
54. Miller GA, Galanter EG, Pribram KH. 1960. Plans and the structure of behavior. Holt, Rinehart and Winston, Inc.
55. Miyawaki E, Perlmutter JS, Troster AI, Videen TO, Koller WC. 2000. The behavioral complications of pallidal stimulation: a case report. Brain Cogn. 42:417-434.
56. Monsell S. 2003. Task switching. Trends Cogn Sci. 7:134-140.
57. Nagai Y, Critchley HD, Featherstone E, Fenwick PB, Trimble MR, Dolan RJ. 2004. Brain activity relating to the contingent negative variation: an fMRI investigation. Neuroimage. 21:1232-1241.
58. Nichols T, Brett M, Andersson J, Wager T, Poline JB. 2005. Valid conjunction inference with the minimum statistic. Neuroimage. 25:653-660.
59. Niemi P, Naatanen R. 1981. Foreperiod and simple reaction time. Psychol Bull. 89:133-162.
60. O'Doherty J, Kringelbach ML, Rolls ET, Hornak J, Andrews C. 2001. Abstract reward and punishment representations in the human orbitofrontal cortex. Nat Neurosci. 4:95-102.
61. O'Reilly JX, Mesulam MM, Nobre AC. 2008. The cerebellum predicts the timing of perceptual events. J Neurosci. 28:2252-2260.
62. Owen AM, McMillan KM, Laird AR, Bullmore E. 2005. N-back working memory paradigm: a meta-analysis of normative functional neuro-imaging studies. Hum Brain Mapp. 25:46-59.
63. Pasquereau B, Nadjar A, Arkadir D, Bezard E, Goillandeau M, Bioulac B, Gross CE, Boraud T. 2007. Shaping of motor responses by incentive values through the basal ganglia. J Neurosci. 27:1176-1183.
64. Pastor MA, Macaluso E, Day BL, Frackowiak RS. 2008. Putaminal activity is related to perceptual certainty. Neuroimage. 41:123-129.
65. Pessiglione M, Schmidt L, Draganski B, Kalisch R, Lau H, Dolan RJ, Frith CD. 2007. How the brain translates money into force: a neuroimaging study of subliminal motivation. Science. 316:904-906.
66. Petrides M. 2005. Lateral prefrontal cortex: architectonic and functional organization. Philos Trans R Soc Lond B Biol Sci. 360:781-795. (Pubitemid 40885665)
67. Petrides M, Pandya DN. 2007. Efferent association pathways from the rostral prefrontal cortex in the macaque monkey. J Neurosci. 27:11573-11586.
68. Picton TW, Stuss DT, Shallice T, Alexander MP, Gillingham S. 2006. Keeping time: effects of focal frontal lesions. Neuropsychologia. 44:1195-1209.
69. Pochon JB, Levy R, Fossati P, Lehericy S, Poline JB, Pillon B, Le Bihan D, Dubois B. 2002. The neural system that bridges reward and cognition in humans: an fMRI study. Proc Natl Acad Sci USA. 99:5669-5674.
70. Price CJ, Friston KJ. 1997. Cognitive conjunction: A new approach to brain activation experiments. Neuroimage. 5:261-270.
71. Ramnani N. 2006. The primate cortico-cerebellar system: anatomy and function. Nat Rev Neurosci. 7:511-522.
72. Ramnani N, Owen AM. 2004. Anterior prefrontal cortex: insights into function from anatomy and neuroimaging. Nat Rev Neurosci. 5:184-194.
73. Ratcliff R. 1993. Methods for dealing with reaction time outliers. Psychol Bull. 114:510-532.
74. Remijnse PL, Nielen MM, Uylings HB, Veltman DJ. 2005. Neural correlates of a reversal learning task with an affectively neutral baseline: an event-related fMRI study. Neuroimage. 26:609-618.
75. Reynolds JR, McDermott KB, Braver TS. 2006. A direct comparison of anterior prefrontal cortex involvement in episodic retrieval and integration. Cereb Cortex. 16:519-528.
76. Robbins TW. 2007. Shifting and stopping: fronto-striatal substrates, neurochemical modulation and clinical implications. Philos Trans R Soc Lond B Biol Sci. 362:917-932.
77. Roesch MR, Olson CR. 2005. Neuronal activity dependent on anticipated and elapsed delay in macaque prefrontal cortex, frontal and supplementary eye fields, and premotor cortex. J Neurophysiol. 94:1469-1497.
78. Rowe JB, Toni I, Josephs O, Frackowiak RS, Passingham RE. 2000. The prefrontal cortex: response selection or maintenance within working memory? Science. 288:1656-1660.
79. Rugg MD, Wilding EL. 2000. Retrieval processing and episodic memory. Trends Cogn Sci. 4:108-115.
80. Rypma B, Prabhakaran V, Desmond JE, Glover GH, Gabrieli JD. 1999. Load-dependent roles of frontal brain regions in the maintenance of working memory. Neuroimage. 9:216-226.
81. Sakai K. 2008. Task set and prefrontal cortex. Annu Rev Neurosci. 31:219-245.
82. Schacter DL, Addis DR, Buckner RL. 2007. Remembering the past to imagine the future: the prospective brain. Nat Rev Neurosci. 8:657-661.
83. Schmidt L, d'Arc BF, Lafargue G, Galanaud D, Czernecki V, Grabli D, Schupbach M, Hartmann A, Levy R, Dubois B, Pessiglione M. 2008. Disconnecting force from money: effects of basal ganglia damage on incentive motivation. Brain. 131:1303-1310.
84. Simons JS, Owen AM, Fletcher PC, Burgess PW. 2005. Anterior prefrontal cortex and the recollection of contextual information. Neuropsychologia. 43:1774-1783.
85. Somerville LH, Heatherton TF, Kelley WM. 2006. Anterior cingulate cortex responds differentially to expectancy violation and social rejection. Nat Neurosci. 9:1007-1008.
86. Steinborn MB, Rolke B, Bratzke D, Ulrich R. 2008. Sequential effects within a short foreperiod context: evidence for the conditioning account of temporal preparation. Acta Psychol. 129:297-307.
87. Sternberg S. 1966. High-speed scanning in human memory. Science. 153:652-654.
88. Stuss DT, Alexander MP. 2007. Is there a dysexecutive syndrome? Philos Trans R Soc Lond B Biol Sci. 362:901-915.
89. Stuss DT, Alexander MP, Shallice T, Picton TW, Binns MA, Macdonald R, Borowiec A, Katz DI. 2005. Multiple frontal systems controlling response speed. Neuropsychologia. 43:396-417.
90. Summerfield C, Koechlin E. 2008. A neural representation of prior information during perceptual inference. Neuron. 59:336-347.
91. Thesen S, Heid O, Mueller E, Schad LR. 2000. Prospective acquisition correction for head motion with image-based tracking for real-time fMRI. Magn Reson Med. 44:457-465.
92. Tomlin D, Kayali MA, King-Casas B, Anen C, Camerer CF, Quartz SR, Montague PR. 2006. Agent-specific responses in the cingulate cortex during economic exchanges. Science. 312:1047-1050.
93. Turner MS, Simons JS, Gilbert SJ, Frith CD, Burgess PW. 2008. Distinct roles for lateral and medial rostral prefrontal cortex in source monitoring of perceived and imagined events. Neuropsychologia. 46:1442-1453.
94. Uttl B. 2002. North American Adult Reading Test: age norms, reliability, and validity. J Clin Exp Neuropsychol. 24:1123-1137.
95. Vallesi A, McIntosh AR, Shallice T, Stuss DT. 2009. When time shapes behavior: fMRI evidence of brain correlates of temporal monitoring. J Cogn Neurosci. 21:1116-1126.
96. Vallesi A, Mussoni A, Mondani M, Budai R, Skrap M, Shallice T. 2007. The neural basis of temporal preparation: Insights from brain tumor patients. Neuropsychologia. 45:2755-2763.
97. Vallesi A, Shallice T, Walsh V. 2007. Role of the prefrontal cortex in the foreperiod effect: TMS evidence for dual mechanisms in temporal preparation. Cereb Cortex. 17:466-474.
98. Velanova K, Jacoby LL, Wheeler ME, McAvoy MP, Petersen SE, Buckner RL. 2003. Functional-anatomic correlates of sustained and transient processing components engaged during controlled retrieval. J Neurosci. 23:8460-8470.
99. Vinckier F, Dehaene S, Jobert A, Dubus JP, Sigman M, Cohen L. 2007. Hierarchical coding of letter strings in the ventral stream: dissecting the inner organization of the visual word-form system. Neuron. 55:143-156.
100. Vogt BA. 2005. Pain and emotion interactions in subregions of the cingulate gyrus. Nat Rev Neurosci. 6:533-544.
101. Vogt BA, Pandya DN. 1987. Cingulate cortex of the rhesus monkey: II. Cortical afferents. J Comp Neurol. 262:271-289.
102. Windmann S, Kirsch P, Mier D, Stark R, Walter B, Gunturkun O, Vaitl D. 2006. On framing effects in decision making: linking lateral versus medial orbitofrontal cortex activation to choice outcome processing. J Cogn Neurosci. 18:1198-1211.
103. Wolf RC, Vasic N, Walter H. 2006. Differential activation of ventrolateral prefrontal cortex during working memory retrieval. Neuropsycho-logia. 44:2558-2563.
104. Wolpert DM, Miall RC. 1996. Forward models for physiological motor control. Neural Netw. 9:1265-1279.
105. Zanolie K, Van Leijenhorst L, Rombouts SA, Crone EA. 2008. Separable neural mechanisms contribute to feedback processing in a rule-learning task. Neuropsychologia. 46:117-126.