Imaging the changing role of feedback during learning in decision-making

NeuroImage

Volumn 37, Issue 4, 2007, Pages 1474-1486

  Sailer, Uta ^a   Robinson, Simon ^b   Fischmeister, Florian Ph S ^a   Moser, Ewald ^b   Kryspin Exner, Ilse ^a   Bauer, Herbert ^a  

^a UNIVERSITY OF VIENNA   (Austria)

^b MEDICAL UNIVERSITY OF VIENNA   (Austria)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; BRAIN FUNCTION; BRAIN REGION; CONTROLLED STUDY; DECISION MAKING; FEEDBACK SYSTEM; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; IMAGE ANALYSIS; LEARNING; NEUROIMAGING; NORMAL HUMAN; PRIORITY JOURNAL;

ADULT; ALGORITHMS; ANALYSIS OF VARIANCE; BRAIN; DECISION MAKING; FEEDBACK, PSYCHOLOGICAL; FEMALE; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; LEARNING; MAGNETIC RESONANCE IMAGING; MALE; MODELS, PSYCHOLOGICAL; MOTOR CORTEX; MOTOR SKILLS; NEOSTRIATUM; NERVE NET; OXYGEN; PHOTIC STIMULATION; PREFRONTAL CORTEX;

EID: 34548541454     PISSN: 10538119     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neuroimage.2007.07.012     Document Type: Article

References (87)

1. Aizenstein H.J., Stenger V.A., Cochran J., Clark K., Johnson M., Nebes R.D., and Carter C.S. Regional brain activation during concurrent implicit and explicit sequence learning. Cereb. Cortex 14 (2004) 199-208
2. Akitsuki Y., Sugiura M., Watanabe J., Yamashita K., Sassa Y., Awata S., Matsuoka H., Maeda Y., Matsue Y., Fukuda H., and Kawashima R. Context-dependent cortical activation in response to financial reward and penalty: an event-related fMRI study. NeuroImage 19 (2003) 1674-1685
3. Alexander G.E., DeLong M.R., and Strick P.L. Parallel organization of functionally segregated circuits linking basal ganglia and cortex. Annu. Rev. Neurosci. (1986) 357-381
4. Anderson J.R. Acquisition of cognitive skill. Psychol. Rev. 89 (1982) 369-406
5. Anderson J.R. Parallel organization of functionally segregated circuits linking basal ganglia and cortex. Cogn. Sci. 29 (2005) 313-341
6. Berman K.F., Ostrem J.L., Randolph C., Gold J., Goldberg T.E., Coppola R., Carson R.E., Herscovitch P., and Weinberger D.R. Physiological activation of a cortical network during performance of the Wisconsin Card Sorting Test: a positron emission tomography study. Neuropsychologia 33 (1995) 1027-1046
7. Berns G.S., McClure S.M., Pagnoni G., and Montague P.R. Predictability modulates human brain response to reward. J. Neurosci. 21 (2001) 2793-2798
8. Birnboim S. The automatic and controlled information-processing dissociation: is it still relevant?. Neuropsychol. Rev. 13 (2003) 19-31
9. Blackwood N., Ffytche D., Simmons A., Bentall R., Murray R., and Howard R. The cerebellum and decision making under uncertainty. Brain Res. Cogn. Brain Res. 20 (2004) 46-53
10. Botvinick M.M., Nystrom L.E., Fissell K., Carter C.S., and Cohen J.D. Conflict monitoring versus selection-for-action in anterior cingulate cortex. Nature 402 (1999) 179-181
11. Boettiger C.A., and D'Esposito M. Frontal networks for learning and executing arbitrary stimulus-response associations. J. Neurosci. 25 (2005) 2723-2732
12. Breiter H.C., Aharon I., Kahneman D., Dale A., and Shizgal P. Functional imaging of neural responses to expectancy and experience of monetary gains and losses. Neuron 30 (2001) 619-639
13. Brett M., Johnsrude I.S., and Owen A.M. The problem of functional localization in the human brain. Nat. Rev., Neurosci. 3 (2002) 243-249
14. Bush G., Whalen P.J., Rosen B.R., Jenike M.A., McInerney S.C., and Rauch S.L. The counting Stroop: an interference task specialized for functional neuroimaging - validation study with functional MRI. Hum. Brain Mapp. 6 (1998) 270-282
15. Bush G., Luu P., and Posner M.I. Cognitive and emotional influences in anterior cingulate cortex. Trends Cogn. Sci. 4 (2000) 215-222
16. Cabeza R., and Nyberg L. Imaging cognition: II. An empirical review of 275 PET and fMRI studies. J. Cogn. Neurosci. 12 (2000) 1-47
17. Carter C.S., Braver T.S., Barch D.M., Botvinick M.M., Noll D., and Cohen J.D. Anterior cingulate cortex, error detection, and the online monitoring of performance. Science 280 (1998) 747-749
18. Carter C.S., Macdonald A.M., Botvinick M., Ross L.L., Stenger V.A., Noll D., and Cohen J.D. Parsing executive processes: strategic vs. evaluative functions of the anterior cingulate cortex. Proc. Natl. Acad. Sci. U. S. A. 97 (2000) 1944-1948
19. Cavanna A.E., and Trimble M.R. The precuneus: a review of its functional anatomy and behavioural correlates. Brain 129 (2006) 564-583
20. Chao L.L., Haxby J.V., and Martin A. Attribute-based neural substrates in posterior temporal cortex for perceiving and knowing about objects. Nat. Neurosci. 2 (1999) 913-919
21. Chein J.M., and Schneider W. Neuroimaging studies of practice-related change: fMRI and meta-analytic evidence of a domain-general control network for learning. Brain Res. Cogn. Brain. Res. 25 (2005) 607-623
22. Cohen M.X., Elger C.E., and Ranganath C. Reward expectation modulates feedback-related negativity and EEG spectra. NeuroImage 35 (2007) 968-978
23. Coricelli G., Critchley H.D., Joffily M., O'Doherty J.P., Sirigu A., and Dolan R.J. Regret and its avoidance: a neuroimaging study of choice behavior. Nat. Neurosci. 8 (2005) 1255-1262
24. Delgado M.R., Miller M.M., Inati S., and Phelps E.A. An fMRI study of reward-related probability learning. NeuroImage 24 (2005) 862-873
25. Derrfuss J., Brass M., and von Cramon D.Y. Cognitive control in the posterior frontolateral cortex: evidence from common activations in task coordination, interference control, and working memory. NeuroImage 23 (2004) 604-612
26. Dickhaut J., McCabe K., Nagode J.C., Rustichini A., Smith K., and Pardo J.V. The impact of the certainty context on the process of choice. Proc. Natl. Acad. Sci. U. S. A. 100 (2003) 3536-3541
27. Elliott R., Dolan R.J., and Frith C.D. Dissociable functions in the medial and lateral orbitofrontal cortex: evidence from human neuroimaging studies. Cereb. Cortex 10 (2000) 308-317
28. Ernst M., and Paulus M.P. Neurobiology of decision making: a selective review from a neurocognitive and clinical perspective. Biol. Psychiatry 58 (2005) 597-604
29. Ernst M., Bolla K., Mouratidis M., Contoreggi C., Matochik J.A., Kurian V., Cadet J.L., Kimes A.S., and London E.D. Decision-making in a risk-taking task: a PET study. Neuropsychopharmacology 26 (2002) 682-691
30. Ernst M., Nelson E.E., McClure E.B., Monk C.S., Munson S., Eshel N., Zarahn E., Leibenluft E., Zametkin A., Towbin K., Blair J., Charney D., and Pine D.S. Choice selection and reward anticipation: an fMRI study. Neuropsychologia 42 (2004) 1585-1597
31. Fincham J.M., and Anderson J.R. Distinct roles of the anterior cingulate and prefrontal cortex in the acquisition and performance of a cognitive skill. Proc. Natl. Acad. Sci. U. S. A. 103 (2006) 12941-12946
32. Fitts P.M. Perceptual-motor skill learning. In: Melton A.W. (Ed). Categories of Human Learning (1964), Academic Press, New York 243-285
33. Gehring W.J., and Willoughby A.R. The medial frontal cortex and the rapid processing of monetary gains and losses. Science 295 (2002) 2279-2282
34. Gruber S.A., Rogowska J., Holcomb P., Soraci S., and Yurgelun-Todd D. Stroop performance in normal control subjects: an fMRI study. NeuroImage 16 (2002) 349-360
35. Haruno M., Kuroda T., Doya K., Toyama K., Kimura M., Samejima K., Imamizu H., and Kawato M. A neural correlate of reward-based behavioral learning in caudate nucleus: a functional magnetic resonance imaging study of a stochastic decision task. J. Neurosci. 24 (2004) 1660-1665
36. Hasselmo M.E., and Stern C.E. Mechanisms underlying working memory for novel information. Trends Cogn. Sci. 10 (2006) 487-493
37. Herath P., Kinomura S., and Roland P.E. Visual recognition: evidence for two distinctive mechanisms from a PET study. Hum. Brain Mapp. 12 (2001) 110-119
38. Holroyd C.B., and Coles M.G. The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. Psychol. Rev. 109 (2002) 679-709
39. Holroyd C.B., Nieuwenhuis S., Yeung N., and Cohen J.D. Errors in reward prediction are reflected in the event-related brain potential. NeuroReport 14 (2003) 2481-2484
40. Jansma J.M., Ramsey N.F., Slagter H.A., and Kahn R.S. Functional anatomical correlates of controlled and automatic processing. J. Cogn. Neurosci. 13 (2001) 730-743
41. Knutson B., Westdorp A., Kaiser E., and Hommer D. FMRI visualization of brain activity during a monetary incentive delay task. NeuroImage 12 (2000) 20-27
42. Koch K., Wagner G., von Consbruch K., Nenadic I., Schultz C., Ehle C., Reichenbach J., Sauer H., and Schlosser R. Temporal changes in neural activation during practice of information retrieval from short-term memory: an fMRI study. Brain Res. 1107 (2006) 140-150
43. Kosson D.S., Budhani S., Nakic M., Chen G., Saad Z.S., Vythilingam M., Pine D.S., and Blair R.J. The role of the amygdala and rostral anterior cingulate in encoding expected outcomes during learning. NeuroImage 29 (2006) 1161-1172
44. Krain A.L., Wilson A.M., Arbuckle R., Castellanos F.X., and Milham M.P. Distinct neural mechanisms of risk and ambiguity: a meta-analysis of decision-making. NeuroImage 32 (2006) 477-484
45. Krawczyk D.C. Contributions of the prefrontal cortex to the neural basis of human decision making. Neurosci. Biobehav. Rev. 26 (2002) 631-664
46. Kringelbach M.L., and Rolls E.T. Neural correlates of rapid reversal learning in a simple model of human social interaction. NeuroImage 20 (2003) 1371-1383
47. Lancaster J.L., Woldorff M.G., Parsons L.M., Liotti M., Freitas C.S., Rainey L., Kochunov P.V., Nickerson D., Mikiten S.A., and Fox P.T. Automated Talairach atlas labels for functional brain mapping. Hum. Brain Mapp. 10 (2000) 120-131
48. Lane R.D., Chua P.M., and Dolan R.J. Common effects of emotional valence, arousal and attention on neural activation during visual processing of pictures. Neuropsychologia 37 (1999) 989-997
49. Luck S.J. An Introduction to the Event-Related Potential Technique (2005), MIT Press, Cambridge, MA
50. MacDonald III A.W., Cohen J.D., Stenger V.A., and Carter C.S. Dissociating the role of the dorsolateral prefrontal and anterior cingulate cortex in cognitive control. Science 288 (2000) 1835-1838
51. Maddock R.J., Garrett A.S., and Buonocore M.H. Posterior cingulate cortex activation by emotional words: fMRI evidence from a valence decision task. Hum. Brain Mapp. 18 (2003) 30-41
52. McClure S.M., Berns G.S., and Montague P.R. Temporal prediction errors in a passive learning task activate human striatum. Neuron 38 (2003) 339-346
53. Montague P.R., Hyman S.E., and Cohen J.D. Computational roles for dopamine in behavioural control. Nature 431 (2004) 760-767
54. Nagahama Y., Fukuyama H., Yamauchi H., Matsuzaki S., Konishi J., Shibasaki H., and Kimura J. Cerebral activation during performance of a card sorting test. Brain 119 (1996) 1667-1675
55. Nagahama Y., Okada T., Katsumi Y., Hayashi T., Yamauchi H., Sawamoto N., Toma K., Nakamura K., Hanakawa T., Konishi J., Fukuyama H., and Shibasaki H. Transient neural activity in the medial superior frontal gyrus and precuneus time locked with attention shift between object features. NeuroImage 10 (1999) 193-199
56. Naghavi H.R., and Nyberg L. Common fronto-parietal activity in attention, memory, and consciousness: shared demands on integration?. Conscious. Cogn. 14 (2005) 390-425
57. Nieuwenhuis S., Ridderinkhof K.R., Talsma D., Coles M.G., Holroyd C.B., Kok A., and van der Molen M.W. A computational account of altered error processing in older age: dopamine and the error-related negativity. Cogn. Affect. Behav. Neurosci. 2 (2002) 19-36
58. Nieuwenhuis S., Yeung N., Holroyd C.B., Schurger A., and Cohen J.D. Sensitivity of electrophysiological activity from medial frontal cortex to utilitarian and performance feedback. Cereb. Cortex 14 (2004) 741-747
59. Nieuwenhuis S., Slagter H.A., von Geusau N.J., Heslenfeld D.J., and Holroyd C.B. Knowing good from bad: differential activation of human cortical areas by positive and negative outcomes. Eur. J. Neurosci. 21 (2005) 3161-3168
60. O'Doherty J.P. Reward representations and reward-related learning in the human brain: insights from neuroimaging. Curr. Opin. Neurobiol. 14 (2004) 769-776
61. O'Doherty J., Kringelbach M.L., Rolls E.T., Hornak J., and Andrews C. Abstract reward and punishment representations in the human orbitofrontal cortex. Nat. Neurosci. 4 (2001) 95-102
62. O'Doherty J., Critchley H., Deichmann R., and Dolan R.J. Dissociating valence of outcome from behavioral control in human orbital and ventral prefrontal cortices. J. Neurosci. 23 (2003) 7931-7939
63. O'Doherty J.P., Dayan P., Friston K., Critchley H., and Dolan R.J. Temporal difference models and reward-related learning in the human brain. Neuron 38 (2003) 329-337
64. Oldfield R.C. Assessment and analysis of handedness: the Edinburgh Inventory. Neuropsychologia 9 (1971) 97-113
65. Paulus M.P., Hozack N., Zauscher B., McDowell J.E., Frank L., Brown G.G., and Braff D.L. Prefrontal, parietal, and temporal cortex networks underlie decision-making in the presence of uncertainty. NeuroImage 13 (2001) 91-100
66. Paulus M.P., Rogalsky C., Simmons A., Feinstein J.S., and Stein M.B. Increased activation in the right insula during risk-taking decision making is related to harm avoidance and neuroticism. NeuroImage 19 (2003) 1439-1448
67. Pollmann S. Switching between dimensions, locations, and responses: the role of the left frontopolar cortex. NeuroImage 14 (2001) S118-S124
68. Postuma R.B., and Dagher A. Basal ganglia functional connectivity based on a meta-analysis of 126 positron emission tomography and functional magnetic resonance imaging publications. Cereb. Cortex 16 (2006) 1508-1521
69. Preuschoff K., Bossaerts P., and Quartz S.R. Neural differentiation of expected reward and risk in human subcortical structures. Neuron 51 (2006) 381-390
70. Ranganath C. Working memory for visual objects: complementary roles of inferior temporal, medial temporal, and prefrontal cortex. Neuroscience 139 (2006) 277-289
71. Remijnse P.L., Nielen M.M., Uylings H.B., and Veltman D.J. Neural correlates of a reversal learning task with an affectively neutral baseline: an event-related fMRI study. NeuroImage 26 (2005) 609-618
72. Richards F.J. A flexible growth function for empirical use. J. Exp. Bot. 10 (1959) 290-300
73. Rogers R.D., Andrews T.C., Grasby P.M., Brooks D.J., and Robbins T.W. Contrasting cortical and subcortical activations produced by attentional-set shifting and reversal learning in humans. J. Cogn. Neurosci. 12 (2000) 142-162
74. Rolls E.T. The orbitofrontal cortex and reward. Cereb. Cortex 10 (2000) 284-294
75. Sailer U., Flanagan J.R., and Johansson R.S. Eye-hand coordination during learning of a novel visuomotor task. J. Neurosci. 25 (2005) 8833-8842
76. Schoenbaum G., and Setlow B. Integrating orbitofrontal cortex into prefrontal theory: common processing themes across species and subdivisions. Learn. Mem. 8 (2001) 134-147
77. Schoenbaum G., Roesch M.R., and Stalnaker T.A. Orbitofrontal cortex, decision-making and drug addiction. Trends Neurosci. 29 (2006) 116-124
78. Schneider W., and Shiffrin R.M. Controlled and automatic human information processing: I. Detection, search, and attention. Psychol. Rev. 84 (1977) 1-66
79. Schultz W. Getting formal with dopamine and reward. Neuron 36 (2002) 241-263
80. Schultz W., Dayan P., and Montague P.R. A neural substrate of prediction and reward. Science 275 (1997) 1593-1599
81. Seger C.A., and Cincotta C.M. Dynamics of frontal, striatal, and hippocampal systems during rule learning. Cereb. Cortex 16 (2006) 1546-1555
82. Strange B.A., Henson R.N., Friston K.J., and Dolan R.J. Anterior prefrontal cortex mediates rule learning in humans. Cereb. Cortex 11 (2001) 1040-1046
83. Thut G., Schultz W., Roelcke U., Nienhusmeier M., Missimer J., Maguire R.P., and Leenders K.L. Activation of the human brain by monetary reward. NeuroReport 8 (1997) 1225-1228
84. van Veen V., Holroyd C.B., Cohen J.D., Stenger V.A., and Carter C.S. Errors without conflict: implications for performance monitoring theories of anterior cingulate cortex. Brain Cogn. 56 (2004) 267-276
85. Wise R.A. Brain reward circuitry: insights from unsensed incentives. Neuron 36 (2002) 229-240
86. Wittchen H.-U., and Unland H. Neue Ansätze zur Symptomerfassung und Diagnoseerstellung nach ICD-10 und DSM-III-R: Strukturierte und standardisierte Interviews. Z. Klin. Psychol. 4 (1991) 321-342
87. Zalla T., Koechlin E., Pietrini P., Basso G., Aquino P., Sirigu A., and Grafman J. Differential amygdala responses to winning and losing: a functional magnetic resonance imaging study in humans. Eur. J. Neurosci. 12 (2000) 1764-1770