Striatum in stimulus-response learning via feedback and in decision making

NeuroImage

Volumn 101, Issue , 2014, Pages 448-457

  Hiebert, Nole M ^a   Vo, Andrew ^a   Hampshire, Adam ^b   Owen, Adrian M ^a   Seergobin, Ken N ^a   MacDonald, Penny A ^a  

^a UNIVERSITY OF WESTERN ONTARIO   (Canada)

^b IMPERIAL COLLEGE LONDON   (United Kingdom)

Author keywords

Decision making; Functional MRI; Parkinson's disease; Stimulus response learning; Striatum

Indexed keywords

ADULT; ARTICLE; BRAIN REGION; CORPUS STRIATUM; DECISION MAKING; DORSAL STRIATUM; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; IMAGE ANALYSIS; IMAGE PROCESSING; INFORMATION PROCESSING; LEARNING; MALE; NEUROFEEDBACK; NEUROIMAGING; NORMAL HUMAN; PRIORITY JOURNAL; PSYCHOPHYSIOLOGY; RESPONSE TIME; STIMULUS RESPONSE; TASK PERFORMANCE; VALIDATION PROCESS; ADAPTIVE BEHAVIOR; BRAIN MAPPING; NEOSTRIATUM; NUCLEAR MAGNETIC RESONANCE IMAGING; PHYSIOLOGY; PROCEDURES; VENTRAL STRIATUM; YOUNG ADULT; ASSOCIATION; BRAIN FUNCTION; CAUDATE NUCLEUS; CONTROLLED STUDY; DATA ANALYSIS; ELECTROENCEPHALOGRAM; NERVOUS SYSTEM PARAMETERS; PUTAMEN; REGION OF INTEREST;

ADULT; ASSOCIATION LEARNING; BRAIN MAPPING; DECISION MAKING; FEEDBACK, PSYCHOLOGICAL; FEMALE; HUMANS; MAGNETIC RESONANCE IMAGING; MALE; NEOSTRIATUM; VENTRAL STRIATUM; YOUNG ADULT;

EID: 84907027324     PISSN: 10538119     EISSN: 10959572     Source Type: Journal    
DOI: 10.1016/j.neuroimage.2014.07.013     Document Type: Article

References (78)

1. Abler B., Walter H., Erk S., Kammerer H., Spitzer M. Prediction error as a linear function of reward probability is coded in human nucleus accumbens. NeuroImage 2006, 31(2):790-795.
2. Aron A.R., Shohamy D., Clark J., Myers C., Gluck M.A., Poldrack R.A. Human midbrain sensitivity to cognitive feedback and uncertainty during classification learning. J. Neurophysiol. 2004, 92:1144-1152.
3. Ashby F.G., Ennis J.M., Spiering B.J. A neurobiological theory of automaticity in perceptual categorization. Psychol. Rev. 2007, 114(3):632-656.
4. Ashby F.G., Turner B.O., Horvitz J.C. Cortical and basal ganglia contributions to habit learning and automaticity. Trends Cogn. Sci. 2010, 14(5):208-215.
5. Atallah H.E., Lopez-Paniagua D., Rudy J.W., O'Reilly R.C. Separate neural substrates for skill learning and performance in the ventral and dorsal striatum. Nat. Neurosci. 2007, 10(1):126-131.
6. Balleine B.W., Liljeholm M., Ostlund S.B. The integrative function of the basal ganglia in instrumental conditioning. Behav. Brain Res. 2009, 199(1):43-52.
7. Barone P., Antonini A., Colosimo C., Marconi R., Morgante L., Avarello T.P., et al. The PRIAMO study: A multicenter assessment of nonmotor symptoms and their impact on quality of life in Parkinson's disease. Mov. Disord. 2009, 24(11):1641-1649.
8. Boettiger C.A., D'Esposito M. Frontal networks for learning and executing arbitrary stimulus-response associations. J. Neurosci. Off. J. Soc. Neurosci. 2005, 25(10):2723-2732.
9. Brett M., Anton J.L., Valabregue V., Poline J.B. Region of interest analysis using an SPM toolbox. Presented at the Eighth International Conference on Functional Mapping of the Human Brain, Sendai, Japan, June 2002.
10. Brovelli A., Nazarian B., Meunier M., Boussaoud D. Differential roles of caudate nucleus and putamen during instrumental learning. NeuroImage 2011, 57(4):1580-1590.
11. Brown T.I., Stern C.E. Contributions of medial temporal lobe and striatal memory systems to learning and retrieving overlapping spatial memories. Cereb. Cortex 2013, 1-17.
12. Camara E., Rodriguez-Fornells A., Munte T.F. Microstructural brain differences predict functional hemodynamic responses in a reward processing task. J. Neurosci. Off. J. Soc. Neurosci. 2010, 30(34):11398-11402.
13. Cools R. Dopaminergic modulation of cognitive function-implications for l-DOPA treatment in Parkinson's disease. Neurosci. Biobehav. Rev. 2006, 30(1):1-23.
14. Cools R., Clark L., Owen A.M., Robbins T.W. Defining the neural mechanisms of probabilistic reversal learning using event-related functional magnetic resonance imaging. J. Neurosci. Off. J. Soc. Neurosci. 2002, 22(11):4563-4567.
15. Cools R., Lewis S.J., Clark L., Barker R.A., Robbins T.W. l-DOPA disrupts activity in the nucleus accumbens during reversal learning in Parkinson's disease. Neuropsychopharmacology 2007, 32(1):180-189.
16. Daniel R., Pollmann S. Comparing the neural basis of monetary reward and cognitive feedback during information-integration category learning. J. Neurosci. Off. J. Soc. Neurosci. 2010, 30(1):47-55.
17. Daw N.D., Doya K. The computational neurobiology of learning and reward. Curr. Opin. Neurobiol. 2006, 16(2):199-204.
18. de Wit S., Barker R.A., Dickinson A.D., Cools R. Habitual versus goal-directed action control in Parkinson's disease. J. Cogn. Neurosci. 2011, 23(5):1218-1229.
19. Delgado M.R. Reward-related responses in the human striatum. Ann. N. Y. Acad. Sci. 2007, 1104:70-88.
20. Delgado M.R., Nystrom L.E., Fissel C., Noll D.C., Fiez J.A. Tracking the hemodynamic responses to reward and punishment in the striatum. J. Neurophysiol. 2000, 84(6):3072-3077.
21. Delgado M.R., Miller M.M., Inati S., Phelps E.A. An fMRI study of reward-related probability learning. NeuroImage 2005, 24(3):862-873.
22. Dobryakova E., Tricomi E. Basal ganglia engagement during feedback processing after a substantial delay. Cogn. Affect. Behav. Neurosci. 2013, 13(4):725-736.
23. Ell S.W., Marchant N.L., Ivry R.B. Focal putamen lesions impair learning in rule-based, but not information-integration categorization tasks. Neuropsychologia 2006, 44(10):1737-1751.
24. Exner C., Koschack J., Irle E. The differential role of premotor frontal cortex and basal ganglia in motor sequence learning: evidence from focal basal ganglia lesions. Learn. Mem. 2002, 9(6):376-386.
25. Feekes J.A., Cassell M.D. The vascular supply of the functional compartments of the human striatum. Brain 2006, 129(Pt 8):2189-2201.
26. Feigin A.S., Ghilardi M.F., Carbon M., Edwards C., Fukuda M.D., Dhawan V., et al. Effects of levodopa on motor sequence learning in Parkinson's disease. Neurology 2003, 60:1744-1749.
27. Foerde K., Shohamy D. Feedback timing modulates brain systems for learning in humans. J. Neurosci. Off. J. Soc. Neurosci. 2011, 31(37):13157-13167.
28. Foerde K., Race E., Verfaellie M., Shohamy D. A role for the medial temporal lobe in feedback-driven learning: evidence from amnesia. J. Neurosci. Off. J. Soc. Neurosci. 2013, 33(13):5698-5704.
29. Garrison J., Erdeniz B., Done J. Prediction error in reinforcement learning: a meta-analysis of neuroimaging studies. Neurosci. Biobehav. Rev. 2013, 37(7):1297-1310.
30. Ghilardi M.F., Feigin A.S., Battaglia F., Silvestri G., Mattis P., Eidelberg D., Di Rocco A. l-Dopa infusion does not improve explicit sequence learning in Parkinson's disease. Parkinsonism Relat. Disord. 2007, 13(3):146-151.
31. Grahn J.A., Parkinson J.A., Owen A.M. The cognitive functions of the caudate nucleus. Prog. Neurobiol. 2008, 86(3):141-155.
32. Haber S.N., Fudge J.L. The primate substantia nigra and VTA: integrative circuitry and function. Crit. Rev. Neurobiol. 1997, 11(4):323-342.
33. Hart G., Leung B.K., Balleine B.W. Dorsal and ventral streams: the distinct role of striatal subregions in the acquisition and performance of goal-directed actions. Neurobiol. Learn. Mem. 2014, 108:104-118.
34. Haruno M., Kawato M. Different neural correlates of reward expectation and reward expectation error in the putamen and caudate nucleus during stimulus-action-reward association learning. J. Neurophysiol. 2006, 95(2):948-959.
35. Helie S., Roeder J.L., Ashby F.G. Evidence for cortical automaticity in rule-based categorization. J. Neurosci. Off. J. Soc. Neurosci. 2010, 30(42):14225-14234.
36. Jessup R.K., O'Doherty J.P. Human dorsal striatal activity during choice discriminates reinforcement learning behavior from the gambler's fallacy. J. Neurosci. Off. J. Soc. Neurosci. 2011, 31(17):6296-6304.
37. Kish S.J., Shannak K., Hornykiewicz O. Uneven pattern of dopamine loss in the striatum of patients with idiopathic Parkinson's disease. N. Engl. J. Med. 1988, 318:876-880.
38. Knutson B., Cooper J.C. Functional magnetic resonance imaging of reward prediction. Curr. Opin. Neurol. 2005, 18:411-417.
39. MacDonald P.A., Monchi O. Differential effects of dopaminergic therapies on dorsal and ventral striatum in Parkinson's disease: implications for cognitive function. Park. Dis. 2011, 2011:1-18.
40. MacDonald P.A., MacDonald A.A., Seergobin K.N., Tamjeedi R., Ganjavi H., Provost J.S., et al. The effect of dopamine therapy on ventral and dorsal striatum-mediated cognition in Parkinson's disease: Support from functional MRI. Brain 2011, 134(Pt 5):1447-1463.
41. MacDonald A.A., Seergobin K.N., Owen A.M., Tamjeedi R., Monchi O., Ganjavi H., MacDonald P.A. Differential effects of Parkinson's disease and dopamine replacement on memory encoding and retrieval. PLoS One 2013, 8(9):e74044.
42. MacDonald A.A., Monchi O., Seergobin K.N., Ganjavi H., Tamjeedi R., MacDonald P.A. Parkinson's disease duration determines effect of dopaminergic therapy on ventral straitum function. Mov. Disord. 2013, 28(2):153-160.
43. MacDonald A.A., Seergobin K.N., Tamjeedi R., Owen A.M., Provost J.-S., Monchi O., Ganjavi H., MacDonald P.A. Dorsal striatum mediates cognitive flexibility not merely cognitive effort: investigations in Parkinson's disease and using fMRI. Ann. Clin. Transl. Neurol. 2014, 1(6):390-400.
44. McDonald R.J., Hong N.S. A dissociation of dorso-lateral striatum and amygdala function on the same stimulus-response habit task. Neuroscience 2004, 124(3):507-513.
45. McDonald R.J., White N.M. A triple dissociation of memory systems: hippocampus, amygdala, and dorsal striatum. Behav. Neurosci. 1993, 107(1):3-22.
46. Nomura E.M., Maddox W.T., Filoteo J.V., Ing A.D., Gitelman D.R., Parrish T.B., et al. Neural correlates of rule-based and information-integration visual category learning. Cereb. Cortex 2007, 17(1):37-43.
47. O'Doherty J.P. Reward representations and reward-related learning in the human brain: insights from neuroimaging. Curr. Opin. Neurobiol. 2004, 14(6):769-776.
48. O'Doherty J.P., Dayan P., Friston K., Critchley H., Dolan R.J. Temporal difference models and reward-related learning in the human brain. Neuron 2003, 28:329-337.
49. O'Doherty J.P., Dayan P., Schultz J., Deichmann R., Friston K., Dolan R.J. Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science 2004, 304(5669):452-454.
50. Ohira H., Ichikawa N., Nomura M., Isowa T., Kimura K., Kanayama N., et al. Brain and autonomic association accompanying stochastic decision-making. NeuroImage 2010, 49(1):1024-1037.
51. Poldrack R.A., Prabhakaran V., Seger C.A., Gabrieli J.D.E. Striatal activation during acquisition of a cognitive skill. Neuropsychology 1999, 13(4):564-574.
52. Postle B.R., D'Esposito M. Dissociation of human caudate nucleus activity in spatial and nonspatial working memory: an event-related fMRI study. Cogn. Brain Res. 1999, 8:107-115.
53. Preuschoff K., Bossaerts P., Quartz S.R. Neural differentiation of expected reward and risk in human subcortical structures. Neuron 2006, 51(3):381-390.
54. Ragozzino M.E. The contribution of the medial prefrontal cortex, orbitofrontal cortex, and dorsomedial striatum to behavioral flexibility. Ann. N. Y. Acad. Sci. 2007, 1121:355-375.
55. Rangel A., Camerer C., Montague P.R. A framework for studying the neurobiology of value-based decision making. Nat. Rev. Neurosci. 2008, 9(7):545-556.
56. Ray N.J., Strafella A.P. The neurobiology and neural circuitry of cognitive changes in Parkinson's disease revealed by functional neuroimaging. Mov. Disord. 2012, 27(12):1484-1492.
57. Reiss J.P., Campbell D.W., Leslie W.D., Paulus M.P., Stroman P.W., Polimeni J.O., et al. The role of the striatum in implicit learning: a functional magnetic resonance imaging study. Neuroreport 2005, 16(12):1291-1295.
58. Rodriguez P.F. Stimulus-outcome learnability differentially activates anterior cingulate and hippocampus at feedback processing. Learn. Mem. 2009, 16(5):324-331.
59. Ruge H., Wolfensteller U. Rapid formation of pragmatic rule representations in the human brain during instruction-based learning. Cereb. Cortex 2010, 20(7):1656-1667.
60. Ruge H., Wolfensteller U. Functional integration processes underlying the instruction-based learning of novel goal-directed behaviors. NeuroImage 2013, 68:162-172.
61. Ryterska A., Jahanshahi M., Osman M. What are people with Parkinson's disease really impaired on when it comes to making decisions? A meta-analysis of the evidence. Neurosci. Biobehav. Rev. 2013, 37(10 Pt 2):2836-2846.
62. Schrag A., Jahanshahi M., Quinn N. What contributes to quality of life in patients with Parkinson's disease?. J. Neurol. Neurosurg. Psychiatry 2000, 69:308-312.
63. Seger C.A., Peterson E.J., Cincotta C.M., Lopez-Paniagua D., Anderson C.W. Dissociating the contributions of independent corticostriatal systems to visual categorization learning through the use of reinforcement learning modeling and Granger causality modeling. NeuroImage 2010, 50(2):644-656.
64. Seo M., Beigi M., Jahanshahi M., Averbeck B.B. Effects of dopamine medication on sequence learning with stochastic feedback in Parkinson's disease. Front. Syst. Neurosci. 2010, 4:1-9.
65. Sesack S.R., Grace A.A. Cortico-basal ganglia reward network: microcircuitry. Neuropsychopharmacology 2010, 35(1):27-47.
66. Shin J.C., Aparicio P., Ivry R.B. Multidimensional sequence learning in patients with focal basal ganglia lesions. Brain Cogn. 2005, 58(1):75-83.
67. Shohamy D., Myers C.E., Geghman K.D., Sage J., Gluck M.A. l-dopa impairs learning, but spares generalization, in Parkinson's disease. Neuropsychologia 2006, 44(5):774-784.
68. Smittenaar P., Chase H.W., Aarts E., Nusselein B., Bloem B.R., Cools R. Decomposing effects of dopaminergic medication in Parkinson's disease on probabilistic action selection-learning or performance?. Eur. J. Neurosci. 2012, 35(7):1144-1151.
69. Takahashi Y., Roesch M.R., Stalnaker T.A., Schoenbaum G. Cocaine exposure shifts the balance of associative encoding from ventral to dorsolateral striatum. Front. Integr. Neurosci. 2007, 1(11).
70. Toni I., Passingham R.E. Prefrontal-basal ganglia pathways are involved in the learning of arbitrary visuomotor associations: a PET study. Exp. Brain Res. 1999, 127:19-32.
71. Tremblay P.L., Bedard M.A., Langlois D., Blanchet P.J., Lemay M., Parent M. Movement chunking during sequence learning is a dopamine-dependant process: a study conducted in Parkinson's disease. Exp. Brain Res. 2010, 205(3):375-385.
72. Tricomi E., Balleine B.W., O'Doherty J.P. A specific role for posterior dorsolateral striatum in human habit learning. Eur. J. Neurosci. 2009, 29(11):2225-2232.
73. Voorn P., Vanderschuren L.J., Groenewegen H.J., Robbins T.W., Pennartz C.M. Putting a spin on the dorsal-ventral divide of the striatum. Trends Neurosci. 2004, 27(8):468-474.
74. Waldschmidt J.G., Ashby F.G. Cortical and striatal contributions to automaticity in information-integration categorization. NeuroImage 2011, 56(3):1791-1802.
75. Wickens J.R., Horvitz J.C., Costa R.M., Killcross S. Dopaminergic mechanisms in actions and habits. J. Neurosci. Off. J. Soc. Neurosci. 2007, 27(31):8181-8183.
76. Worthy D.A., Markman A.B., Maddox W.T. Feedback and stimulus-offset timing effects in perceptual category learning. Brain Cogn. 2013, 81(2):283-293.
77. Xue G., Ghahremani D.G., Poldrack R.A. Neural substrates for reversing stimulus-outcome and stimulus-response associations. J. Neurosci. Off. J. Soc. Neurosci. 2008, 28(44):11196-11204.
78. Yin H.H., Knowlton B.J. The role of the basal ganglia in habit formation. Nat. Rev. Neurosci. 2006, 7(6):464-476.