Functional specialization within the striatum along both the dorsal/ventral and anterior/posterior axes during associative learning via reward and punishment

Learning and Memory

Volumn 18, Issue 11, 2011, Pages 703-711

  Mattfeld, Aaron T ^a,b   Gluck, Mark A ^c   Stark, Craig E L ^a,b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b Center for the Neurobiology of Learning and Memory   (United States)

^c RUTGERS UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; CAUDATE NUCLEUS; CONTROLLED STUDY; CORPUS STRIATUM; FEEDBACK SYSTEM; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; MALE; NORMAL HUMAN; PRIORITY JOURNAL; PUNISHMENT; PUTAMEN; REWARD; STATE DEPENDENT LEARNING; TRAINING;

ADULT; ANALYSIS OF VARIANCE; ANTIPARKINSON AGENTS; ASSOCIATION LEARNING; BRAIN MAPPING; CORPUS STRIATUM; FEEDBACK, PSYCHOLOGICAL; FEMALE; HUMANS; MAGNETIC RESONANCE IMAGING; MALE; MODELS, NEUROLOGICAL; PARKINSON DISEASE; PATTERN RECOGNITION, VISUAL; PUNISHMENT; REWARD; YOUNG ADULT;

EID: 80054810435     PISSN: 10720502     EISSN: 15495485     Source Type: Journal    
DOI: 10.1101/lm.022889.111     Document Type: Article

References (66)

1. Alexander GE, DeLong MR, Strick PL. 1986. Parallel organization of functionally segregated circuits linking basal ganglia and cortex. Annu Rev Neurosci 9: 357-381. (Pubitemid 16055790)
2. Avants B, Duda JT, Kim J, Zhang H, Pluta J, Gee JC, Whyte J. 2008. Multivariate analysis of structural and diffusion imaging in traumatic brain injury. Acad Radiol 15: 1360-1375.
3. Barto AG. 1995. Adaptive critics and the basal ganglia. In Models of information processing in the basal ganglia (ed. JC Houk, et al.), pp. 215-232. The MIT Press, Cambridge, MA.
4. Becerra L, Breiter HC, Wise R, Gonzalez RG, Borsook D. 2001. Reward circuitry activation by noxious thermal stimuli. Neuron 32: 927-946. (Pubitemid 34024851)
5. Bódi N, Kéri S, Nagy H, Moustafa A, Meyers CE, Daw N, Dibó G, Takáts A, Bereczki D, Gluck M. 2009. Reward-learning and the novelty-seeking personality: A between- and within-subjects study of the effects of dopamine agonists on young Parkinson's patients. Brain 132: 2385-2395.
6. Breiter HC, Aharon I, Kahneman D, Dale A, Shizgal P. 2001. Functional imaging of neural responses to expectancy and experience of monetary gains and losses. Neuron 30: 619-639. (Pubitemid 32530601)
7. Bromberg-Martin ES, Matsumoto M, Hikosaka O. 2010. Dopamine in motivational control: Rewarding, aversive, and alerting. Neuron 68: 815-834.
8. Büchel C, Morris J, Dolan RJ, Friston KJ. 1998. Brain systems mediating aversive conditioning: An event-related fMRI study. Neuron 20: 947-957. (Pubitemid 28247400)
9. Burock MA, Buckner RL, Woldorff MG, Rosen BR, Dale A. 1998. Randomized event-related experimental designs allow for extremely rapid presentation rates using functional MRI. Neuroreport 9: 3735-3739. (Pubitemid 28561770)
10. Casey KL, Minoshima S, Berger KL, Koeppe RA, Morrow TJ, Frey KA. 1994. Positron emission tomographic analysis of cerebral structures activated specifically by repetitive noxious heat stimuli. J Neurophysiol 71: 802-807. (Pubitemid 24068606)
11. Chikama M, McFarland NR, Amaral DG, Haber SN. 1997. Insular cortical projections to functional regions of the striatum correlate with cortical cytoarchitectonic organization in the primate. J Neurosci 17: 9686-9705. (Pubitemid 28006412)
12. Cox RW. 1996. AFNI: Software for analysis and visualization of functional magnetic resonance neuroimages. Comput Biomed Res 29: 162-173. (Pubitemid 26266657)
13. Dale AM, Buckner RL. 1997. Selective averaging of rapidly presented individual trials using fMRI. Hum Brain Mapp 5: 329-340. (Pubitemid 27479394)
14. Daw N, Kakade S, Dayan P. 2002. Opponent interactions between serotonin and dopamine. Neural Netw 15: 603-616. (Pubitemid 34951146)
15. Delgado MR. 2007. Reward-related responses in the human striatum. Ann NY Acad Sci 1104: 70-88. (Pubitemid 47092728)
16. Delgado MR, Nystrom LE, Fissell C, Nolls C, Fiez JA. 2000. Tracking the hemodynamic responses to reward and punishment in the striatum. J Neurophysiol 84: 3072-3077.
17. Delgado MR, Locke HM, Stenger VA, Fiez JA. 2003. Dorsal striatum responses to reward and punishment: Effects of valence and magnitude manipulations. Cogn Affect Behav Neurosci 3: 27-38. (Pubitemid 37517033)
18. Delgado MR, Li J, Schiller D, Phelps EA. 2008. The role of the striatum in aversive learning and aversive prediction errors. Phil Trans R Soc B 363: 3787-3800.
19. Doya K. 2002. Metalearning and neuromodulation. Neural Netw 15: 495-506. (Pubitemid 34947460)
20. Elliott R, Frith CD, Dolan RJ. 1997. Differential neural response to positive and negative feedback in planning and guessing tasks. Neuropsychologia 35: 1395-1404. (Pubitemid 27455567)
21. Elliott R, Friston KJ, Dolan RJ. 2000. Dissociable neural responses in human reward systems. J Neurosci 20: 6159-6165. (Pubitemid 30658409)
22. Greenspan JD, Winfield JA. 1992. Reversible pain and tactile deficits associated with a cerebral tumor compressing the posterior insula and parietal operculum. Pain 50: 29-39.
23. Haber SN. 2003. The primate basal ganglia: Parallel and integrative networks. J Chem Neuroanat 26: 317-330. (Pubitemid 38077155)
24. Haruno M, Kawato M. 2006. Heterarchical reinforcement-learning model for integration of multiple cortico-striatal loops: fMRI examination in stimulus-action-reward association learning. Neural Netw 19: 1241-1254.
25. Heidbreder CA, Hedou G, Feldon J. 1999. Behavioral neurochemistry reveals a new functional dichotomy in the shell subregion of the nucleus accumbens. Prog Neuropsychopharmacol Biol Psychiatry 23: 99-132. (Pubitemid 29098905)
26. Hikosaka O, Miyashita K, Miyachi S, Sakai K, Lu X. 1998. Differential roles of the frontal cortex, basal ganglia, and cerebellum in visuomotor sequence learning. Neurobiol Learn Mem 70: 137-149. (Pubitemid 28455588)
27. Ikemoto S. 2007. Dopamine reward circuitry: Two projection systems from the ventral midbrain to the nucleus accumbens-olfactory tubercle complex. Brain Res Rev 56: 27-78. (Pubitemid 350110353)
28. Jensen J, McInotsh AR, Crawley AP, Mikulis DJ, Remington G, Kapur S. 2003. Direct activation of the ventral striatum in anticipation of aversive stimuli. Neuron 40: 1251-1257. (Pubitemid 38032799)
29. Jensen J, Smith AJ, Willeit M, Crawley AP, Mikulis DJ, Vitcu I, Kapur S. 2007. Separate brain regions code for salience vs. valence during reward prediction in humans. Hum Brain Mapp 28: 294-302. (Pubitemid 46542911)
30. Kahnt T, Park SQ, Cohen MX, Beck A, Heinz A, Wrase J. 2009. Dorsal striatal-midbrain connectivity in humans predicts how reinforcements are used to guide decisions. J Cogn Neurosci 21: 1332-1345.
31. Kim H, Shimojo S, O'Doherty JP. 2006. Is avoiding an aversive outcome rewarding? Neural substrates of avoidance learning in the human brain. PLoS Biology 4: e233. doi: 10.1371/journal.pbio.0040233.
32. Klein TA, Neumann J, Reuter M, Hennig J, von Cramon DY, Ullsperger J. 2007. Genetically determined differences in learning from errors. Science 318: 1642-1645. (Pubitemid 350233666)
33. Knowlton BJ, Mangels JA, Squire LR. 1996. A neostriatal habit learning system in humans. Science 273: 1399-1402. (Pubitemid 26296530)
34. Konorski J. 1967. Integrative activity of the brain: An interdisciplinary approach. University of Chicago Press, Chicago.
35. Law JR, Flannery MA, Wirth S, Yanike M, Smith AC, Frank LM, Suzuki WA, Brown EN, Stark CEL. 2005. FMRI activity during the gradual acquisition and expression of paired-associate memory. J Neurosci 25: 5720-5729. (Pubitemid 40847884)
36. Liu X, Powell DK, Wang H, Gold BT, Corbly CR, Joseph JE. 2007. Functional dissociation in the frontal and striatal areas for processing of positive and negative reward information. J Neurosci 27: 4587-4597. (Pubitemid 46663580)
37. Logothetis NK, Pauls J, Augath M, Trinath T, Oeltermann A. 2001. Neurophysiological investigation of the basis of the fMRI signal. Nature 412: 150-157. (Pubitemid 32674704)
38. Lynd-Balta E, Haber SN. 1994. The organization of midbrain projections to the striatum in the primate: Sensorimotor-related striatum versus ventral striatum. Neuroscience 59: 625-640. (Pubitemid 24131517)
39. Matsumoto M, Hikosaka O. 2009. Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature 459: 837-841.
40. Mattfeld AT, Stark CEL. 2010. Striatal and medial temporal lobe functional interactions during visuomotor associative learning. Cereb Cortex 21: 647-658.
41. Miyachi S, Hikosaka O, Miyashita K, Karadi Z, Rand MK. 1997. Differential roles of monkey striatum in learning of sequential hand movement. Exp Brain Res 115: 1-5. (Pubitemid 27259603)
42. Miyachi S, Hikosaka O, Lu X. 2002. Differential activation of monkey striatal neurons in the early and late stages of procedural learning. Exp Brain Res 146: 122-126. (Pubitemid 34985335)
43. O'Doherty JP. 2004. Reward representations and reward-related learning in the human brain: Insights from neuroimaging. Curr Opin Neurobiol 14: 769-776. (Pubitemid 39576211)
44. O'Doherty JP, Kringelbach ML, Rolls ET, Hornak J, Andrews C. 2001. Abstract reward and punishment representations in the human orbitofrontal cortex. Nat Neurosci 4: 95-102. (Pubitemid 32095532)
45. Pessiglione M, Seymour B, Flandin G, Dolan RJ, Frith CD. 2006. Dopamine-dependent prediction errors underpin reward-seeking behavior in humans. Nature 442: 1042-1045. (Pubitemid 44330261)
46. Robinson OJ, Frank MJ, Sahakian BJ, Cools R. 2010. Dissociable responses to punishment in distinct striatal regions during reversal learning. NeuroImage 51: 1459-1467.
47. Schultz W. 2007. Multiple dopamine functions at different time courses. Annu Rev Psychol 30: 259-288. (Pubitemid 47218758)
48. Seger CA. 2008. How do the basal ganglia contribute to categorization? Their role in generalization, response selection, and learning via feedback. Neurosci Biobehav Rev 32: 265-278. (Pubitemid 351146621)
49. Seger CA, Peterson EJ, Cincotta CM, Lopez-Paniagua D, Anderson CW. 2010. Dissociating the contributions of independent corticostriatal systems to visual categorization learning through the use of reinforcement learning modeling and Granger causality modeling. NeuroImage 50: 644-656.
50. Seymour B, O'Doherty JP, Dayan P, Koltzenburg M, Jones AK, Dolan RJ, Friston KJ, Frackowiak RS. 2004. Temporal difference models describe higher-order learning in humans. Nature 429: 664-667. (Pubitemid 38812318)
51. Seymour B, O'Doherty JP, Klotzenburg M, Wiech K, Frackowiak R, Friston KJ, Dolan R. 2005. Opponent appetitive-aversive neural processes underlie predictive learning of pain relief. Nat Neurosci 8: 1234-1240. (Pubitemid 43348143)
52. Seymour B, Daw N, Dayan P, Singer T, Dolan RJ. 2007. Differential encoding of losses and gains in the human striatum. J Neurosci 27: 4826-4831. (Pubitemid 46699059)
53. Smith AC, Frank LM, Wirth S, Yanike M, Hu D, Kubota Y, Graybiel AM, Suzuki WA, Brown EN. 2004. Dynamic analysis of learning in behavioral experiments. J Neurosci 24: 447-461. (Pubitemid 38112376)
54. Stark CEL, Okado Y. 2003. Making memories without trying: Medial temporal lobe activity associated with incidental memory formation during recognition. J Neurosci 23: 6748-6753. (Pubitemid 36951201)
55. Sutton RS, Barto AG. 1998. Reinforcement learning: An introduction. The MIT Press, Cambridge, MA.
56. Talairach J, Tournoux P. 1988. A coplanar sterotaxic atlas of the human brain. Thieme Medical, New York.
57. Thorndike EL. 1933. A proof of the law of effect. Science 77: 173-175.
58. Tom SM, Fox CR, Trepel C, Poldrack RA. 2007. The neural basis of loss aversion in decision-making under risk. Science 315: 515-518. (Pubitemid 46175755)
59. Tricomi EM, Fiez JA. 2008. Feedback signals in the caudate reflect goal achievement on a declarative memory task. NeuroImage 41: 1154-1167.
60. Tricomi EM, Delgado MR, Fiez JA. 2004. Modulation of caudate activity by action contingency. Neuron 41: 281-292. (Pubitemid 38125188)
61. Watkins CHCJ. 1989. Learning with delayed rewards. PhD thesis, Cambridge University, Cambridge, UK.
62. Wheeler EZ, Fellows LK. 2008. The human ventromedial frontal lobe is critical for learning from negative feedback. Brain 131: 1323-1331.
63. Widrow B, Hoff ME. 1960. Adaptive switching circuits. IRE Wescon Convention Record. 96-104.
64. Yacubian J, Gläscher J, Schroeder K, Sommer T, Braus DF, Büchel C. 2006. Dissociable systems for gain- and loss-related value predictions and errors of prediction in the human brain. J Neurosci 26: 9530-9537. (Pubitemid 44396866)
65. Yin HH, Knowlton BJ, Balleine BW. 2004. Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning. Eur J Neurosci 19: 181-189. (Pubitemid 38122084)
66. Yin HH, Knowlton BJ, Balleine BW. 2005. Blockade of NMDA receptors in the dorsomedial striatum prevents action-outcome learning in instrumental conditioning. Eur J Neurosci 22: 505-512. (Pubitemid 41097623)