Critical Roles for Anterior Insula and Dorsal Striatum in Punishment-Based Avoidance Learning

Neuron

Volumn 76, Issue 5, 2012, Pages 998-1009

  Palminteri, Stefano ^a,b   Justo, Damian ^b   Jauffret, Céline ^b   Pavlicek, Beth ^c   Dauta, Aurélie ^d   Delmaire, Christine ^e   Czernecki, Virginie ^d   Karachi, Carine ^d   Capelle, Laurent ^d   Durr, Alexandra ^b,d   Pessiglione, Mathias ^a,b  

^a PITIÉ SALPÊTRIÈRE HOSPITAL   (France)

^b INSERM   (France)

^c INSEAD   (France)

^d ASSISTANCE PUBLIQUE HÔPITAUX DE PARIS   (France)

^e LILLE UNIVERSITY HOSPITAL   (France)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ANTERIOR INSULA; ARTICLE; ASSOCIATION; AVOIDANCE BEHAVIOR; BRAIN CORTEX; BRAIN DAMAGE; BRAIN REGION; BRAIN TUMOR; CONTROLLED STUDY; CORPUS STRIATUM; DECISION MAKING; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUNTINGTON CHOREA; LEARNING DISORDER; MAJOR CLINICAL STUDY; MALE; MATHEMATICAL MODEL; MONEY; PREDICTION; PRIORITY JOURNAL; PUNISHMENT; SUBCORTEX; TASK PERFORMANCE;

ADULT; ATROPHY; AVOIDANCE LEARNING; BRAIN MAPPING; BRAIN NEOPLASMS; CEREBRAL CORTEX; CORPUS STRIATUM; FEMALE; HUMANS; HUNTINGTON DISEASE; IMAGE PROCESSING, COMPUTER-ASSISTED; MAGNETIC RESONANCE IMAGING; MALE; MIDDLE AGED; OXYGEN; PUNISHMENT;

EID: 84872723739     PISSN: 08966273     EISSN: 10974199     Source Type: Journal    
DOI: 10.1016/j.neuron.2012.10.017     Document Type: Article

References (52)

1. Atallah H.E., Lopez-Paniagua D., Rudy J.W., O'Reilly R.C. Separate neural substrates for skill learning and performance in the ventral and dorsal striatum. Nat. Neurosci. 2007, 10:126-131.
2. Bar-Gad I., Bergman H. Stepping out of the box: information processing in the neural networks of the basal ganglia. Curr. Opin. Neurobiol. 2001, 11:689-695.
3. Blair K., Marsh A.A., Morton J., Vythilingam M., Jones M., Mondillo K., Pine D.C., Drevets W.C., Blair J.R. Choosing the lesser of two evils, the better of two goods: specifying the roles of ventromedial prefrontal cortex and dorsal anterior cingulate in object choice. J. Neurosci. 2006, 26:11379-11386.
4. Bódi N., Kéri S., Nagy H., Moustafa A., Myers C.E., Daw N., Dibó G., Takáts A., Bereczki D., Gluck M.A. Reward-learning and the novelty-seeking personality: a between- and within-subjects study of the effects of dopamine agonists on young Parkinson's patients. Brain 2009, 132:2385-2395.
5. Büchel C., Morris J., Dolan R.J., Friston K.J. Brain systems mediating aversive conditioning: an event-related fMRI study. Neuron 1998, 20:947-957.
6. Craig A.D. Interoception: the sense of the physiological condition of the body. Curr. Opin. Neurobiol. 2003, 13:500-505.
7. Daw N.D., Kakade S., Dayan P. Opponent interactions between serotonin and dopamine. Neural Netw. 2002, 15:603-616.
8. Daw N.D., Gershman S.J., Seymour B., Dayan P., Dolan R.J. Model-based influences on humans' choices and striatal prediction errors. Neuron 2011, 69:1204-1215.
9. De Martino B., Camerer C.F., Adolphs R. Amygdala damage eliminates monetary loss aversion. Proc. Natl. Acad. Sci. USA 2010, 107:3788-3792.
10. Delgado M.R., Nystrom L.E., Fissell C., Noll D.C., Fiez J.A. Tracking the hemodynamic responses to reward and punishment in the striatum. J. Neurophysiol. 2000, 84:3072-3077.
11. Douaud G., Gaura V., Ribeiro M.J., Lethimonnier F., Maroy R., Verny C., Krystkowiak P., Damier P., Bachoud-Levi A.C., Hantraye P., Remy P. Distribution of grey matter atrophy in Huntington's disease patients: a combined ROI-based and voxel-based morphometric study. Neuroimage 2006, 32:1562-1575.
12. Doya K. Metalearning and neuromodulation. Neural Netw. 2002, 15:495-506.
13. Draganski B., Kherif F., Klöppel S., Cook P.A., Alexander D.C., Parker G.J.M., Deichmann R., Ashburner J., Frackowiak R.S.J. Evidence for segregated and integrative connectivity patterns in the human Basal Ganglia. J. Neurosci. 2008, 28:7143-7152.
14. Frank M.J., Seeberger L.C., O'reilly R.C. By carrot or by stick: cognitive reinforcement learning in parkinsonism. Science 2004, 306:1940-1943.
15. Galvan A., Hare T.A., Davidson M., Spicer J., Glover G., Casey B.J. The role of ventral frontostriatal circuitry in reward-based learning in humans. J. Neurosci. 2005, 25:8650-8656.
16. Gottfried J.A., Dolan R.J. Human orbitofrontal cortex mediates extinction learning while accessing conditioned representations of value. Nat. Neurosci. 2004, 7:1144-1152.
17. Haber S.N. The primate basal ganglia: parallel and integrative networks. J. Chem. Neuroanat. 2003, 26:317-330.
18. Hare T.A., O'Doherty J., Camerer C.F., Schultz W., Rangel A. Dissociating the role of the orbitofrontal cortex and the striatum in the computation of goal values and prediction errors. J. Neurosci. 2008, 28:5623-5630.
19. Jensen J., McIntosh A.R., Crawley A.P., Mikulis D.J., Remington G., Kapur S. Direct activation of the ventral striatum in anticipation of aversive stimuli. Neuron 2003, 40:1251-1257.
20. Jones C.L., Ward J., Critchley H.D. The neuropsychological impact of insular cortex lesions. J. Neurol. Neurosurg. Psychiatry 2010, 81:611-618.
21. Joshua M., Adler A., Mitelman R., Vaadia E., Bergman H. Midbrain dopaminergic neurons and striatal cholinergic interneurons encode the difference between reward and aversive events at different epochs of probabilistic classical conditioning trials. J. Neurosci. 2008, 28:11673-11684.
22. Kahnt T., Park S.Q., Cohen M.X., Beck A., Heinz A., Wrase J. Dorsal striatal-midbrain connectivity in humans predicts how reinforcements are used to guide decisions. J. Cogn. Neurosci. 2009, 21:1332-1345.
23. Kim H., Shimojo S., O'Doherty J.P. Is avoiding an aversive outcome rewarding? Neural substrates of avoidance learning in the human brain. PLoS Biol. 2006, 4:e233.
24. Kim H., Shimojo S., O'Doherty J.P. Overlapping responses for the expectation of juice and money rewards in human ventromedial prefrontal cortex. Cereb. Cortex 2011, 21:769-776.
25. Kirsch P., Schienle A., Stark R., Sammer G., Blecker C., Walter B., Ott U., Burkart J., Vaitl D. Anticipation of reward in a nonaversive differential conditioning paradigm and the brain reward system: an event-related fMRI study. Neuroimage 2003, 20:1086-1095.
26. Kuhnen C.M., Knutson B. The neural basis of financial risk taking. Neuron 2005, 47:763-770.
27. McCabe C., Mishor Z., Cowen P.J., Harmer C.J. Diminished neural processing of aversive and rewarding stimuli during selective serotonin reuptake inhibitor treatment. Biol. Psychiatry 2010, 67:439-445.
28. Miyazaki K., Miyazaki K.W., Doya K. Activation of dorsal raphe serotonin neurons underlies waiting for delayed rewards. J. Neurosci. 2011, 31:469-479.
29. Morrison S.E., Salzman C.D. The convergence of information about rewarding and aversive stimuli in single neurons. J. Neurosci. 2009, 29:11471-11483.
30. Naqvi N.H., Bechara A. The hidden island of addiction: the insula. Trends Neurosci. 2009, 32:56-67.
31. Nitschke J.B., Dixon G.E., Sarinopoulos I., Short S.J., Cohen J.D., Smith E.E., Kosslyn S.M., Rose R.M., Davidson R.J. Altering expectancy dampens neural response to aversive taste in primary taste cortex. Nat. Neurosci. 2006, 9:435-442.
32. O'Doherty J., Kringelbach M.L., Rolls E.T., Hornak J., Andrews C. Abstract reward and punishment representations in the human orbitofrontal cortex. Nat. Neurosci. 2001, 4:95-102.
33. O'Doherty J., Dayan P., Schultz J., Deichmann R., Friston K., Dolan R.J. Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science 2004, 304:452-454.
34. O'Doherty J.P., Dayan P., Friston K., Critchley H., Dolan R.J. Temporal difference models and reward-related learning in the human brain. Neuron 2003, 38:329-337.
35. Palminteri S., Boraud T., Lafargue G., Dubois B., Pessiglione M. Brain hemispheres selectively track the expected value of contralateral options. J. Neurosci. 2009, 29:13465-13472.
36. Palminteri S., Lebreton M., Worbe Y., Grabli D., Hartmann A., Pessiglione M. Pharmacological modulation of subliminal learning in Parkinson's and Tourette's syndromes. Proc. Natl. Acad. Sci. USA 2009, 106:19179-19184.
37. Palminteri S., Clair A.-H., Mallet L., Pessiglione M. Similar improvement of reward and punishment learning by serotonin reuptake inhibitors in obsessive-compulsive disorder. Biol. Psychiatry 2012, 72:244-250.
38. Pessiglione M., Seymour B., Flandin G., Dolan R.J., Frith C.D. Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans. Nature 2006, 442:1042-1045.
39. Pessiglione M., Petrovic P., Daunizeau J., Palminteri S., Dolan R.J., Frith C.D. Subliminal instrumental conditioning demonstrated in the human brain. Neuron 2008, 59:561-567.
40. Petrovic P., Pleger B., Seymour B., Klöppel S., De Martino B., Critchley H., Dolan R.J. Blocking central opiate function modulates hedonic impact and anterior cingulate response to rewards and losses. J. Neurosci. 2008, 28:10509-10516.
41. Postuma R.B., Dagher A. Basal ganglia functional connectivity based on a meta-analysis of 126 positron emission tomography and functional magnetic resonance imaging publications. Cereb. Cortex 2006, 16:1508-1521.
42. Ravel S., Legallet E., Apicella P. Responses of tonically active neurons in the monkey striatum discriminate between motivationally opposing stimuli. J. Neurosci. 2003, 23:8489-8497.
43. Rutledge R.B., Dean M., Caplin A., Glimcher P.W. Testing the reward prediction error hypothesis with an axiomatic model. J. Neurosci. 2010, 30:13525-13536.
44. Samanez-Larkin G.R., Hollon N.G., Carstensen L.L., Knutson B. Individual differences in insular sensitivity during loss anticipation predict avoidance learning. Psychol. Sci. 2008, 19:320-323.
45. Schlund M.W., Cataldo M.F. Amygdala involvement in human avoidance, escape and approach behavior. Neuroimage 2010, 53:769-776.
46. Seymour B., O'Doherty J.P., Dayan P., Koltzenburg M., Jones A.K., Dolan R.J., Friston K.J., Frackowiak R.S. Temporal difference models describe higher-order learning in humans. Nature 2004, 429:664-667.
47. Seymour B., Daw N., Dayan P., Singer T., Dolan R. Differential encoding of losses and gains in the human striatum. J. Neurosci. 2007, 27:4826-4831.
48. Sutton R.S., Barto A.G. Reinforcement Learning: An Introduction 1998, The MIT Press, Cambridge, MA.
49. Tabrizi S.J., Langbehn D.R., Leavitt B.R., Roos R.A., Durr A., Craufurd D., Kennard C., Hicks S.L., Fox N.C., Scahill R.I., et al. Biological and clinical manifestations of Huntington's disease in the longitudinal TRACK-HD study: cross-sectional analysis of baseline data. Lancet Neurol. 2009, 8:791-801. TRACK-HD investigators.
50. Tom S.M., Fox C.R., Trepel C., Poldrack R.A. The neural basis of loss aversion in decision-making under risk. Science 2007, 315:515-518.
51. Tversky A., Kahneman D. Advances in prospect theory: Cumulative representation of uncertainty. J. Risk Uncertain. 1992, 5:297-323.
52. Yacubian J., Gläscher J., Schroeder K., Sommer T., Braus D.F., Büchel C. Dissociable systems for gain- and loss-related value predictions and errors of prediction in the human brain. J. Neurosci. 2006, 26:9530-9537.