Evidence that conditioned avoidance responses are reinforced by positive prediction errors signaled by tonic striatal dopamine

Behavioural Brain Research

Volumn 241, Issue 1, 2013, Pages 112-119

  Dombrowski, Patricia A ^a   Maia, Tiago V ^b,g   Boschen, Suelen L ^a   Bortolanza, Mariza ^a   Wendler, Etieli ^a   Schwarting, Rainer K W ^c   Brandão, Marcus Lira ^d   Winn, Philip ^e   Blaha, Charles D ^f   Da Cunha, Claudio ^a  

^a FEDERAL UNIVERSITY OF PARANÁ   (Brazil)

^b NEW YORK STATE PSYCHIATRIC INSTITUTE   (United States)

^c INSTITUTO DE MEDICINA MOLECULAR   (Portugal)

^d PHILIPPS UNIVERSITY MARBURG   (Germany)

^e INeC   (Brazil)

^f UNIVERSITY OF STRATHCLYDE   (United Kingdom)

^g University of Memphis   (United States)

Author keywords

Avoidance learning; Dopamine; Hedonia; Prediction error; Salience

Indexed keywords

DOPAMINE;

ANIMAL EXPERIMENT; ANIMAL TISSUE; ARTICLE; AVERSION; AVOIDANCE BEHAVIOR; CONTROLLED STUDY; DOPAMINE RELEASE; IMMUNOHISTOCHEMISTRY; IN VIVO STUDY; MALE; MICRODIALYSIS; NONHUMAN; PREDICTION; PRIORITY JOURNAL; RAT; REINFORCEMENT; RESPONSE TIME; STIMULUS RESPONSE; SUBSTANTIA NIGRA; TASK PERFORMANCE; VENTRAL TEGMENTUM;

ANIMALS; AVOIDANCE LEARNING; CONDITIONING, OPERANT; CORPUS STRIATUM; DOPAMINE; ELECTROSHOCK; MALE; MICRODIALYSIS; NEURONS; RATS; RATS, WISTAR;

EID: 84871825867     PISSN: 01664328     EISSN: 18727549     Source Type: Journal    
DOI: 10.1016/j.bbr.2012.06.031     Document Type: Article

References (57)

1. Da Cunha C., Wietzikoski E.C., Dombrowski P., Santos L.M., Bortolanza M., Boschen S.L., et al. Learning processing in the basal ganglia: a mosaic of broken mirrors. Behavioural Brain Research 2009, 199:156-169.
2. Darvas M., Fadok J.P., Palmiter R.D. Requirement of dopamine signaling in the amygdala and striatum for learning and maintenance of a conditioned avoidance response. Learning and Memory 2011, 18:136-143.
3. Ostlund S.B., Wassum K.M., Murphy N.P., Balleine B.W., Maidment N.T. Extracellular dopamine levels in striatal subregions track shifts in motivation and response cost during instrumental conditioning. Journal of Neuroscience 2011, 31:200-207.
4. Schultz W. Dopamine signals for reward value and risk: basic and recent data. Behavioral and Brain Functions 2010, 6:9.
5. Wise R.A. Dopamine and reward: the anhedonia hypothesis 30 years on. Neurotoxicity Research 2008, 14:169-183.
6. Redgrave P., Gurney K., Reynolds J. What is reinforced by phasic dopamine signals. Brain Research Reviews 2008, 58:322-339.
7. Redgrave P., Prescott T.J., Gurney K. Is the short-latency dopamine response too short to signal reward error. Trends in Neurosciences 1999, 22:146-151.
8. Anstrom K.K., Miczek K.A., Budygin E.A. Increased phasic dopamine signaling in the mesolimbic pathway during social defeat in rats. Neuroscience 2009, 161:3-12.
9. Berridge K.C. The debate over dopamine's role in reward: the case for incentive salience. Psychopharmacology 2007, 131:391-431.
10. Goto Y., Otani S., Grace A.A. The Yin Yang of dopamine release: a new perspective. Neurophramacology 2007, 53:583-587.
11. Robinson D.L., Howard E.C., McConnell S., Gonzales R.A., Wightman R.M. Disparity between tonic and phasic ethanol-induced dopamine increases in the nucleus accumbens of rats. Alcoholism 2009, 33:1187-1196.
12. Horvitz J.C. Mesolimbocortical and nigrostriatal dopamine responses to salient non-reward events. Neuroscience 2000, 96:651-656.
13. McCullough L.D., Sokolowski J.D., Salamone J.D. A neurochemical and behavioral investigation of the involvement of nucleus-accumbens dopamine in instrumental avoidance. Neuroscience 1993, 52:919-925.
14. Saulskaya N.B. Striatal synaptic dopamine release during passive-avoidance behavior in rats. Zhurnal Vyss Nervn Deyatelnosti Im I P Pavlov 1993, 43:1025-1029.
15. Pezze M.A., Heidbreder C.A., Feldon J., Murphy C.A. Selective responding of nucleus accumbens core and shell dopamine to aversively conditioned contextual and discrete stimuli. Neuroscience 2001, 108:91-102.
16. Young A.M.J., Ahier R.G., Upton R.L., Joseph M.H., Gray J.A. Increased extracellular dopamine in the nucleus accumbens of the rat during associative learning of neutral stimuli. Neuroscience 1998, 83:1175-1183.
17. Young A.M.J. Increased extracellular dopamine in nucleus accumbens in response to unconditioned and conditioned aversive stimuli: studies using 1min microdialysis in rats. Journal of Neuroscience Methods 2004, 138:57-63.
18. McCullough L.D., Cousins M.S., Salamone J.D. The role of nucleus-accumbens dopamine in responding on a continuous reinforcement operant schedule - a neurochemical and behavioral-study. Pharmacology Biochemistry and Behavior 1993, 46:581-586.
19. Levita L., Dalley J.W., Robbins T.W. Nucleus accumbens dopamine and learned fear revisited: a review and some new findings. Behavioural Brain Research 2002, 137:115-127.
20. Brischoux F., Chakraborty S., Brierley D.I., Ungless M.A. Phasic excitation of dopamine neurons in ventral VTA by noxious stimuli. Proceedings of the National Academy of Sciences of the United States of America 2009, 106:4893-4899.
21. Matsumoto M., Hikosaka O. Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature 2009, 459:838-842.
22. Zweifel L.S., Fadok J.P., Argilli E., Garelick M.G., Jones G.L., Dickerson T.M.K., et al. Activation of dopamine neurons is critical for aversive conditioning and prevention of generalized anxiety. Nature Neuroscience 2011, 14:620-628.
23. Wang D.V., Tsien J.Z. Convergent processing of both positive and negative motivational signals by the VTA dopamine neuronal populations. PLoS ONE 2011, 6.
24. Budygin E.A., Park J., Bass C.E., Grinevich V.P., Bonin K.D., Wightman R.M. Aversive stimulus differentially triggers subsecond dopamine release in reward regions. Neuroscience 2012, 201:331-337.
25. Maia T.V. Two-factor theory, the actor-critic model, and conditioned avoidance. Learning & Behavior 2010, 38:50-67.
26. Huston J.P., Mueller C.C., Mondadori C. Memory facilitation by posttrial hypothalamic-stimulation and other reinforcers - central theory of reinforcement. Biobehavioral Reviews 1977, 1:143-150.
27. Huston J.P., Oitzl M.S. The relationship between reinforcement and memory - parallels in the rewarding and mnemonic effects of the neuropeptide substance-P. Neuroscience and Biobehavioral Reviews 1989, 13:171-180.
28. Schultz W., Dayan P., Montague P.R. A neural substrate of prediction and reward. Science 1997, 275:1593-1599.
29. Ferro M.M., Bellissimo M.I., Anselmo-Franci J.A., Angellucci M.E.M., Canteras N.S., Da Cunha C. Comparison of bilaterally 6-OHDA- and MPTP-lesioned rats as models of the early phase of Parkinson's disease: Histological, neurochemical, motor and memory alterations. Journal of Neuroscience Methods 2005, 148:78-87.
30. Da Cunha C., Gevaerd M.S., Vital M., Miyoshi E., Andreatini R., Silveira R., et al. Memory disruption in rats with nigral lesions induced by MPTP: a model for early Parkinson's disease amnesia. Behavioural Brain Research 2001, 124:9-18.
31. Tadaiesky M.T., Dombrowski P.A., Figueiredo C.P., Cargnin-Ferreira E., Da Cunha C., Takahashi R.N. Emotional, cognitive and neurochemical alterations in a premotor stage model of Parkinson's disease. Neuroscience 2008, 156:830-840.
32. Perry J.C., Da Cunha C., Anselmo-Franci J., Andreatini R., Miyoshi E., Tufik S., et al. Behavioural and neurochemical effects of phosphatidylserine in MPTP lesion of the substantia nigra of rats. European Journal of Pharmacology 2004, 484:225-233.
33. Ho Y.J., Ho S.C., Pawlak C.R., Yeh K.Y. Effects of d-cycloserine on MPTP-induced behavioral and neurological changes: potential for treatment of Parkinson's disease dementia. Behavioural Brain Research 2011, 219:280-290.
34. Wang A.L., Liou Y.M., Pawlak C.R., Ho Y.J. Involvement of NMDA receptors in both MPTP-induced neuroinflammation and deficits in episodic-like memory in Wistar rats. Behavioural Brain Research 2010, 208:38-46.
35. Kumar P., Kaundal R.K., More S., Sharma S.S. Beneficial effects of pioglitazone on cognitive impairment in MPTP model of Parkinson's disease. Behavioural Brain Research 2009, 197:398-403.
36. Wadenberg M.L., Ericson E., Magnusson O., Ahlenius S. Suppression of conditioned avoidance-behavior by the local application of (-)sulpiride into the ventral, but not the dorsal, striatum of the rat. Biological Psychiatry 1990, 28:297-307.
37. Setlow B., McGaugh J.L. D2 dopamine receptor blockade immediately post-training enhances retention in hidden and visible platform versions of the water maze. Learning and Memory 2000, 7:187-191.
38. Setlow B., McGaugh J.L. Sulpiride infused into the nucleus accumbens posttraining impairs memory of spatial water maze training. Behavioral Neuroscience 1998, 112:603-610.
39. Stuchlik A., Vales K. Effect of dopamine D1 receptor antagonist SCH23390 and D1 agonist A77636 on active allothetic place avoidance, a spatial cognition task. Behavioural Brain Research 2006, 172:250-255.
40. Manago F., Castellano C., Oliverio A., Mele A., De Leonibus E. Role of dopamine receptors subtypes, D1-like and D2-like, within the nucleus accumbens subregions, core and shell, on memory consolidation in the one-trial inhibitory avoidance task. Learning and Memory 2009, 16:46-52.
41. Wietzikoski E.C., Boschen S.L., Miyoshi E., Bortolanza M., Santos L.M., Frank M., et al. Roles of D1-like dopamine receptors in the nucleus accumbens and dorsolateral striatum in conditioned avoidance response. Psychopharmacology 2012, 219:159-169.
42. Boschen S.L., Wietzikoski E.C., Winn P., Da Cunha C. The role of nucleus accumbens and dorsolateral striatal D2 receptors in active avoidance conditioning. Neurobiology of Learning and Memory 2011, 96:254-262.
43. Paxinos G., Watson C The rat brain in stereotaxic coordinates 2005, Academic Press, Ltd., San Diego, CA, USA. 5th edition.
44. Jolly D., Vezina P. In vivo microdialysis in the rat: low cost and low labor construction of a small diameter, removable, concentric-style microdialysis probe system. Journal of Neuroscience Methods 1996, 68:259-267.
45. Mowrer O.H. Two-factor learning theory reconsidered, with special reference to secondary reinforcement and the concept of habit. Psychological Review 1956, 63:114-128.
46. Ballard P.A., Tetrud J.W., Langston J.W. Permanent human parkinsonism due to 1-methyl-4-phenyl-1,2,3,6-tetrahydropyridine (MPTP) - 7 cases. Neurology 1985, 35:949-956.
47. Bracs P.U., Gregory P., Jackson D.M. Passive-avoidance in rats - disruption by dopamine applied to the nucleus accumbens. Psychopharmacology 1984, 83:70-75.
48. Wickens J.R., Shindou T., Ochi-Shindou M. Synaptic plasticity in the striatum: modulation by dopamine. The Journal of Physiological Sciences 2009, 59:48.
49. Surmeier D.J., Plotkin J., Shen W.X. Dopamine and synaptic plasticity in dorsal striatal circuits controlling action selection. Current Opinion in Neurobiology 2009, 19:621-628.
50. Huston J.P., MondadorC.Waser P.G. Memory consolidation as a response directly modifiable by operant-conditioning. Experientia 1974, 30:680-780.
51. White I.M., Christensen J.R., Flory G.S., Miller D.W., Amphetamine Rebec G.V. Cocaine and dizocilpine enhance performance on a lever-release, conditioned avoidance-response task in rats. Psychopharmacology 1995, 118:324-331.
52. Evangeli A.M., Izquierdo I. Effect of pre-trial and post-trial amphetamine injections on avoidance responses of rats. Psychopharmacologia 1971, 20:42.
53. Huston J.P., Mueller C.C. Enhanced passive-avoidance learning and appetitive t-maze learning with post-trial rewarding hypothalamic-stimulation. Brain Research Bulletin 1978, 3:265-270.
54. Huston J.P., Waser P.G., Ornstein K., Mondadori C. Facilitation of avoidance-learning by post-trial reinforcing hypothalamic-stimulation. Experientia 1976, 32:757-857.
55. Ilango A., Shumake J., Wetzel W., Scheich H., Ohl F.W. Effects of ventral tegmental area stimulation on the acquisition and long-term retention of active avoidance learning. Behavioural Brain Research 2011, 225:515-521.
56. You Z.B., Chen Y.Q., Wise R.A. Dopamine and glutamate release in the nucleus accumbens and ventral tegmental area of rat following lateral hypothalamic self-stimulation. Neuroscience 2001, 107:629-639.
57. Wise R.A. Dopamine, learning and motivation. Nature Reviews Neuroscience 2004, 5:483-494.