Dopamine receptor blockade attenuates the general incentive motivational effects of noncontingently delivered rewards and reward-paired cues without affecting their ability to bias action selection

Neuropsychopharmacology

Volumn 37, Issue 2, 2012, Pages 508-519

  Ostlund, Sean B ^a,b   Maidment, Nigel T ^a,b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

dopamine; free operant; incentive motivation; Pavlovian; reward

Indexed keywords

DOPAMINE; DOPAMINE RECEPTOR; FLUPENTIXOL; SUCROSE;

ANIMAL EXPERIMENT; ARTICLE; ASSOCIATION; CONTROLLED STUDY; DRUG EFFECT; HUNGER; INSTRUMENTAL CONDITIONING; LOW DRUG DOSE; MALE; MOTIVATION; NOISE; NONHUMAN; PRIORITY JOURNAL; RAT; RECEPTOR BLOCKING; REWARD; STIMULUS RESPONSE;

ANIMALS; CONDITIONING, CLASSICAL; CONDITIONING, OPERANT; CUES; DOPAMINE; DOPAMINE ANTAGONISTS; FLUPENTHIXOL; MALE; MOTIVATION; RATS; RATS, LONG-EVANS; REWARD; TRANSFER (PSYCHOLOGY);

EID: 84856031720     PISSN: 0893133X     EISSN: 1740634X     Source Type: Journal    
DOI: 10.1038/npp.2011.217     Document Type: Article

References (64)

1. Baker AG, Steinwald H, Bouton ME (1991). Contextual conditioning and reinstatement of extinguished instrumental responding. Q J Exp Psychol 43B: 199-218.
2. Balleine B (1994). Asymmetrical interactions between thirst and hunger in Pavlovian-instrumental transfer. Q J Exp Psychol 47B: 211-231.
3. Balleine BW, Dickinson A (1998). Goal-directed instrumental action: contingency and incentive learning and their cortical substrates. Neuropharmacology 37: 407-419. (Pubitemid 28306930)
4. Balleine BW, Ostlund SB (2007). Still at the choice-point: action selection and initiation in instrumental conditioning. Ann N Y Acad Sci 1104: 147-171. (Pubitemid 47092732)
5. Blackburn JR, Pfaus JG, Phillips AG (1992). Dopamine functions in appetitive and defensive behaviours. Prog Neurobiol 39: 247-279.
6. Blundell P, Hall G, Killcross S (2001). Lesions of the basolateral amygdala disrupt selective aspects of reinforcer representation in rats. J Neurosci 21: 9018-9026. (Pubitemid 33054863)
7. Chausmer AL, Ettenberg A (1997). A role for D2, but not D1, dopamine receptors in the response-reinstating effects of food reinforcement. Pharmacol Biochem Behav 57: 681-685. (Pubitemid 27334415)
8. Colwill RM (1994). Associative representations of instrumental contingencies. In: Medin DL (ed). The Psychology of Learning and Motivation. Academic Press: New York, pp 1-72.
9. Colwill RM, Rescorla RA (1985). Postconditioning devaluation of a reinforcer affects instrumental responding. J Exp Psychol Anin Behav Proc 11: 120.
10. Colwill RM, Rescorla RA (1988). Associations between the discriminative stimulus and the reinforcer in instrumental learning. J Exper Psychol Anim Behav Proc 14: 155-164.
11. Corbit LH, Balleine BW (2003). The role of prelimbic cortex in instrumental conditioning. Behav Brain Res 146: 145-157. (Pubitemid 37476141)
12. Corbit LH, Balleine BW (2005). Double dissociation of basolateral and central amygdala lesions on the general and outcomespecific forms of Pavlovian-instrumental transfer. J Neurosci 25: 962-970. (Pubitemid 40171012)
13. Corbit LH, Janak PH, Balleine BW (2007). General and outcomespecific forms of Pavlovian-instrumental transfer: the effect of shifts in motivational state and inactivation of the ventral tegmental area. Eur J Neurosci 26: 3141-3149. (Pubitemid 350135179)
14. Day JJ, Jones JL, Wightman RM, Carelli RM (2010). Phasic nucleus accumbens dopamine release encodes effort-and delay-related costs. Biol Psych 68: 306-309.
15. Delamater AR, Lolordo VM, Sosa W (2003). Outcome-specific conditioned inhibition in Pavlovian backward conditioning. Learn Behav 31: 393-402. (Pubitemid 38622771)
16. De Wit S, Ostlund SB, Balleine BW, Dickinson A (2009). Resolution of conflict between goal-directed actions: outcome encoding and neural control processes. J Exper Psychol Anim Behav Proc 35: 382-393.
17. Dickinson A, Dawson GR (1987). Pavlovian processes in the motivational control of instrumental performance. Q J Exper Psychol 39B: 201-213.
18. Dickinson A, Smith J, Mirenowicz J (2000). Dissociation of Pavlovian and instrumental incentive learning under dopamine antagonists. Behav Neurosci 114: 468-483. (Pubitemid 30490894)
19. Estes WK (1948). Discriminative conditioning. II. Effects of a Pavlovian conditioned stimulus upon a subsequently established operant response. J Exp Psycho 38: 173-177.
20. Evenden JL, Robbins TW (1983). Dissociable effects of damphetamine, chlordiazepoxide and alpha-flupenthixol on choice and rate measures of reinforcement in the rat. Psychopharmacology 79: 180-186. (Pubitemid 13192078)
21. Everitt BJ, Robbins TW (2005). Neural systems of reinforcement for drug addiction: from actions to habits to compulsion. Nat Neurosci 8: 1481-1489. (Pubitemid 41573659)
22. Flagel SB, Clark JJ, Robinson TE, Mayo L, Czuj A, Willuhn I et al (2011). A selective role for dopamine in stimulus-reward learning. Nature 469: 53-57.
23. Fuchs R, Lasseter H, Ramirez D, Xie X (2008). Relapse to drug seeking following prolonged abstinence: the role of environmental stimuli. Drug Discov Today Dis Models 5: 251-258.
24. Gan JO, Walton ME, Phillips PE (2009). Dissociable cost and benefit encoding of future rewards by mesolimbic dopamine. Nat Neurosci 13: 25-27.
25. Glasner SV, Overmier JB, Balleine BW (2005). The role of Pavlovian cues in alcohol seeking in dependent and nondependent rats. J Stud Alcohol 66: 53-62.
26. Holland PC (2004). Relations between Pavlovian-instrumental transfer and reinforcer devaluation. J Exp Psychol Anim Behav Process 30: 104-117. (Pubitemid 38491959)
27. Horvitz JC, Ettenberg A (1988). Haloperidol blocks the responsereinstating effects of food reward: a methodology for separating neuroleptic effects on reinforcement and motor processes. Pharmacol Biochem Behav 31: 861-865. (Pubitemid 19274295)
28. Ikemoto S, Panksepp J (1999). The role of nucleus accumbens dopamine in motivated behavior: a unifying interpretation with special reference to reward-seeking. Brain Res Rev 31: 6-41. (Pubitemid 30009611)
29. Johnson AW, Bannerman D, Rawlins N, Sprengel R, Good MA (2007). Targeted deletion of the GluR-1 AMPA receptor in mice dissociates general and outcome-specific influences of appetitive rewards on learning. Behav Neurosci 121: 1192-1202.
30. Khroyan TV, Barrett-Larimore RL, Rowlett JK, Spealman RD (2000). Dopamine D1-and D2-like receptor mechanisms in relapse to cocaine-seeking behavior: effects of selective antagonists and agonists. J Pharmacol Exper Ther 294: 680-687. (Pubitemid 30490845)
31. Kruse JM, Overmier JB, Konz WA, Rokke E (1983). Pavlovian conditioned stimulus effects upon instrumental choice behavior are reinforcer specific. Learn Motiv 14: 165-181.
32. Leri F, Stewart J (2001). Drug-induced reinstatement to heroin and cocaine seeking: a rodent model of relapse in polydrug use. Exper Clin Psychopharmacol 9: 297-306. (Pubitemid 32762877)
33. Lex A, Hauber W (2008). Dopamine D1 and D2 receptors in the nucleus accumbens core and shell mediate Pavlovian-instrumental transfer. Learn Mem 15: 483-491. (Pubitemid 352008670)
34. McFarland K, Kalivas PW (2001). The circuitry mediating cocaineinduced reinstatement of drug-seeking behavior. J Neurosci 21: 8655-8663. (Pubitemid 33051463)
35. Murschall A, HauberW(2006). Inactivation of the ventral tegmental area abolished the general excitatory influence of Pavlovian cues on instrumental performance. Learn Mem 13: 123-126.
36. Ostlund SB, Balleine BW (2005). Lesions of medial prefrontal cortex disrupt the acquisition but not the expression of goaldirected learning. J Neurosci 25: 7763-7770. (Pubitemid 41208647)
37. Ostlund SB, Balleine BW (2007a). Selective reinstatement of instrumental performance depends on the discriminative stimulus properties of the mediating outcome. Learn Behav 35: 43-52. (Pubitemid 46854750)
38. Ostlund SB, Balleine BW (2007b). Orbitofrontal cortex mediates outcome encoding in Pavlovian but not instrumental conditioning. J Neurosci 27: 4819-4825. (Pubitemid 46699058)
39. Ostlund SB, Balleine BW (2008). Differential involvement of the basolateral amygdala and mediodorsal thalamus in instrumental action selection. J Neurosci 28: 4398-4405.
40. Ostlund SB, Wassum KM, Murphy NP, Balleine BW, Maidment NT (2011). Extracellular dopamine levels in striatal subregions track shifts in motivation and response cost during instrumental conditioning. J Neurosci 31: 200-207.
41. Ostlund SB, Winterbauer NE, Balleine BW (2008). Theory of reward systems. In: Byrne J (ed). Learning and Memory: A Comprehensive Reference. Elsevier: Oxford, 1, pp 701-720.
42. Reimold M, Solbach C, Noda S, Schaefer J-E, Bartels M, Beneke M et al (2007). Occupancy of dopamine D(1), D (2) and serotonin (2A) receptors in schizophrenic patients treated with flupentixol in comparison with risperidone and haloperidol. Psychopharmacology (Berl) 190: 241-249. (Pubitemid 46011184)
43. Rescorla RA (1994). Transfer of instrumental control mediated by a devalued outcome. Learn Behav 22: 27-33. (Pubitemid 24054216)
44. Rescorla RA (1997). Response-inhibition in extinction. Q J Exper Psychol 50B: 238-252.
45. Rescorla RA, Skucy JC (1969). Effect of response-independent reinforcers during extinction. J Compar Physiol Psychol 67: 381-389.
46. Rescorla RA, Solomon RL (1967). Two-process learning theory: relationships between Pavlovian conditioning and instrumental learning. Psychol Rev 74: 151-182.
47. Robbins TW, Everitt BJ (2007). A role for mesencephalic dopamine in activation: commentary on Berridge (2006). Psychopharmacology 191: 433-437. (Pubitemid 46355885)
48. Robinson TE, Berridge KC (1993). The neural basis of drug craving: an incentive-sensitization theory of addiction. Brain Res Rev 18: 247-291. (Pubitemid 23219500)
49. Salamone JD (1987). The actions of neuroleptic drugs on appetitive instrumental behaviors. In: Iverson LL, Iverson SD, Solomon SH (eds). Handbook of Psychopharmacology. Plenum: New York, pp 575-608.
50. Salamone JD, Correa M, Farrar A, Mingote SM (2007). Effortrelated functions of nucleus accumbens dopamine and associated forebrain circuits. Psychopharmacology 191: 461-482. (Pubitemid 46355902)
51. Schmidt HD, Anderson SM, Famous KR, Kumaresan V, Pierce RC (2005). Anatomy and pharmacology of cocaine priming-induced reinstatement of drug seeking. Eur J Pharmacol 526: 65-76. (Pubitemid 41744106)
52. Shiflett MW, Balleine BW (2010). At the limbic-motor Interface: disconnection of basolateral amygdala from nucleus accumbens core and shell reveals dissociable components of incentive motivation. Eur J Neurosci 32: 1735-1743.
53. Sun W, Rebec GV (2005). The role of prefrontal cortex D1-like and D2-like receptors in cocaine-seeking behavior in rats. Psychopharmacology (Berl) 177: 315-323. (Pubitemid 40137292)
54. Testa R, Abbiati G, Ceserani R, Restelll G, Vanasia A, Barone D et al (1989). Profile of in vitro binding affinities of neuroleptics at different rat brain receptors: cluster analysis comparison with pharmacological and clinical profiles. Pharm Res 6: 571-577. (Pubitemid 19214421)
55. Trapold MA, Overmier JB (1972). The second learning process in instrumental conditioning. In: Black AA, Prokasy WF (eds). Classical Conditioning II: Current Research and Theory. Appleton-Century-Crofts: New York, pp 427-452.
56. Walker K (1942). The effect of a discriminative stimulus transferred to a previously unassociated response. J Exper Psychol 31: 312-321.
57. Walton M, Kennerley S, Bannerman D, Phillips P, Rushworth M (2006). Weighing up the benefits of work: behavioral and neural analyses of effort-related decision making. Neural Netw 19: 1302-1314. (Pubitemid 44466342)
58. Wassum KM, Ostlund SB, Balleine BW, Maidment NT (2011). Differential dependence of Pavlovian and instrumental incentive learning processes on dopamine signaling. Learn Behav 18: 475-483.
59. Wickens JR, Horvitz JC, Costa RM, Killcross S (2007). Dopaminergic mechanisms in actions and habits. J Neurosci 27: 8181-8183. (Pubitemid 47219602)
60. Willner P, Chawla K, Sampson D, Sophokleous S, Muscat R (1988). Tests of functional equivalence between pimozide pretreatment, extinction and free feeding. Psychopharmacology 95: 423-426.
61. Wise RA (2006). Role of brain dopamine in food reward and reinforcement. Philos Trans Royal Soc 361B: 1149-1158. (Pubitemid 44874226)
62. Wyvell CL, Berridge KC (2000). Intra-accumbens amphetamine increases the conditioned incentive salience of sucrose reward: enhancement of reward "wanting" without enhanced "liking" or response reinforcement. J Neurosci 20: 8122-8130.
63. Yin HH, Ostlund SB, Balleine BW (2008). Reward-guided learning beyond dopamine in the nucleus accumbens: the integrative functions of cortico-basal ganglia networks. Eur J Neurosci 28: 1437-1448.
64. Zorawski M, Killcross S (2003). Glucocorticoid receptor agonist enhances Pavlovian appetitive conditioning but disrupts outcomespecific associations. Behav Neurosci 117: 1453-1457. (Pubitemid 37549446)