A cAMP pathway underlying reward prediction in associative learning

Journal of Neuroscience

Volumn 28, Issue 44, 2008, Pages 11401-11408

  Kheirbek, Mazen A ^a   Beeler, Jeff A ^a   Ishikawa, Yoshihiro ^b   Zhuang, Xiaoxi ^a  

^a UNIVERSITY OF CHICAGO   (United States)

^b RUTGERS NEW JERSEY MEDICAL SCHOOL   (United States)

Author keywords

Adenylyl cyclase; Dopamine; Instrumental conditioning; Pavlovian conditioning; Reward prediction; Striatum

Indexed keywords

ADENYLATE CYCLASE; ADENYLATE CYCLASE 5; CYCLIC AMP; DOPAMINE; DOPAMINE 1 RECEPTOR; MITOGEN ACTIVATED PROTEIN KINASE; UNCLASSIFIED DRUG;

ANIMAL EXPERIMENT; APPETITIVE PAVLOVIAN CONDITIONING; ARTICLE; CONDITIONING; CONTROLLED STUDY; CORPUS STRIATUM; ENZYME ACTIVATION; GENE DELETION; INSTRUMENTAL CONDITIONING; MOUSE; NONHUMAN; NUCLEUS ACCUMBENS; PRIORITY JOURNAL; PROTEIN FUNCTION; REWARD; STATE DEPENDENT LEARNING; TASK PERFORMANCE; ANIMAL; C57BL MOUSE; COMPARATIVE STUDY; LEARNING; MOUSE MUTANT; PHYSIOLOGY; PREDICTION AND FORECASTING; SIGNAL TRANSDUCTION;

ANIMALS; ASSOCIATION LEARNING; CONDITIONING, OPERANT; CYCLIC AMP; MICE; MICE, INBRED C57BL; MICE, KNOCKOUT; PREDICTIVE VALUE OF TESTS; REWARD; SIGNAL TRANSDUCTION;

EID: 56149091090     PISSN: 02706474     EISSN: 02706474     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.4115-08.2008     Document Type: Article

References (43)

1. Baldwin AE, Sadeghian K, Holahan MR, Kelley AE (2002) Appetitive instrumental learning is impaired by inhibition of cAMP-dependent protein kinase within the nucleus accumbens. Neurobiol Learn Mem 77:44-62.
2. Beaulieu JM, Sotnikova TD, Marion S, Lefkowitz RJ, Gainetdinov RR, Caron MG (2005) An Akt/beta-arrestin 2/PP2A signaling complex mediates dopaminergic neurotransmission and behavior. Cell 122:261-273.
3. Belin D, Mar AC, Dalley JW, Robbins TW, Everitt BJ (2008) High impulsivity predicts the switch to compulsive cocaine-taking. Science 320:1352-1355.
4. Berridge KC (2007) The debate over dopamine's role in reward: the case for incentive salience. Psychopharmacology (Berl) 191:391-431.
5. Calabresi P, Maj R, Mercuri NB, Bernardi G (1992) Coactivation of D1 and D2 dopamine receptors is required for long-term synaptic depression in the striatum. Neurosci Lett 142:95-99.
6. Calabresi P, Picconi B, Tozzi A, Di Filippo M (2007) Dopamine-mediated regulation of corticostriatal synaptic plasticity. Trends Neurosci 30:211-219.
7. 2+-sensitive adenylyl cyclases. Adv Second Messenger Phosphoprotein Res 32:23-51.
8. Corbit LH, Muir JL, Balleine BW (2001) The role of the nucleus accumbens in instrumental conditioning: evidence of a functional dissociation between accumbens core and shell. J Neurosci 21:3251-3260.
9. Dalley JW, Chudasama Y, Theobald DE, Pettifer CL, Fletcher CM, Robbins TW (2002) Nucleus accumbens dopamine and discriminated approach learning: interactive effects of 6-hydroxydopamine lesions and systemic apomorphine administration. Psychopharmacology (Berl) 161:425-433.
10. Day JJ, Roitman MF, Wightman RM, Carelli RM (2007) Associative learning mediates dynamic shifts in dopamine signaling in the nucleus accumbens. Nat Neurosci 10:1020-1028.
11. Di Ciano P, Cardinal RN, Cowell RA, Little SJ, Everitt BJ (2001) Differential involvement of NMDA, AMPA/kainate, and dopamine receptors in the nucleus accumbens core in the acquisition and performance of pavlovian approach behavior. J Neurosci 21:9471-9477.
12. Dickinson A, Balleine BW (2002) The role of learning in the operation of motivational systems. In: Steven's handbook of experimental psychology, Ed 3 (Pashler HE, ed). New York: Wiley.
13. 2 receptors in appetitive conditioning. J Neurosci 23:1584-1587.
14. 1 dopamine receptor supersensitivity in the dopamine-depleted striatum results from a switch in the regulation of ERK1/2/MAP kinase. J Neurosci 22:5042-5054.
15. Guillou JL, Nakata H, Cooper DM (1999) Inhibition by calcium of mammalian adenylyl cyclases. J Biol Chem 274:35539-35545.
16. Hall G (2002) Associative structures in pavlovian and instrumental conditioning. In: Steven's handbook of experimental psychology, Ed 3 (Pashler HE, ed). New York: Wiley.
17. Hanoune J, Defer N (2001) Regulation and role of adenylyl cyclase isoforms. Annu Rev Pharmacol Toxicol 41:145-174.
18. Iwami G, Kawabe J, Ebina T, Cannon PJ, Homcy CJ, Ishikawa Y (1995) Regulation of adenylyl cyclase by protein kinase A. J Biol Chem 270:12481-12484.
19. Iwamoto T, Okumura S, Iwatsubo K, Kawabe J, Ohtsu K, Sakai I, Hashimoto Y, Izumitani A, Sango K, Ajiki K, Toya Y, Umemura S, Goshima Y, Arai N, Vatner SF, Ishikawa Y (2003) Motor dysfunction in type 5 adenylyl cyclase-null mice. J Biol Chem 278:16936-16940.
20. Kandel ER (2001) The molecular biology of memory storage: a dialogue between genes and synapses. Science 294:1030-1038.
21. Kelley AE (2004) Ventral striatal control of appetitive motivation: role in ingestive behavior and reward-related learning. Neurosci Biobehav Rev 27:765-776.
22. Kreitzer AC, Malenka RC (2007) Endocannabinoid-mediated rescue of striatal LTD and motor deficits in Parkinson's disease models. Nature 445:643-647.
23. LeDoux JE (2000) Emotion circuits in the brain. Annu Rev Neurosci 23:155-184.
24. Matsuoka I, Suzuki Y, Defer N, Nakanishi H, Hanoune J (1997) Differential expression of type I, II, and V adenylyl cyclase gene in the postnatal developing rat brain. J Neurochem 68:498-506.
25. Nicol X, Muzerelle A, Bachy I, Ravary A, Gaspar P (2005) Spatiotemporal localization of the calcium-stimulated adenylate cyclases, AC1 and AC8, during mouse brain development. J Comp Neurol 486:281-294.
26. Paxinos G, Franklin KBJ (2001) The mouse brain in steroetaxic coordinates, Ed 2. San Diego: Academic.
27. Reynolds JN, Wickens JR (2002) Dopamine-dependent plasticity of corticostriatal synapses. Neural Netw 15:507-521.
28. Reynolds JN, Hyland BI, Wickens JR (2001) A cellular mechanism of reward-related learning. Nature 413:67-70.
29. Robinson S, Sandstrom SM, Denenberg VH, Palmiter RD (2005) Distinguishing whether dopamine regulates liking, wanting, and/or learning about rewards. Behav Neurosci 119:5-15.
30. Schultz W (1998) Predictive reward signal of dopamine neurons. J Neurophysiol 80:1-27.
31. Schultz W (2002) Getting formal with dopamine and reward. Neuron 36:241-263.
32. Schultz W (2006) Behavioral theories and the neurophysiology of reward. Annu Rev Psychol 57:87-115.
33. Schultz W, Dayan P, Montague PR (1997) A neural substrate of prediction and reward. Science 275:1593-1599.
34. Self DW, Genova LM, Hope BT, Barnhart WJ, Spencer JJ, Nestler EJ (1998) Involvement of cAMP-dependent protein kinase in the nucleus accumbens in cocaine self-administration and relapse of cocaine-seeking behavior. J Neurosci 18:1848-1859.
35. Shiflett MW, Martini RP, Mauna JC, Foster RL, Peet E, Thiels E (2008) Cue-elicited reward-seeking requires extracellular signal-regulated kinase activation in the nucleus accumbens. J Neurosci 28:1434-1443.
36. Valjent E, Pascoli V, Svenningsson P, Paul S, Enslen H, Corvol JC, Stipanovich A, Caboche J, Lombroso PJ, Nairn AC, Greengard P, Hervé D, Girault JA (2005) Regulation of a protein phosphatase cascade allows convergent dopamine and glutamate signals to activate ERK in the striatum. Proc Natl Acad Sci U S A 102:491-496.
37. Wang H, Storm DR (2003) Calmodulin-regulated adenylyl cyclases: cross-talk and plasticity in the central nervous system. Mol Pharmacol 63:463-468.
38. Wickens JR, Begg AJ, Arbuthnott GW (1996) Dopamine reverses the depression of rat corticostriatal synapses which normally follows high-frequency stimulation of cortex in vitro. Neuroscience 70:1-5.
39. Wickens JR, Reynolds JN, Hyland BI (2003) Neural mechanisms of reward-related motor learning. Curr Opin Neurobiol 13:685-690.
40. Wong ST, Athos J, Figueroa XA, Pineda VV, Schaefer ML, Chavkin CC, Muglia LJ, Storm DR (1999) Calcium-stimulated adenylyl cyclase activity is critical for hippocampus-dependent long-term memory and late phase LTP. Neuron 23:787-798.
41. Wu ZL, Thomas SA, Villacres EC, Xia Z, Simmons ML, Chavkin C, Palmiter RD, Storm DR (1995) Altered behavior and long-term potentiation in type I adenylyl cyclase mutant mice. Proc Natl Acad Sci U S A 92:220-224.
42. Yin HH, Knowlton BJ (2006) The role of the basal ganglia in habit formation. Nat Rev Neurosci 7:464-476.
43. Yin HH, Ostlund SB, Knowlton BJ, Balleine BW (2005) The role of the dorsomedial striatum in instrumental conditioning. Eur J Neurosci 22:513-523.