Striatal dopamine D1 receptors are involved in the dissociation of learning based on reward-magnitude

Neuroscience

Volumn 230, Issue , 2013, Pages 132-138

  Rose, J ^a   Schiffer, A M ^a   Gunturkun O ^a  

^a RUHR UNIVERSITY BOCHUM   (Germany)

Author keywords

Behavioral contrast; GPe; GPi; MSt; Pigeon; Punishment; Reinforcement learning; Reward; SNr; SpL; TD

Indexed keywords

8 CHLORO 2,3,4,5 TETRAHYDRO 3 METHYL 5 PHENYL 1H 3 BENZAZEPIN 7 OL HYDROGEN MALEATE; DOPAMINE 1 RECEPTOR;

ANIMAL BEHAVIOR; ANIMAL EXPERIMENT; ARTICLE; COLUMBA LIVIA; CONTROLLED STUDY; CORPUS STRIATUM; DISCRIMINATION LEARNING; LEARNING; LEARNING CURVE; MENTAL DISSOCIATION; MENTAL TASK; NEGATIVE FEEDBACK; NEUROMODULATION; NONHUMAN; POSITIVE FEEDBACK; PRIORITY JOURNAL; PROTEIN FUNCTION; REINFORCEMENT; REWARD; TRAINING;

ANALYSIS OF VARIANCE; ANIMALS; BENZAZEPINES; CHOICE BEHAVIOR; COLUMBIDAE; CONDITIONING, OPERANT; CORPUS STRIATUM; DISCRIMINATION LEARNING; DOPAMINE ANTAGONISTS; RECEPTORS, DOPAMINE D1; REWARD;

EID: 84872321440     PISSN: 03064522     EISSN: 18737544     Source Type: Journal    
DOI: 10.1016/j.neuroscience.2012.10.064     Document Type: Article

References (48)

1. Barnetta A., Ahna H., Billarda W., Golda E.H., Kohli J.D., Glock D., Goldberg L.I. Relative activities of SCH 23390 and its analogs in three tests for D1/DA1 dopamine receptor antagonism. Eur J Pharmacol 1986, 128(3):249-253.
2. Bayer H.M., Glimcher P.W. Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron 2005, 47(1):129-141.
3. Berridge K.C. The debate over dopamine's role in reward: the case for incentive salience. Psychopharmacology 2007, 191(3):391-431.
4. Berridge K.C., Robinson T.E. What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?. Brain Res Brain Res Rev 1998, 28(3):309-369.
5. Black R.W. Shifts in magnitude of reward and contrast effects in instrumental and selective learning: a reinterpretation. Psychol Rev 1968, 75(2):114-126.
6. Calabresi P., Maj R., Pisani A., Mercuri N.B., Bernardi G. Long-term synaptic depression in the striatum: physiological and pharmacological characterization. J Neurosci 1992, 12(11):4224-4233.
7. Calabresi P., Saiardi A., Pisani A., Baik J.H., Centonze D., Mercuri N.B., Bernardi G., Borrelli E. Abnormal synaptic plasticity in the striatum of mice lacking dopamine D2 receptors. J Neurosci 1997, 17(12):4536-4544.
8. Clarke H.F., Robbins T.W., Roberts A.C. Lesions of the medial striatum in monkeys produce perseverative impairments during reversal learning similar to those produced by lesions of the orbitofrontal cortex. J Neurosci 2008, 28(43):10972-10982.
9. Collier G., Marx M.H. Changes in performance as a function of shifts in the magnitude of reinforcement. J Exp Psychol 1959, 57(5):305-309.
10. Crespi L.P. Quantitative variation of incentive and performance in the white rat. Am J Psychol 1942, 55(4):467-513.
11. Denny M.R., King G.F. Differential response learning on the basis of differential size of reward. J Genet Psychol 1955, 87(2):317-320.
12. Fiorillo C.D., Tobler P.N., Schultz W. Discrete coding of reward probability and uncertainty by dopamine neurons. Science 2003, 299(5614):1898-1902.
13. Frank M.J., O'Reilly R.C. A mechanistic account of striatal dopamine function in human cognition: psychopharmacological studies with cabergoline and haloperidol. Behav Neurosci 2006, 120(3):497-517.
14. Frank M.J., Seeberger L.C., O'Reilly R.C. By carrot or by stick: cognitive reinforcement learning in parkinsonism. Science 2004, 306(5703):1940-1943.
15. Freund N., Manns M., Rose J. A method for the evaluation of intracranial tetrodotoxin injections. J Neurosci Methods 2010, 186(1):25-28.
16. Güntürkün O. The convergent evolution of neural substrates for cognition. Psychol Res 2012, 76:212-219.
17. Graybiel A.M. The basal ganglia: learning new tricks and loving it. Curr Opin Neurobiol 2005, 15(6):638-644.
18. Guttman N. Operant conditioning, extinction, and periodic reinforcement in relation to concentration of sucrose used as reinforcing agent. J Exp Psychol 1953, 46(4):213-224.
19. Herold C., Diekamp B., Güntürkün O. Stimulation of dopamine D1 receptors in the avian fronto-striatal system adjusts daily cognitive fluctuations. Behav Brain Res 2008, 194:223-229.
20. Herold C., Joshi I., Hollmann M., Güntürkün O. Prolonged cognitive training increases D5 receptor expression in the avian prefrontal cortex. PLoS One 2012, 7(5):e36484.
21. Jiao Y., Medina L., Veenman C.L., Toledo C., Puelles L., Reiner A. Identification of the anterior nucleus of the ansa lenticularis in birds as the homolog of the mammalian subthalamic nucleus. J Neurosci 2000, 20:6998-7010.
22. Joshua M., Adler A., Mitelman R., Vaadia E., Bergman H. Midbrain dopaminergic neurons and striatal cholinergic interneurons encode the difference between reward and aversive events at different epochs of probabilistic classical conditioning trials. J Neurosci 2008, 28(45):11673-11684.
23. Kabai P., Stewart M.G., Tarcali J., Csillag A. Inhibiting effect of D1, but not D2 antagonist administered to the striatum on retention of passive avoidance in the chick. Neurobiol Learn Mem 2004, 81(2):155-158.
24. Karten H.W., Hodos W. A stereotaxic atlas of the brain of the pigeon (Columba livia) 1967, Johns Hopkins University Press, Baltimore.
25. Kerr J.N., Wickens J.R. Dopamine D-1/D-5 receptor activation is required for long-term potentiation in the rat neostriatum in vitro. J Neurophysiol 2001, 85(1):117-124.
26. Maher W.B., Wickens D.D. Effect of differential quantity of reward on acquisition and performance of a maze habit. J Comp Physiol Psychol 1954, 47(1):44-46.
27. Neuringer A.J. Effects of reinforcement magnitude on choice and rate of responding. J Exp Anal Behav 1967, 10:417-424.
28. Pan W.X., Schmidt R., Wickens J.R., Hyland B.I. Tripartite mechanism of extinction suggested by dopamine neuron activity and temporal difference model. J Neurosci 2008, 28(39):9619-9631.
29. Reiner A., Medina L., Veenman C.L. Structural and functional evolution of the basal ganglia in vertebrates. Brain Res Brain Res Rev 1998, 28:235-288.
30. Reiner A., Perkel D.J., Bruce L.L., Butler A.B., Csillag A., Kuenzel W., Paxinos G., Shimizu T., Striedter G., Wild M., Ball G.F., Durand S., Güntürkün O., Lee D.W., Mello C.V., Powers A., White S.A., Hough G., Kubikova L., Smulders T.V., Wada K., Dugas-Ford J., Husband S., Yamamoto K., Yu J., Siang C., Jarvis E.D. Revised nomenclature for avian telencephalon and some related brainstem nuclei. J Comp Neurol 2004, 473(3):377-414.
31. Reiner A., Yamamoto K., Karten H.J. Organization and evolution of the avian forebrain. Anat Rec A 2005, 287A:1080-1102.
32. Reynolds J.N., Hyland B.I., Wickens J.R. A cellular mechanism of reward-related learning. Nature 2001, 413(6851):67-70.
33. Rose J., Otto T., Dittrich L. The Biopsychology-Toolbox: a free, open-source Matlab-toolbox for the control of behavioral experiments. J Neurosci Methods 2008, 175(1):104-107.
34. Rose J., Schmidt R., Grabemann M., Güntürkün O. Theory meets pigeons: The influence of reward-magnitude on discrimination-learning. Behav Brain Res 2009, 198(1):125-129.
35. Rose J., Schiffer A.M., Dittrich L., Güntürkün O. The role of dopamine in maintenance and distractability of attention in the in the "prefrontal cortex" of pigeons. Neuroscience 2010, 167(2):232-237.
36. Schultz W. Getting formal with dopamine and reward. Neuron 2002, 36(2):241-263.
37. Schultz W. Behavioral dopamine signals. Trends Neurosci 2007, 30(5):203-210.
38. Schultz W., Apicella P., Scarnati E., Ljungberg T. Neuronal activity in monkey ventral striatum related to the expectation of reward. J Neurosci 1992, 12(12):4595-4610.
39. Schultz W., Dayan P., Montague P.R. A neural substrate of prediction and reward. Science 1997, 275(5306):1593-1599.
40. Sun Z., Wang H.B., Laverghetta A.V., Yamamoto K., Reiner A. The distribution and cellular localization of glutamatergic acid decarboxylase-65 (GAD65) mRNA in the forebrain and midbrain of the domestic chick. J Chem Neuroanat 2005, 29:265-291.
41. Sutton R.S., Barto A.G. Toward a modern theory of adaptive networks: expectation and prediction. Psychol Rev 1981, 88(2):135-170.
42. Tobler P.N., Fiorillo C.D., Schultz W. Adaptive coding of reward value by dopamine neurons. Science 2005, 307(5715):1642-1645.
43. Tsai H.C., Zhang F., Adamantidis A., Stuber G.D., Bonci A., de Lecea L., Deisseroth K. Phasic firing in dopaminergic neurons is sufficient for behavioral conditioning. Science 2009, 324(5930):1080-1084.
44. Veenman C.L., Reiner A. The distribution of GABA-containing perikarya, fibers, and terminals in the forebrain and midbrain of pigeons, with particular reference to the basal ganglia and its projection targets. J Comp Neurol 1994, 339:209-250.
45. Wang Z., Kai L., Day M., Ronesi J., Yin H.H., Ding J., Tkatch T., Lovinger D.M., Surmeier D.J. Dopaminergic control of corticostriatal long-term synaptic depression in medium spiny neurons is mediated by cholinergic interneurons. Neuron 2006, 50(3):443-452.
46. Watanabe S. Effects of lobus parolfactorius lesions on repeated acquisition of spatial discrimination in pigeons. Brain Behav Evol 2001, 58(6):333-342.
47. Wickens J. Striatal dopamine in motor activation and reward-mediated learning: steps towards a unifying model. J Neural Transm Gen Sect 1990, 80(1):9-31.
48. Wickens J.R., Horvitz J.C., Costa R.M., Killcross S. Dopaminergic mechanisms in actions and habits. J Neurosci 2007, 27(31):8181-8183.