Modeling operant behavior in the Parkinsonian rat

Behavioural Brain Research

Volumn 198, Issue 2, 2009, Pages 298-305

  Avila, Irene ^a   Reilly, Mark P ^b   Sanabria, Federico ^a   Posadas Sánchez, Diana ^a   Chavez, Claudia L ^a   Banerjee, Nikhil ^a   Killeen, Peter ^a   Castañeda, Eddie ^a,c  

^a ARIZONA STATE UNIVERSITY   (United States)

^b CENTRAL MICHIGAN UNIVERSITY   (United States)

^c UNIVERSITY OF TEXAS AT EL PASO   (United States)

Author keywords

Dopamine; Fixed ratio schedule; Memory; Motivation; Motor; MPR; Operant behavior; Parkinson's disease

Indexed keywords

DOPAMINE; OXIDOPAMINE;

ANIMAL EXPERIMENT; ANIMAL MODEL; ARTICLE; AUTOPSY; BRAIN DAMAGE; CONTROLLED STUDY; DOPAMINERGIC ACTIVITY; INSTRUMENTAL CONDITIONING; LOCOMOTION; MALE; MOTIVATION; NEUROCHEMISTRY; NONHUMAN; PARKINSON DISEASE; PRIORITY JOURNAL; RAT; REINFORCEMENT; SUBSTANTIA NIGRA;

ANIMALS; CONDITIONING, OPERANT; DISEASE MODELS, ANIMAL; DOPAMINE; FOOD; MALE; MEMORY, SHORT-TERM; MICROINJECTIONS; MOTIVATION; MOTOR ACTIVITY; OXIDOPAMINE; PARKINSON DISEASE; RATS; RATS, SPRAGUE-DAWLEY; REINFORCEMENT (PSYCHOLOGY); REINFORCEMENT SCHEDULE; SUBSTANTIA NIGRA; SYMPATHOLYTICS; TIME FACTORS;

EID: 59749087719     PISSN: 01664328     EISSN: 18727549     Source Type: Journal    
DOI: 10.1016/j.bbr.2008.11.033     Document Type: Article

References (75)

1. Aberman J.E., and Salamone J.D. Nucleus accumbens dopamine depletions make rats more sensitive to high ratio requirements but do not impair primary food reinforcement. Neuroscience 92 (1999) 545-552
2. Aparicio C.F. Haloperidol, dynamics of choice, and the parameters of the matching law. Behav Proces 75 (2007) 206-212
3. Baldo B.A., and Kelley A.E. Discrete neurochemical coding of distinguishable motivational processes: insights from nucleus accumbens control of feeding. Psychopharmacol 191 (2007) 439-459
4. Baldo B.A., Sadeghian K., Basso A.M., and Kelley A.E. Effects of selective dopamine D1 or D2 receptor blockade within nucleus accumbens subregions on ingestive behavior and associated motor activity. Behav Brain Res 137 (2002) 165-177
5. Baum W.M. On two types of deviation from the matching law: bias and undermatching. J Exp Anal Behav 22 (1974) 231-242
6. Bizo L.A., Kettle L.C., and Killeen P.R. Rats don't always respond faster for more food: the paradoxical incentive effect. Anim Learn Behav 29 (2001) 66-78
7. Bizo L.A., and Killeen P.R. Models of ratio schedule performance. J Exp Psychol: Anim Behav Proces 23 (1997) 351-367
8. Brooks V.B. How does the limbic system assist motor learning? A limbic comparator hypothesis. Brain Behav Evol 29 (1986) 29-53
9. Brown P.L., and Jenkins H.M. Conditioned inhibition and excitation in operant discrimination learning. J Exp Psychol 75 (1967) 255-266
10. Brown P.L., and Jenkins H.M. Auto-shaping of the pigeon's key-peck. J Exp Analy Behav 11 (1968) 1-8
11. Burnham K.P., and Anderson D.R. Model selection and multimodel inference: a practical information-theoretic approach. 2nd ed. (2002), Springer-Verlag, New York pp. 488
12. Calaminus C., and Hauber W. Intact discrimination reversal learning but slowed responding to reward-predictive cues after dopamine D1 and D2 receptor blockade in the nucleus accumbens of rats. Psychopharmacol 3 (2007) 551-566
13. Cannon C.M., and Bseikri M.R. Is dopamine required for natural reward?. Physiol Behav 81 (2004) 741-748
14. Cannon C.M., and Palmiter R.D. Reward without dopamine. J Neurosci 23 (2003) 10827-10831
15. Castañeda E., Whishaw I.Q., and Robinson T.E. Changes in striatal dopamine neurotransmission assessed with microdialysis following recovery from a bilateral 6-OHDA lesion: variation as a function of lesion size. J Neurosci 10 (1990) 1847-1854
16. Da Cunha C., Angelucci M.E.M., Canteras N.S., Wonnacott S., and Takahashi R.N. The lesion of the rat substantia nigra pars compacta dopaminergic neurons as a model for Parkinson's disease memory disabilities. Cell Mol Neurobiol 22 (2002) 227-237
17. Da Cunha C., Wietzikoski S., Wietzikoski E.C., Miyoshi E., Ferro M.M., Anselmo-Franci J.A., et al. Evidence for the substantia nigra pars compacta as an essential component of a memory system independent of the hippocampal memory system. Neurobiol Learn Mem 79 (2003) 236-242
18. Fahn S. The history of Parkinsonism. Move Disord 4 (1989) S2-S10
19. Fahn S. Description of Parkinson's disease as a clinical syndrome. Ann NY Acad Sci 991 (2003) 1-14
20. Farrar A.M., Pereira M., Velasco F., Hockemeyer J., Muller C.E., and Salamone J.D. Adenosine A(2a) receptor antagonism reverses the effects of dopamine receptor antagonism on instrumental output and effort-related choice in the rat: implications for studies of psychomotor slowing. Psychopharmacol 191 (2007) 579-586
21. Hall S., and Schallert T. Striatal dopamine and the interface between orienting and ingestive functions. Physiol Behav 44 (1988) 469-471
22. Hamilton M.E., Mele A., and Pert A. Striatal extracellular dopamine in conscious vs. anesthetized rats: effects of chloral hydrate anesthetic on responses to drugs of different classes. Brain Res 597 (1992) 1-7
23. Heyser C.J., Fienberg A.A., Greengard P., and Gold L.H. DARPP-32 knockout mice exhibit impaired reversal learning in a discriminated operant task. Brain Res 867 (2000) 122-130
24. Hollerman J.R., and Schultz W. Dopamine neurons report an error in the temporal prediction of reward during learning. Nat Neurosci 1 (1998) 304-309
25. Ishiwari K., Weber S.M., Mingote S., Correa M., and Salamone J.D. Accumbens dopamine and the regulation of effort in food-seeking behavior: modulation of work output by different ratio or force requirement. Behav Brain Res 151 (2004) 83-91
26. Kelland M.D., Chiodo L.A., and Freeman A.S. Anesthetic influences on the basal activity and pharmacological responsiveness of nigrostriatal dopamine neurons. Synapse 6 (1990) 207-209
27. Kheramin S., Body S., Herrera F.M., Bradshaw C.M., Szabadi E., Deakin J.F., et al. The effect of orbital prefrontal cortex lesions on performance on a progressive ratio schedule: implications for models of inter-temporal choice. Behav Brain Res 156 (2005) 145-152
28. Killeen P.R. Mathematical principles of reinforcement. Behav Brain Sci 17 (1994) 105-172
29. Killeen P.R., and Sitomer M.T. MPR Behav Proces 62 (2003) 49-64
30. Kleen J.K., Sitomer M.T., Killeen P.R., and Conrad C.D. Chronic stress impairs spatial memory and motivation for reward without disrupting motor ability and motivation to explore. Behav Neurosci 120 (2006) 842-851
31. Koch M., Schmid A., and Schnitzler H.U. Role of nucleus accumbens dopamine D1 and D2 receptors in instrumental and Pavlovian paradigms of conditioned reward. Psychopharmacol 152 (2000) 67-73
32. Kolb B., and Whishaw I.Q. Fundamentals of human neurophysiology. 4th ed. (1996), W.H. Freeman and Company, New York p. 168
33. Lindner M.D., Plone M.A., Francis J.M., Blaney T.J., Salamone J.D., and Emerich D.F. Rats with partial striatal dopamine depletions exhibit robust and long-lasting behavioral deficits in a simple fixed-ratio bar-pressing task. Behav Brain Res 86 (1997) 25-40
34. Lundblad M., Andersson M., Winkler C., Kirik D., Wierup N., and Cenci M.A. Pharmacological validation of behavioural measures of akinesia and dyskinesia in a rat model of Parkinson's disease. Eur J Neurosci 15 (2002) 120-132
35. Martin-Iverson M.T., Wilkie D., and Fibiger H.C. Effects of haloperidol and d-amphetamine on perceived quantity of food and tones. Psychopharmacol 93 (1987) 374-381
36. McCullough L.D., and Salamone J.D. Involvement of nucleus accumbens dopamine in the motor activity induced by periodic food presentation: a microdialysis and behavioral study. Brain Res 592 (1992) 29-36
37. McFarland K., and Ettenberg A. Haloperidol differentially affects reinforcement and motivational processes in rats running an alley for intravenous heroin. Psychopharmacol 122 (1995) 346-350
38. Mingote S., Weber S.M., Ishiwari K., Correa M., and Salamone J.D. Ratio and time requirements on operant schedules: effort-related effects of nucleus accumbens dopamine depletions. Eur J Neurosci 21 (2005) 1749-1757
39. Mobini S., Chiang T.J., Ho M.Y., Bradshaw C.M., and Szabadi E. Comparison of the effects of clozapine, haloperidol, chlorpromazine, and d-amphetamine on performance on a time-constrained progressive ratio schedule and on locomotor behaviour in the rat. Psychopharmacol 152 (2000) 47-54
40. Nieoullon A., Coquerel A., and Dopamine:. A key regulator to adapt action, emotion, motivation and cognition. Curr Opin Neurol 16 (2003) S3-S9
41. Nishino H., Hattori S., Muramoto K., and Ono T. Basal ganglia neural activity during operant feeding behavior in the monkey: Relation to sensory integration and motor execution. Brain Res Bull 27 (1991) 463-468
42. Ono T., Nishijo H., and Nishino H. Functional role of the limbic system and basal ganglia in motivated behaviors. J Neurol 247 (2000) V23-32
43. Posadas-Sánchez, D., Evaluating models of motivation: role of reinforcer quality, lever force, and drug effects, Unpublished Dissertation, Arizona State University, Tempe; (2004).
44. Reilly M.P. Extending mathematical principles of reinforcement into the domain of behavioral pharmacology. Behav Proces 62 (2003) 75-88
45. Rescorla R.A., and Wagner A.R. A theory of Pavlovian conditioning: variations in the effectiveness of reinforcement and nonreinforcement. In: Black A.H., and Prokasy W.F. (Eds). Classical conditioning II: current research and theory (1972), Appleton Century Crofts, New York 64-99
46. Rick J.H., Horvitz J.C., and Balsam P.D. Dopamine receptor blockade and extinction differentially affect behavioral variability. Behav Neurosci 120 (2006) 488-492
47. Robinson S., Rainwater A., Hnasko T., and Palmiter R.D. Viral restoration of dopamine signaling to the dorsal striatum restores instrumental conditioning to dopamine-deficient mice. Psychopharmacol 191 (2007) 567-578
48. Roizen M.F., Kopin I.J., Zivin J., Muth E.A., and Jacobowitz D.M. The effect of two anesthetic agents on norepinephrine and dopamine in discrete brain nuclei, fiber tracts, and terminal regions of the rat. Brain Res 110 (1976) 515-522
49. Sakai K., and Gash D.M. Effect of bilateral 6-OHDA lesions of the substantia nigra on locomotor activity in the rat. Brain Res 633 (1994) 144-150
50. Salamone J.D., and Correa M. Motivational views of reinforcement: implications for understanding the behavioral functions of nucleus accumbens dopamine. Behav Brain Res 137 (2002) 3-25
51. Salamone J.D., Correa M., Farrar A., and Mingote S.M. Effort-related functions of nucleus accumbens dopamine and associated forebrain circuits. Psychopharmacol 191 (2007) 461-482
52. Salamone J.D., Cousins M.S., and Bucher S. Anhedonia or anergia? Effects of haloperidol and nucleus-accumbens dopamine depletion on instrumental response selection in a t-maze cost/benefit procedure. Behav Brain Res 65 (1994) 221-229
53. Salamone J.D., Cousins M.S., Maio C., Champion M., Turski T., and Kovach J. Different behavioral effects of haloperidol, clozapine, and thioridazine in a concurrent lever pressing and feeding procedure. Psychopharmacol 125 (1996) 105-112
54. Salamone J.D., Kurth P., McCullough L.D., and Sokolowski J.D. The effects of nucleus accumbens dopamine depletions on continuously reinforced operant responding: contrasts with the effects of extinction. Pharmacol Biochem Behav 50 (1995) 437-443
55. Salamone J.D., Kurth P., McCullough L.D., Sokolowski J.D., and Cousins M.S. The role of brain dopamine in response initiation: effects of haloperidol and regionally specific dopamine depletions on the local rate of instrumental responding. Brain Res 628 (1993) 218-226
56. Salamone J.D., Steinpreis R.E., McCullough L.D., Smith P., Grebel D., and Mahan K. Haloperidol and nucleus accumbens dopamine depletion suppress lever pressing for food but increase free food consumption in a novel food choice procedure. Psychopharmacol 104 (1991) 515-521
57. Salamone J.D., Wisniecki A., Carlson B.B., and Correa M. Nucleus accumbens dopamine depletions make animals highly sensitive to high fixed ratio requirements but do not impair primary food reinforcement. Neuroscience 105 (2001) 863-870
58. Sanabria F., Acosta J.I., Killeen P.R., Neisewander J.L., and Bizo L.A. Modeling the effects of fluoxetine on food-reinforced behavior. Behav Pharmacol 19 (2008) 61-70
59. Schallert T., and Hall S. 'Disengage' sensorimotor deficit following apparent recovery from unilateral dopamine depletion. Behav Brain Res 30 (1988) 15-24
60. Schallert T., Whishaw I.Q., Ramirez V.D., and Teitelbaum P. Compulsive, abnormal walking caused by anticholinergics in akinetic, 6-hydroxydopamine-treated rats. Science 199 (1978) 1461-1463
61. Schultz W. Getting formal with dopamine reward. Neuron 36 (2002) 241-263
62. Schwarting R.K., and Huston J.P. The unilateral 6-hydroxydopamine lesion model in behavioral brain research. Analysis of functional deficits, recovery and treatments. Prog Neurobiol 50 (1996) 275-331
63. Stephens D.W., and Krebs J.R. Foraging theory (1986), Princeton University Press, Princeton, NJ
64. Sutton R.S., and Barto A.G. Toward a modern theory of adaptive networks: expectation and prediction. Psychol Rev 88 (1981) 135-170
65. Tran-Nguyen L.T., Castañeda E., and MacBeth T. Changes in behavior and monoamine levels in microdialysate from dorsal striatum after 6-OHDA infusions into ventral striatum. Pharmacol Biochem Behav 55 (1996) 141-150
66. Waelti P., Dickinson A., and Schultz W. Dopamine responses comply with basic assumptions of formal learning theory. Nature 412 (2001) 43-48
67. White N.M., and McDonald R.J. Multiple parallel memory systems in the brain of the rat. Neurobiol Learn Mem 77 (2002) 125-184
68. Wise R.A. Dopamine, learning and motivation. Nat Rev Neurosci 5 (2004) 483-494
69. Wise R.A., and Schwartz H.V. Pimozide attenuates acquisition of lever-pressing for food in rats. Pharmacol Biochem Behav 15 (1981) 655-656
70. Wise R.A., Spindler J., deWit H., and Gerber G.J. Neuroleptic-induced "anhedonia" in rats: pimozide blocks reward quality of food. Science 201 (1978) 262-264
71. Zhang Z., Rickard J.F., Asgari K., Body S., Bradshaw C.M., and Szabadi E. Quantitative analysis of the effects of some "atypical" and "conventional" antipsychotics on progressive ratio schedule performance. Psychopharmacol 179 (2005) 489-497
72. Zhang Z., Rickard J.F., Body S., Asgari K., Bradshaw C.M., and Szabadi E. Comparison of the effects of clozapine and 8-hydroxy-2-(di-n-propylamino) tetralin (8-OH-DPAT) on progressive ratio schedule performance: Evidence against the involvement of 5-HT1A receptors in the behavioural effects of clozapine. Psychopharmacol 181 (2005) 381-391
73. Zigmond M.J., Acheson A.L., Stachowiak M.K., and Stricker E.M. Neurochemical compensation after nigrostriatal bundle injury in an animal model of preclinical Parkinsonism. Arch Neurol 41 (1984) 856-861
74. Zigmond M.J., and Stricker E.M. Deficits in feeding behavior after intraventricular injection of 6-hydroxydopamine in rats. Science 177 (1972) 1211-1214
75. Zigmond M.J., and Stricker E.M. Recovery of feeding and drinking by rats after intraventricular 6-hydroxydopamine or lateral hypothalamic lesions. Science 82 (1973) 717-720