The Reinforcement Mountain: Allocation of Behavior as a Function of the Rate and Intensity of Rewarding Brain Stimulation

Behavioral Neuroscience

Volumn 122, Issue 5, 2008, Pages 1126-1138

  Arvanitogiannis, Andreas ^a   Shizgal, Peter ^a  

^a and Applied Physiology   (Canada)

Author keywords

brain stimulation reward; medial forebrain bundle; rate of reinforcement; self stimulation; single operant matching law

Indexed keywords

ARTICLE; BEHAVIOR; BRAIN DEPTH STIMULATION; INSTRUMENTAL CONDITIONING; PREDICTION; REINFORCEMENT; REWARD; TASK PERFORMANCE; THEORETICAL MODEL; VALIDITY;

ANIMALS; BEHAVIOR, ANIMAL; BRAIN; CONDITIONING, OPERANT; DOSE-RESPONSE RELATIONSHIP, RADIATION; ELECTRIC STIMULATION; MALE; MODELS, PSYCHOLOGICAL; RATS; RATS, LONG-EVANS; REINFORCEMENT (PSYCHOLOGY); REINFORCEMENT SCHEDULE; SELF STIMULATION; TIME FACTORS;

EID: 54049094888     PISSN: 07357044     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0012679     Document Type: Article

References (37)

1. Arvanitogiannis A., Waraczynski M., and Shizgal P. Effects of excitotoxic lesions of the basal forebrain on MFB self-stimulation. Physiology and Behavior 59 (1996) 795-806
2. Carr K.D., and Wolinsky T.D. Chronic food restriction and weight loss produce opioid facilitation of perifornical hypothalamic self-stimulation. Brain Research 607 (1993) 141-148
3. Edmonds D.E., and Gallistel C.R. Parametric analysis of brain stimulation reward in the rat: III. Effect of performance variables on the reward summation function. Journal of Comparative and Physiological Psychology 87 (1974) 876-883
4. Forgie M.L., and Shizgal P. Mapping the substrate for brain stimulation reward by means of current- number trade-off functions. Behavioral Neuroscience 107 (1993) 506-524
5. Fouriezos G., Bielajew C., and Pagotto W. Task difficulty increases thresholds of rewarding brain stimulation. Behavioural Brain Research 37 (1990) 1-7
6. Fouriezos G., Hansson P., and Wise R.A. Neuroleptic-induced attenuation of brain stimulation reward in rats. Journal of Comparative and Physiological Psychology 92 (1978) 661-671
7. Frank R.A., and Williams H.P. Both response effort and current intensity affect self-stimulation train duration thresholds. Pharmacology Biochemistry and Behavior 22 (1985) 527-530
8. Franklin K.B.J. Catecholamines and self-stimulation: Reward and performance effects dissociated. Pharmacology, Biochemistry & Behavior 9 (1978) 813-820
9. Fulton S., Woodside B., and Shizgal P. Potentiation of brain stimulation reward by weight loss: Evidence for functional heterogeneity in brain reward circuitry. Behavioural Brain Research 174 (2006) 56-63
10. Gallistel C.R. Self-stimulation in the rat: Quantitative characteristics of the reward pathway. Journal of Comparative and Physiological Psychology 92 (1978) 977-998
11. Gallistel C.R., and Karras D. Pimozide and amphetamine have opposing effects on the reward summation function. Pharmacology Biochemistry and Behavior 20 (1984) 73-77
12. Gallistel C.R., and Leon M. Measuring the subjective magnitude of brain stimulation reward by titration with rate of reward. Behavioral Neuroscience 105 (1991) 913-925
13. Gallistel C.R., Shizgal P., and Yeomans J.S. A portrait of the substrate for self-stimulation. Psychological Review 88 (1981) 228-273
14. Hamilton A.L., Stellar J.R., and Hart E.B. Reward, performance, and the response strength method in self-stimulating rats: Validation and neuroleptics. Physiology & Behavior 35 (1985) 897-904
15. Hernandez, G. A., Breton, Y-A., & Shizgal, P. At what stage of processing does cocaine influence performance for brain stimulation reward? Program No. 843.2. 2007 Abstract Viewer/Itinerary Planner. San Diego, CA: Society for Neuroscience. 2007. Online.
16. Herrnstein R.J. On the law of effect. Journal of the Experimental Analysis of Behavior 13 (1970) 243-266
17. Herrnstein R.J. Formal properties of the matching law. Journal of the Experimental Analysis of Behavior 21 (1974) 159-164
18. Hodos W., and Valenstein E.S. An evaluation of response rate as a measure of rewarding intracranial stimulation. Journal of Comparative and Physiological Psychology 55 (1962) 80-84
19. Mark T.A., and Gallistel C.R. Subjective reward magnitude of medial forebrain stimulation as a function of train duration and pulse frequency. Behavioral Neuroscience 107 (1993) 389-401
20. Miliaressis E., Rompré P.P., Laviolette P., Philippe L., and Coulombe D. The curve-shift paradigm in self-stimulation. Physiology and Behavior 37 (1986) 85-91
21. Neuringer A.J. Effects of reinforcement magnitude on choice and rate of responding. Journal of the Experimental Analysis of Behavior 10 (1967) 417-424
22. Olds J. Hypothalamic substrates of reward. Physiological Reviews 42 (1962) 554-604
23. Olds J., and Milner P.M. Positive reinforcement produced by electrical stimulation of septal area and other regions of rat brain. Journal of Comparative and Physiological Psychology 47 (1954) 419-427
24. Olds M.E., and Olds J. Approach-avoidance analysis of rat diencephalon. Journal of Comparative Neurology 120 (1963) 259-295
25. e parameter in Herrnstein's equation. Behavioural Processes 39 (1997) 39-52
26. Rachlin H. Judgment, decision, and choice (1989), Freeman, New York
27. Salamone J.D. Functional significance of nucleus accumbens dopamine: Behavior, pharmacology and neurochemistry. Behavioural Brain Research 137 (2002) 1
28. Salamone J.D., Correa M., Mingote S., and Weber S.M. Nucleus accumbens dopamine and the regulation of effort in food-seeking behavior: Implications for studies of natural motivation, psychiatry, and drug abuse. Journal of Pharmacology and Experimental Therapeutics 305 (2003) 1-8
29. Salamone J.D., Wisniecki A., Carlson B.B., and Correa M. Nucleus accumbens dopamine depletions make animals highly sensitive to high fixed ratio requirements but do not impair primary food reinforcement. Neuroscience 105 (2001) 863-870
30. Shizgal P., Fulton S., and Woodside B. Brain reward circuitry and the regulation of energy balance. International Journal of Obesity and Related Metabolic Disorders 25 Suppl 5 (2001) S17-21
31. Simmons J.M., Ackermann R.F., and Gallistel C.R. Medial forebrain bundle lesions fail to structurally and functionally disconnect the ventral tegmental area from many ipsilateral forebrain nuclei: Implications for the neural substrate of brain stimulation reward. Journal of Neuroscience 18 (1998) 8515-8533
32. Simmons J.M., and Gallistel C.R. Saturation of subjective reward magnitude as a function of current and pulse frequency. Behavioral Neuroscience 108 (1994) 151-160
33. Sonnenschein B., Conover K., and Shizgal P. Growth of brain stimulation reward as a function of duration and stimulation strength. Behavioral Neuroscience 117 (2003) 978-994
34. Waraczynski M.A. Basal forebrain knife cuts and medial forebrain bundle self-stimulation. Brain Research 438 (1988) 8-22
35. Wise R.A. Action of drugs of abuse on brain reward systems. Pharmacology, Biochemistry and Behavior 13 Suppl 1 (1980) 213-223
36. Wise R.A., and Rompré P.-P. Brain dopamine and reward. Annual Review of Psychology 40 (1989) 191-225
37. Yanovski J.A., Adler N.T., and Gallistel C.R. Does the perception of reward magnitude of self-administered electrical brain stimulation have a circadian rhythm?. Behavioral Neuroscience 100 (1986) 888-893