Effect of reinforcer magnitude on performance maintained by progressive-ratio schedules

Journal of the Experimental Analysis of Behavior

Volumn 91, Issue 1, 2009, Pages 75-87

  Rickard, J F ^a   Body, S ^a   Zhang, Z ^a   Bradshaw, C M ^a   Szabadi, E ^a  

^a UNIVERSITY OF NOTTINGHAM   (United Kingdom)

Author keywords

Lever press; Mathematical Principles of Reinforcement (MPR); Progressive ratio schedule; Rat; Reinforcer magnitude

Indexed keywords

ANIMAL; ARTICLE; FEMALE; INSTRUMENTAL CONDITIONING; RAT; REINFORCEMENT; WISTAR RAT;

ANIMALS; CONDITIONING, OPERANT; FEMALE; RATS; RATS, WISTAR; REINFORCEMENT (PSYCHOLOGY); REINFORCEMENT SCHEDULE;

EID: 64849092817     PISSN: 00225002     EISSN: None     Source Type: Journal    
DOI: 10.1901/jeab.2009.91-75     Document Type: Article

References (51)

1. Aberman, J. E., Ward, S. J., & Salamone, J. D. (1998). Effects of dopamine antagonists and accumbens dopamine depletions on time-constrained progressive-ratio performance. Pharmacology, Biochemistry & Behavior, 61, 341-348.
2. Ainslie, G. W. (1975). Specious reward: a behavioral theory of impulsiveness and impulse control. Psychological Bulletin, 82, 463-492.
3. Arnold, J., & Roberts, D. C. S. (1997). A critique of fixed and progressive ratio schedules used to examine the neural substrates of drug reinforcement. Pharmacology, Biochemistry & Behavior, 57, 441-447.
4. Baron, A., & Derenne, A. (2000). Progressive ratio schedules: effects of later schedule requirements on earlier performances. Journal of the Experimental Analysis of Behavior, 73, 291-304.
5. Baron, A., Mikorski, J., & Schlund, M. (1992). Reinforcement magnitude and pausing on progressive-ratio schedules. Journal of the Experimental Analysis of Behavior, 58, 377-388.
6. Barr, A. M., & Philips, A. G. (1999). Withdrawal following repeated exposure to d-amphetamine decreases responding for a sucrose solution as measured by a progressive ratio schedule of reinforcement. Psychopharmacology, 141, 99-106.
7. Baum, W. M. (1974). On two types of deviation from the matching law: Bias and undermatching. Journal of the Experimental Analysis of Behavior, 22, 231-242.
8. Bezzina, G., Cheung, T. H. C., Asgari, K., Hampson, C. L., Body, S., Bradshaw, C. M., et al. (2007). Effects of quinolinic acid-induced lesions of the nucleus accumbens core on inter-temporal choice: A quantitative analysis. Psychopharmacology, 195, 71-84.
9. Bezzina, G., Body, S., Cheung, T. H. C., Hampson, C. L., Deakin, J. F. W., Anderson, I. M., et al. (2008). Effect of quinolinic acid-induced lesions of the nucleus accumbens core on performance on a progressive ratio schedule of reinforcement: Implications for intertemporal choice. Psychopharmacology, 197, 339-350.
10. Bizo, L. A., & Killeen, P. R. (1997). Models of ratio schedule performance. Journal of Experimental Psychology: Animal Behavior Processes, 23, 351-367.
11. Bizo, L. A., Kettle, L. C., & Killeen, P. R. (2001). Rats don't always respond faster for more food: the paradoxical incentive effect. Animal Learning & Behavior, 29, 66-78.
12. Bowman, E. M., & Brown, V. J. (1998). Effects of excitotoxic lesions of the rat ventral striatum on the perception of reward cost. Experimental Brain Research, 123, 439-448.
13. Bradshaw, C. M., & Szabadi, E. (1989). Central neurotransmitter systems and the control of operant behaviour by 'natural' positive reinforcers. In Liebman, J. M., & Cooper, S. J. (Eds.), The neuropharmacological basis of reward (pp. 320-376). Oxford: Oxford University Press.
14. Cheeta, S., Brooks, S., & Willner, P. (1995). Effects of reinforcer sweetness and the D2/D3 antagonist raclopride on progressive ratio operant responding. Behavioural Pharmacology, 6, 127-132.
15. Davison, M. C., & McCarthy, D. (1988). The matching law: A research review. Hillsdale: Erlbaum.
16. de Villiers, P. A., & Herrnstein, R. J. (1976). Toward a law of response strength. Psychological Bulletin, 83, 1131-1153.
17. Ferguson, S. A., & Paule, M. G. (1997). Progressive ratio performance varies with body weight in rats. Behavioural Processes, 40, 177-182.
18. Hamill, S., Trevitt, J. T., Nowend, K. L., Carlson, B. B., & Salamone, J. D. (1999). Nucleus accumbens dopamine depletion and time-constrained progressive ratio performance: effects of different ratio requirements. Pharmacology, Biochemistry & Behavior, 64, 21-27.
19. Herrnstein, R. J. (1961). Relative and absolute strength of response as a function of frequency of reinforcement. Journal of the Experimental Analysis of Behavior, 4, 267-272.
20. Herrnstein, R. J. (1970). On the law of effect. Journal of the Experimental Analysis of Behavior, 13, 243-266.
21. Heyman, G. M., & Monaghan, M. M. (1987). Effects of changes in response requirement and deprivation on the parameters of the matching law equation: New data and review. Journal of Experimental Psychology: Animal Behavior Processes, 13, 384-394.
22. Heyman, G. M., & Monaghan, M. M. (1994). Reinforcer magnitude (sucrose concentration) and the matching law theory of response strength. Journal of the Experimental Analysis of Behavior, 61, 505-516.
23. Ho, M.-Y., Body, S., Kheramin, S., Bradshaw, C. M., & Szabadi, E. (2003). Effects of 8-OH-DPAT and WAY-100635 on performance on a time-constrained progressive-ratio schedule. Psychopharmacology, 167, 137-144.
24. Ho, M.-Y., Mobini, S., Chiang, T.-J., Bradshaw, C. M., & Szabadi, E. (1999). Theory and method in the quantitative analysis of "impulsive choice"behaviour: Implications for psychopharmacology. Psychopharmacology, 146, 362-372.
25. Hodos, W. (1961). Progressive ratio as a measure of reward strength. Science, 134, 943-944.
26. Hodos, W., & Kalman, G. (1963). Effects of increment size and reinforcer volume on progressive ratio performance. Journal of the Experimental Analysis of Behavior, 6, 389-392.
27. Keesey, R. E., & Goldstein, M. D. (1968). Use of progressive fixed-ratio procedures in the assessment of intracranial reinforcement. Journal of the Experimental Analysis of Behavior, 11, 293-301.
28. Kheramin, S., Body, S., Miranda Herrera, F., Bradshaw, C. M., Szabadi, E., Deakin, J. F. W., et al. (2005). The effect of orbital prefrontal cortex lesions on performance on a progressive ratio schedule: Implications for models of inter-temporal choice. Behavioural Brain Research, 156, 145-152.
29. Kheramin, S., Body, S., Mobini, S., Ho, M.-Y., Velazquez-Martinez, D. N., Bradshaw, C. M., et al. (2002). Effects of quinolinic acid-induced lesions of the orbital prefrontal cortex on inter-temporal choice: A quantitative analysis. Psychopharmacology, 165, 9-17.
30. Killeen, P. R. (1982). Incentive theory. In D. J. Bernstein (Ed.), Nebraska symposium on motivation, 1981: response structure and organization (pp. 161-216). Lincoln: University of Nebraska Press.
31. Killeen, P. R. (1985). Incentive theory IV: Magnitude of reward. Journal of the Experimental Analysis of Behavior, 43, 407-417.
32. Killeen, P. R. (1994). Mathematical principles of reinforcement. Behavioral Brain Science, 17, 105-172.
33. Killeen, P. R. (1998). The first principle of reinforcement. In C. D. L. Wynne, & J. E. R. Staddon (Eds.), Models of action: mechanisms for adaptive behavior (pp. 221-431). Mahwah: Erlbaum.
34. Killeen, P. R., & Sitomer, M. T. (2003). MPR. Behavioural Processes, 62, 49-64.
35. Killeen, P. R., Posadas-Sanchez, D., Johansen, E. B., & Thrailkill, E. A. (in press). Progressive ratio schedules of reinforcement. Journal of Experimental Psychology: Animal Behavior Processes.
36. Mazur, J. E. (1983). Steady-state performance on fixed-, mixed-, and random-ratio schedules. Journal of the Experimental Analysis of Behavior, 39, 293-307.
37. Mazur, J. E. (1987). An adjusting procedure for studying delayed reinforcement. In M. L. Commons, J. E. Mazur, J. A. Nevin, & H. C. Rachlin (Eds.), Quantitative analyses of behavior: vol. 5, The effect of delay and intervening events on reinforcement value (pp. 55-73). Hillsdale: Erlbaum.
38. Mazur, J. E. (2006). Mathematical models and the experimental analysis of behavior. Journal of the Experimental Analysis of Behavior, 85, 285-291.
39. Mobini, S., Chiang, T.-J., Ho, M.-Y., Bradshaw, C. M., & Szabadi, E. (2000). Comparison of the effects of clozapine, haloperidol, chlorpromazine and d-amphetamine on performance on a time-constrained progressive-ratio schedule and locomotor behaviour in the rat. Psychopharmacology, 152, 47-54.
40. Reilly, M. P. (2003). Extending mathematical principles of reinforcement into the domain of behavioral pharmacology. Behavioural Processes, 62, 75-88.
41. Roberts, D. C. S., & Richardson, N. R. (1992). Selfadministration of psychomotor stimulants using progressive ratio schedules of reinforcement. In A. Boulton, G. Baker, & P. H. Wu (Eds.), Neuromethods. (Vol 24., pp. 223-269). Totowa: Humana.
42. Rowlett, J. K. (2000). A labor-supply analysis of cocaine self-administration under progressive ratio schedules: antecedents, methodologies, and perspectives. Psychopharmacology, 153, 1-16.
43. Sclafani, A., & Ackroff, K. (2003). Reinforcement value of sucrose measured by progressive ratio operant licking in the rat. Physiology & Behaviour, 79, 663-670.
44. Shizgal, P. (1997). Neural basis of utility estimation. Current Opinion in Neurobiology, 7, 198-208.
45. Skjoldager, P., Pierre, P. J., & Mittleman, G. (1993). Reinforcer magnitude and progressive ratio responding in the rat: Effects of increased effort, prefeeding, and extinction. Learning & Motivation, 24, 303-343.
46. Stafford, D., & Branch, M. N. (1998). Effects of step size and break-point criterion on progressive-ratio performance. Journal of the Experimental Analysis of Behavior, 70, 123-138.
47. Stellar, J. R., & Rice, M. B. (1989). Pharmacological basis of intracranial self-stimulation reward. In Liebman, J. M., & Cooper, S. J. (Eds.), The neuropharmacological basis of reward (pp. 14-65). Oxford: Oxford University Press.
48. Vaughan, W. (1985). Choice: a local analysis. Journal of the Experimental Analysis of Behavior, 43, 383-405.
49. Weatherley, J. N., King, B. M., & Uran, E. L. (2003). Upcoming food-pellet reinforcement alters rats' lever pressing for liquid sucrose delivered by a progressive schedule. Behavioural Processes, 63, 73-86.
50. Zhang, Z., Rickard, J. F., Asgari, K., Body, S., Bradshaw, C. M., & Szabadi, E. (2005a). Quantitative analysis of the effects of some "atypical"and "conventional"antipsychotics on progressive ratio schedule performance. Psychopharmacology, 179, 489-497.
51. Zhang, Z., Rickard, J. F., Asgari, K., Body, S., Bradshaw, C. M., & Szabadi, E. (2005b). Comparison of the effects of clozapine and 8-hydroxy-2-(di-n-propylamino)tetralin (8-OH-DPAT) on progressive ratio schedule performance: Evidence against the involvement of 5-HT1A receptors in the behavioural effects of clozapine. Psychopharmacology, 181, 381-391.