A theory of behaviour on progressive ratio schedules, with applications in behavioural pharmacology

Psychopharmacology

Volumn 222, Issue 4, 2012, Pages 549-564

  Bradshaw, C M ^a   Killeen, P R ^b  

^a UNIVERSITY OF NOTTINGHAM   (United Kingdom)

^b ARIZONA STATE UNIVERSITY   (United States)

Author keywords

Antipsychotics; Hysteresis; Lesion; Linear waiting; Mathematical model; Mathematical principles of reinforcement; Nucleus accumbens core; Orexinergic neurones; Progressive ratio schedule; Reinforcer magnitude

Indexed keywords

CLOZAPINE; CYPROHEPTADINE; DOPAMINE 2 RECEPTOR; HALOPERIDOL; HISTAMINE H1 RECEPTOR; NEUROLEPTIC AGENT; OREXIN A; OREXIN B; SEROTONIN 2A RECEPTOR;

BEHAVIOR; EXTRAPYRAMIDAL SYMPTOM; HUMAN; HYPERPHAGIA; HYSTERESIS; LATERAL HYPOTHALAMUS; MATHEMATICAL MODEL; NONHUMAN; NUCLEUS ACCUMBENS; PRIORITY JOURNAL; PROGRESSIVE RATIO SCHEDULE; REINFORCEMENT; RESPONSE TIME; REVIEW; SEDATION; SIDE EFFECT; STIMULUS RESPONSE; TASK PERFORMANCE; WEIGHT GAIN;

ANIMALS; ANTIPSYCHOTIC AGENTS; CONDITIONING, OPERANT; HYPOTHALAMIC AREA, LATERAL; INTRACELLULAR SIGNALING PEPTIDES AND PROTEINS; MODELS, PSYCHOLOGICAL; NEUROPEPTIDES; NUCLEUS ACCUMBENS; PSYCHOLOGICAL THEORY; PSYCHOPHARMACOLOGY; REINFORCEMENT (PSYCHOLOGY); REINFORCEMENT SCHEDULE;

EID: 84864490456     PISSN: 00333158     EISSN: 14322072     Source Type: Journal    
DOI: 10.1007/s00213-012-2771-4     Document Type: Review

References (76)

1. Aberman JE,Ward SJ, Salamone JD(1998) Effects of dopamine antagonists and accumbens dopamine depletions on time-constrained progressiveratio performance. Pharmacol Biochem Behav 61:341-348
2. Arnold JM, Roberts DCS (1997) A critique of fixed and progressive ratio schedules used to examine the neural substrates of drug reinforcement. Pharmacol Biochem Behav 57:441-447
3. Aston-Jones G, Smith RJ, Moorman DE, Richardson KA (2009) Role of lateral hypothalamic orexin neurons in reward processing and addiction. Neuropharmacology 56:112-121
4. Baldo B, Kelley AE (2007) Discrete neurochemical coding of distinguishable motivational processes: Insights from nucleus accumbens control of feeding. Psychopharmacology 91:439-459
5. Baron A, Mikorski J, Schlund M (1992) Reinforcement magnitude and pausing on progressive-ratio schedules. J Exp Anal Behav 58:377-388
6. Barr AM, Phillips AG (1999) Withdrawal following repeated exposure to d-Amphetamine decreases responding for a sucrose solution as measured by a progressive ratio schedule of reinforcement. Psychopharmacology 141:99-106
7. Berridge CW, Espana RA, Vittoz NM (2010) Hypocretin/orexin in arousal and stress. Brain Res 1314:91-102
8. Bezzina G, Cheung THC, Asgari K, Hampson CL, Body S, Bradshaw CM, Szabadi E, Deakin JFW, Anderson IM (2007) Effects of quinolinic acid-induced lesions of the nucleus accumbens core on inter-Temporal choice: A quantitative analysis. Psychopharmacology 195:71-84
9. Bezzina G, Body S, Cheung THC, Hampson CL, Deakin JFW, Anderson IM, Szabadi E, Bradshaw CM (2008) Effect of quinolinic acid-induced lesions of the nucleus accumbens core on performance on a progressive ratio schedule of reinforcement: Implications for inter-Temporal choice. Psychopharmacology 197:339-350
10. Bittar EG, Del-Claro K, Bittar LG, da Silva MCP (2012) Towards a mathematical model of within-session operant responding. J Exp Psychol: Anim Behav Proc. doi:10.1037/a0029086
11. Bizo LA, Killeen PR (1997) Models of ratio schedule performance. J Exp Psychol: Anim Behav Process 23:351-367
12. Bowman EM, Brown VJ (1998) Effects of excitotoxic lesions of the rat ventral striatum on the perception of reward cost. Exp Brain Res 123:439-448
13. Carlezon WA, Thomas MJ (2009) Biological substrates of reward and aversion: A nucleus accumbens activity hypothesis. Neuropharmacology 56(1):122-132
14. Cheeta S, Brooks S, Willner P (1995) Effects of reinforcer sweetness and the D2/D3 antagonist raclopride on progressive ratio operant performance. Behav Pharmacol 6:127-132
15. Corrigan PW, Reinke RR, Landsberger SA, Charate A, Toombs GA (2003) The effects of atypical antipsychotic medications on psychosocial outcomes. Schizophrenia Res 63:97-101
16. Covarrubias P, Aparicio CF (2008) Effects of reinforcer quality and step size on rats' performance under progressive ratio schedules. Behav Processes 78:246-252
17. Cunningham Owens DG (1999) A guide to the extrapyramidal sideeffects of antipsychotic drugs. Cambridge University Press, Cambridge
18. Czachowski CL, Samson HH (1999) Breakpoint determination and ethanol self-Administration using an across-session progressive ratio procedure in the rat. Alcoholism: Clin Exp Res 23:1580
19. Date Y, Ueta Y, Yamashita H, Yamaguchi H, Matsukura S, Kangawa K, Sakurai T, Yanagisawa M, Nakazato M (1999) Orexins, orexigenic hypothalamic peptides, interact with autonomic, neuroendocrine and neuroregulatory systems. Proc Natl Acad Sci USA 96:748-753
20. de Lecea L, Kilduff TS, Peyron C, Gao X, Foye PE, Danielson PE, Fukuhara C, Battenberg EL, Gautvik VT, Bartlett FS, Frankel WN, van den Pol AN, Bloom FE, Gautvik KM, Sutcliffe JG (1998) The hypocretins: hypothalamus-specific peptides with neuroexcitatory activity. Proc Natl Acad Sci USA 95:322-327
21. den Boon FS, Body S., Hampson CL, Bradshaw CM, Szabadi E, de Bruin N (2012) Effects of amisulpride and aripiprazole on progressive-ratio schedule performance: comparison with clozapine and haloperidol. J Psychopharmac. doi:10.1177/0269881111421974
22. Ferguson SA, Paule MG (1997) Progressive ratio performance varies with body weight in rats. Behav Processes 40:177-182
23. Ferster CB, Skinner BF (1957) Schedules of reinforcement. B. F. Skinner Foundation, Cambridge
24. Gancarz AM, Kausch MA, Lloyd DR, Richards JB (2012) Betweensession progressive ratio performance in rats responding for cocaine and water reinforcers. Psychopharmacology. doi:10.1007/s00213-012-2637-9
25. Goudie AJ, Cooper GD, Cole JC, Sumnall HR (2007) Cyproheptadine resembels clozapine in vivo folowing both acute and chronic administration in rats. J Psychopharmac 21:179-190
26. Graham SJ, Langley RW, Bradshaw CM, Szabadi E (2001) Effects of haloperidol and clozapine on prepulse inhibition of the acoustic startle response and the N1/P2 auditory evoked potential in man. J Psychopharmac 15:243-250
27. Harris GC, Aston-Jones G (2006) Arousal and reward: A dichotomy in orexin function. Trends Neurosci 29:571-577
28. Hartfield A, Moore N, Clifton P (2003) Serotonergic and histaminergic mechanisms involved in intralipid drinking? Pharmacol Biochem Behav 76:251-258
29. Herrnstein RJ (1970) On the law of effect. J Exp Anal Behav 13:243-266
30. Herrnstein RJ (1974) Formal properties of the matching law. J Exp Anal Behav 21:159-164
31. Herrnstein RJ, Rachlin H, Laibson DI (1997) The matching law. Harvard University Press, Cambridge
32. Ho MY, Body S, Kheramin S, Bradshaw CM, Szabadi E (2003) Effects of 8-OH-DPAT and WAY-100635 on performance on a timeconstrained progressive ratio schedule. Psychopharmacology (Berl) 167:137-144
33. Hodos W (1961) Progressive ratio as a measure of reward strength. Science 134:943-944
34. Hodos W, Kalman G (1963) Effects of increment size and reinforcer volume on progressive ratio performance. J Exp Anal Behav 6:387
35. Kheramin S, Body S, Herrera FM, Bradshaw CM, Szabadi E, Deakin JF, Anderson IM (2005) The effect of orbital prefrontal cortex lesions on performance on a progressive ratio schedule: Implications for models of inter-Temporal choice. Behav Brain Res 156:145-152
36. Killeen PR (1978) Superstition: A matter of bias, not detectability. Science 199:88-90
37. Killeen PR (1979) Arousal: Its genesis, modulation, and extinction. In: Zeiler MD, Harzem P (eds) Advances in analysis of behavior, vol 1, Reinforcement and the organization of behavior. Wiley, Chichester, pp 31-78
38. Killeen PR (1994) Mathematical principles of reinforcement. Behav Brain Sci 17:105-172
39. Killeen PR (1998) The first principle of reinforcement. In: Wynne CDL, Staddon JER (eds) Models of action: mechanisms for adaptive behavior. Erlbaum, Mahwah, pp 127-156
40. Killeen PR, Sitomer MT (2003) MPR. Behav Processes 62:49-64
41. Killeen PR, Hanson SJ, Osborne SR (1978) Arousal: Its genesis and manifestation as response rate. Psychol Rev 85:571-581
42. Killeen PR, Posadas-Sanchez D, Johansen EB, Thrailkill EA (2009) Progressive ratio schedules of reinforcement. J Exp Psychol: Anim Behav Proc 35:35-50
43. Li N, He S, Parrish C, Delich J, Grasing K (2003) Differences in morphine and cocaine reinforcement under fixed and progressive ratio schedules; effects of extinction, reacquisition and schedule design. Behav Pharmac 14:619-630
44. Markou A, Weiss F, Gold LH, Caine SB, Schulteis G, Koob GF (1993) Animal models of drug craving. Psychopharmacology (Berl) 112:163-182
45. Meltzer H, Perry E, Jayathilake K (2003) Clozapine-induced weight gain predicts improvement in psychopathology. Schizophrenia Res 59:19-27
46. Mobini S, Chiang T-J, Ho M-Y, Bradshaw CM, Szabadi E (2000) Comparison of the effects of clozapine, haloperidol, chlorpromazine and d-Amphetamine on performance on a time-constrained progressive ratio schedule and on locomotor behaviour in the rat. Psychopharmacology 152:47-54
47. Müller-Spahn F (2002) Current use of atypical antipsychotics. Eur Psychiat 17(suppl 4):377-384
48. Olarte Sánchez CM, Valencia Torres L, Body S, Cassaday HJ, Bradshaw CM, Szabadi E, Goudie AJ (2012a) A clozapine-like effect of cyproheptadine on progressive-ratio schedule performance. J Psychopharm 26:857-870
49. Olarte Sánchez CM, Valencia Torres L, Body S, Cassaday HJ, Bradshaw CM, Szabadi E (2012b) Effectof orexin-B-saporin induced lesions of the lateral hypothalamus on a progressive-ratio schedule. J Psychopharm 26:871-886
50. Perone M, Courtney K (1992) Fixed-ratio pausing: joint effects of past reinforcer magnitude and stimuli correlated with upcoming magnitude. J Exp Anal Behav 57:33-46
51. Peyron C, Tighe DK, van den Pol AN, de Lecea L, Heller HC, Sutcliffe JG, Kilduff TS (1998) Neurons containing hypocretin (orexin) project to multiple neuronal systems. J Neurosci 18:9996-10015
52. Ping-Teng C, Lee ES, Konz SA, Richardson NR, Roberts DCS (1996) Progressive ratio schedules in drug self-Administration studies in rats: A method to evaluate reinforcing efficacy. J Neurosci Meth 66:1-11
53. Reilly MP (2003) Extending mathematical principles of reinforcement into the domain of behavioral pharmacology. Behav Processes 62:75-88
54. Richardson NR, Roberts DCS (1996) Progressive ratio schedules in drug self-Administration studies in rats-A method to evaluate reinforcing efficacy. J Neurosci Methods 66:1-11
55. Rickard JF, Body S, Zhang Z, Bradshaw CM, Szabadi E (2009) Effect of reinforcer magnitude on performance maintained by progressive-ratio schedules. J Exp Anal Behav 91:75-87
56. Roberts DCS, Richardson NR (1992) Self-Administration of psychostimulants using progressive ratio schedules of reinforcement. In: Boulton A, Baker G, Wu PH (eds) Neuromethods vol 24: Animal models of drug addiction. Humana, New York, pp 233-269
57. Sakurai T, Amemiya A, Ishii M, Matsuzaki I, Chemelli RM, Tanaka H, Williams SC, Richarson JA, Kozlowski GP, Wilson S, Arch JR, Buckingham RE, Haynes AC, Carr SA, Annan RS, McNulty DE, Liu WS, Terrett JA, Elshourbagy NA, Bergsma DJ, Yanagisawa M (1998) Orexins and orexin receptors: A family of hypothalamic neuropeptides and G protein-coupled receptors that regulate feeding behavior. Cell 92:573-585, and page following p. 696
58. Salamone JD, Correa M, Farrar A, Mingote SM (2007) Effort-related functions of nucleus accumbens dopamine and associated forebrain circuits. Psychopharmacology 191:461-482
59. Schmelzeis MC, Mittleman G (1996) The hippocampus and reward: Effects of hippocampal lesions on progressive-ratio responding. Behav Neurosci 110:1049-1066
60. Schneider BA (1969) A two-state analysis of fixed-interval responding in the pigeon. J Exp Anal Behav 12:677-687
61. Siegel JM (2004) Hypocretin (orexin): role in normal behavior and neuropathology. Ann Rev Psychol 55:125-148
62. Siegel JM (2005) Hypocretin/orexin and motor function. In: Nishino S, Sakurai T (eds) The orexin/hypocretin system: physiology and pathophysiology. Humana Press, New York
63. Skinner BF (1948) Superstition in the pigeon. J Exp Psychol 38:168-172
64. Skjoldager P, Pierre PJ, Mittleman G (1993) Reinforcer magnitude and progressive ratio responding in the rat: Effects of increased effort, prefeeding, and extinction. Learn Motiv 24:303-343
65. Stafford D, Branch MN (1998) Effects of step size and break-point criterion on progressive-ratio performance. J Exp Anal Behav 70:123-138
66. Stafford D, LeSage MG, Glowa JR (1998) Progressive-ratio schedules of drug delivery in the analysis of drug self-Administration: A review. Psychopharmacology (Berl) 139:169-184
67. Sutton RS, Barto AG (1990) Time-derivative models of Pavlovian reinforcement. In: Gabriel M, Moore J (eds) Learning and computational neuroscience: foundations of adaptive networks. MIT Press, Cambridge, pp 497-537
68. Timberlake W, Lucas GA (1985) The basis of superstitious behavior: chance contingency, stimulus substitution, or appetitive behavior? J Exp Anal Behav 44:279-299
69. Timberlake W, Lucas GA (1989) Behavior systems and learning: from misbehavior to general principles. In: Klein SB, Mowrer RR (eds) Contemporary learning theories: Instrumental conditioning theory and the impact of constraints on learning. Erlbaum, Hillsdale, pp 237-275
70. Trivedi P, Yu H, MacNeil DJ, Van der Ploeg LH, Guan XM (1998) Distribution of orexin receptor mRNA in the rat brain. FEBS Lett 438:71-75
71. Valencia-Torres L, Olarte-Sánchez CM, da Costa AS, Body S, Bradshaw CM, Szabadi E (2012) Nucleus accumbens and delay discounting in rats: Evidence from a new quantitative protocol for analysing intertemporal choice. Psychopharmacology 219:271-283
72. Wise RA (1982) Neuroleptics and operant behavior: The anhedonia hypothesis. Brain Behav Sci 5:39-87
73. Wise RA (2006) Role of brain dopamine in food reward and reinforcement. Phil Trans Roy Soc Lond B: Biol Sci 361:1149-1158
74. Wynne CDL, Staddon JER, Delius JD (1996) Dynamics of waiting in pigeons. J Exp Anal Behav 65:603-618
75. Zhang Z, Rickard JF, Asgari K, Body S, Bradshaw CM, Szabadi E (2005a) Quantitative analysis of the effects of some "atypical" and "conventional" antipsychotics on progressive ratio schedule performance. Psychopharmacology (Berl) 179:489-497
76. Zhang Z, Rickard JF, Body S, Asgari K, Bradshaw CM, Szabadi E (2005b) Comparison of the effects of clozapine and 8-hydroxy-2-(di-n-propylamino) tetralin (8-OH-DPAT) on progressive ratio schedule performance: Evidence against the involvement of 5-HT 1A receptors in the behavioural effects of clozapine. Psychopharmacology (Berl) 181:381-391