Herrnstein's hyperbolic matching equation and behavioral pharmacology: Review and critique

Behavioural Pharmacology

Volumn 15, Issue 7, 2004, Pages 443-459

  Dallery, J ^a,b   Soto, P L ^a  

^a UNIVERSITY OF FLORIDA   (United States)

^b University of Florida ^*  (United States)

Author keywords

Behavioral mechanisms; Behavioral pharmacology; Herrnstein's hyperbola; Human; Matching theory; Rat; Rate dependency

Indexed keywords

DRUG EFFECT; DRUG MECHANISM; DRUG RESPONSE; ENVIRONMENTAL FACTOR; HUMAN; MATHEMATICAL ANALYSIS; MONKEY; MOTIVATION; NONHUMAN; REINFORCEMENT; REVIEW;

ANIMALS; BEHAVIOR; HUMANS; MODELS, THEORETICAL; MOTIVATION; PHARMACOLOGY; RATS; SENSITIVITY AND SPECIFICITY;

EID: 8344226159     PISSN: 09558810     EISSN: None     Source Type: Journal    
DOI: 10.1097/00008877-200411000-00001     Document Type: Review

References (108)

1. Anderson KG, Velkey AJ, Woolverton WL (2002). The generalized matching law as a predictor of choice between cocaine and food in rhesus monkeys. Psychopharmacology (Berl) 163:319-326.
2. Barrett JE, Glowa JR, Nader MA (1989). Behavioral and pharmacological history as determinants of tolerance- and sensitization-like phenomena in drug action. In: Goudie AJ, Emmett-Oglesby MW (editors): Psychoactive Drugs: Tolerance and Sensitization. Totowa, NJ: Humana Press; pp. 181-219.
3. Baum WM (1974). On two types of deviation from the matching law: bias and under-matching. J Exp Anal Behav 22:231-242.
4. Baum WM (1979). Matching, undermatching, and overmatching in studies of choice. J Exp Anal Behav 32:269-281.
5. Belke TW, Heyman GM (1994). Increasing and signaling background reinforce-ment: Effect on the foreground response-reinforcer relation. J Exp Anal Behav 61:65-81.
6. Belke TW, Neubauer J (1997). A matching law analysis of the effect of amphetamine on responding reinforced by the opportunity to run. Psychol Rec 47:483-498.
7. Borrero JC, Vollmer TR (2002). An application of the matching law to severe problem behavior. J Appl Behav Anal 35:13-27.
8. Bradshaw CM (1977). Suppression of response rates in variable-interval schedules by a concurrent schedule of reinforcement. Br J Psychol 68:473-480.
9. Bradshaw CM, Szabadi E, Bevan P (1976). Behavior of humans in variable-interval schedules of reinforcement. J Exp Anal Behav 26:135-141.
10. Bradshaw CM, Szabadi E, Bevan P (1978). Relationship between response rate and reinforcement frequency in variable-interval schedules: The effect of concentration of sucrose reinforcement. J Exp Anal Behav 29:447-452.
11. Bradshaw CM, Ruddle HV, Szabadi E (1981). Relationship between response rate and reinforcement frequency in variable interval schedules: III. The effect of D-amphetamine. J Exp Anal Behav 36:29-39.
12. Bradshaw CM, Szabadi E, Ruddle HV (1983a). Herrnstein's equation: Effect of response-force requirement on performance in variable-interval schedules. Behav Anal Lett 3:93-100.
13. Bradshaw CM, Szabadi E, Ruddle HV, Pears E (1983b). Herrnstein's equation: Effect of deprivation level on performance in variable-interval schedules. Behav Anal Lett 3:267-273.
14. Branch MN (1984). Rate dependency, behavioral mechanisms, and behavioral pharmacology. J Exp Anal Behav 42:511-522.
15. Branch MN, Schaal DW (1990). Roles and characteristics of theory in behavioral pharmcacology. In: Barrett J, Thompson T, Dews PB (editors): Advances in Behavioral Pharmacology, Vol. 7. Hillsdale, NJ: Lawrence Erlbaum; pp. 171-196.
16. Carroll ME (1996). Reducing drug abuse by enriching the environment with alternative nondrug reinforcers. In: Green L, Kagel JH (editors): Advances in Behavioral Economics. Vol. 3: Substance Use and Abuse. Norwood, NJ: Ablex Publishing; pp. 37-68.
17. Catania AC (1973). Self-inhibiting effects of reinforcement. J Exp Anal Behav 19:517-526.
18. Cheeta S, Brooks S, Willner P (1995). Effects of reinforcer sweetness and the D2/D3 antagonist raclopride on progressive ratio operant performance. Behav Pharmacol 6:127-132.
19. Chen CS (1979). Acquisition of behavioral tolerance to ethanol as a function of reinforced practice in rats. Psychopharmacology (Berl) 63:285-288.
20. Cliffe MJ, Parry SJ (1980). Matching to reinforcer value: Human concurrent variable-interval performance. Q J Exp Psychol 32:557-570.
21. Conrad DG, Sidman M (1956). Sucrose concentration as reinforcement for lever pressing by monkeys. Psychol Rep 2:381-384.
22. Correia CJ, Carey KB (1999). Applying behavioral theories of choice to substance use in a sample of psychiatric outpatients. Psychol Addict Behav 13:207-212.
23. Correia CJ, Simons J, Carey KB, Borsari BE (1998). Predicting drug use: Application of behavioral theories of choice. Addict Behav 23:705-710.
24. Dallery J, Lancaster JS (1999). Individual differences in behavioral tolerance to amphetamine and the economic context of reinforcement loss. Behav Pharmacol 10:257-269.
25. Dallery J, McDowell JJ, Lancaster JS (2000). Falsification of matching theory's account of single-alternative responding: Herrnstein's k varies with sucrose concentration. J Exp Anal Behav 73:23-43.
26. Dallery J, McDowell JJ, Soto PL (2004). The measurement and functional properties of reinforcer value in single-alternative responding: A test of linear system theory. Psychol Rec 54:45-65.
27. Davison M, McCarthy D (1988). The Matching Law: A Research Review. Hillside, NJ: Lawrence Erlbaum.
28. de Villiers PA (1977). Choice in concurrent schedules and a quantitative formulation of the law of effect. In: Honig WK, Staddon JER (editors): Handbook of Operant Behavior. Englewood Cliffs, NJ: Prentice Hall; pp. 233-287.
29. de Villiers PA, Herrnstein RJ (1976). Toward a law of response strength. Psychol Bull 83:1131-1153.
30. Dews PB (1955). Studies on behavior. I. Differential sensitivity to pentobarbital of pecking performance in pigeons depending on the schedule of reward. J Pharmacol 113:393-401.
31. Dews PB, Wenger GR (1977). Rate-dependency of the behavioral effects of amphetamine. In: Thompson T, Dew PB (editors): Advances in Behavioral Pharmacology, Vol. 1. New York: Academic Press; pp. 167-227.
32. Egli M, Schaal DW, Thompson T, Cleary J (1992). Opioid-induced response-rate decrements in pigeons responding under variable interval schedules: reinforcement mechanisms. Behav Pharmacol 3:581-591.
33. Ettenberg A, Koob GG, Bloom FE (1981), Response artifact in the measurement of neuroleptic-induced anhedonia. Science 209:357-359.
34. Fisher WW, Mazur JE (1997). Basic and applied research on choice responding. J Appl Behav Anal 30:387-410.
35. Gallistel CR, Davis AJ (1983). Affinity for the dopamine D-sub-2 receptor predicts neuroleptic potency in blocking the reinforcing effect of MFB stimulation. Pharmacol Biochem Behav 19:867-872.
36. Glautier S, Bankart J, Rigney U, Willner P (1998). Multiple variable interval schedule behaviour in humans: Effects of ethanol, mood, and reinforcer size on responding maintained by monetary reinforcement. Behav Pharmacol 9:619-630.
37. Glautier S, Rigney U, Willner P (2001). Motivation for alcohol assessed by multiple variable interval schedule behaviour: effects of reward size and alcohol. Behav Pharmacol 12:81-89.
38. Gonzalez FA (2002). Improved multiparameter models of drug effects on response rate under multiple variable interval schedules: evidence from rat studies. Psychopharmacology (Berl) 163:310-318.
39. Gutman N (1954). Equal-reinforcement values for sucrose and glucose solutions compared with equal sweetness values. J Comp Physiol Psychol 47:358-381.
40. Hamilton AL, Stellar JR, Hart EB (1985). Reward, performance, and the response strength method in self-stimulating rats: Validation and neuroleptics. Physiol Behav 35:897-904.
41. Herrnstein RJ (1961), Relative and absolute strength of response as a function of frequency of reinforcement. J Exp Anal Behav 4:267-272.
42. Herrnstein RJ (1970). On the law of effect. J Exp Anal Behav 13:243-266.
43. Herrnstein RJ (1974). Formal properties of the matching law. J Exp Anal Behav 21:159-164.
44. Heyman GM (1983). A parametric evaluation of the hedonic and motoric effects of drugs: Pimozide and amphetamine. J Exp Anal Behav 40: 113-122.
45. Heyman GM, Monaghan MM (1987). Effects of changes in response requirement and deprivation on the parameters of the matching law equation: New data and review. J Exp Psychol Anim Behav Process 13:384-394.
46. Heyman GM, Monaghan MM (1994). Reinforcer magnitude (sucrose concentration) and the matching law theory of response strength. J Exp Anal Behav 61:505-516.
47. Heyman GM, Seiden LS (1985). A parametric description of amphetamine's effect on response rate: Changes in reinforcement efficacy and response topography. Psychopharmacology (Berl) 85:154-161.
48. Heyman GM, Kinzie DL, Seiden LS (1986). Chlorpromazine and pimozide alter reinforcement efficacy and motor performance. Psychopharmacology (Berl) 88:346-353.
49. Heyman GM, Monaghan MM, Clody DE (1987). Low doses of cis-flupentixol attenuate motor performance. Psychopharmacology (Berl) 93:477-482.
50. Ho MY, Mobini S, Chiang TJ, Bradshaw CM (1999). Theory and method in the quantitative analysis of 'impulsive choice' behaviour: Implications for Psychopharmacology. Psychopharmacology (Berl) 146:362-372.
51. Houston A (1986). The matching law applies to wagtails' foraging in the wild. J Exp Anal Behav 45:15-18.
52. Iversen IH (2002). Response-initiated imaging of operant behavior using a digital camera. J Appl Behav Anal 77:283-300.
53. Johnston JM, Pennypacker HS (1992). Strategies and tactics of behavioral research. 2nd ed. Hillsdale, NJ: L. Erlbaum.
54. Keesey RE (1964). Duration of stimulation and the reward properties of hypothalamic stimulation. J Comp Physiol Psychol 58:201-207.
55. Kelleher RT, Morse WH (1964). Escape behavior and punished behavior. Fed Proc 23:808-817.
56. Killeen PR (1994). Mathematical principles of reinforcement. Behav Brain Sd 17:105-172.
57. Kraeling D (1961). Analysis of amount of reward as a variable in learning. J Comp Physiol Psychol 54:560-565.
58. Lancaster JS, Dallery J (1999). The effects of morphine on responding under variable-interval schedules: rate-related effects, behavioral mechanisms, and Herrnstein's hyperbola. Behav Pharmacol 10:337-347.
59. LeSage MG, Stafford D, Glowa JR (1999). Preclinical research on cocaine self-administration: Environmental determinants and their interaction with pharmacological treatment. Neurosci Biobehav Rev 23:717-741.
60. Logan RA (1960). Incentive. New Haven: Yale University Press.
61. Lucki I (1983). Rate-dependent effects of amphetamine on responding under random-interval schedules of reinforcement in the rat. Pharmacol Biochem Behav 18:195-201.
62. Lucki I, DeLong DE (1983). Control rate of response or reinforcement and amphetamine's effect on behavior. J Exp Anal Behav 40:123-132.
63. Mace CF, Neef NA, Shade D, Mauro BC (1994). Limited matching on concurrent-schedule reinforcement of academic behavior. J Appl Behav Anal 27: 585-596.
64. Mace CF, Neef NA, Shade D, Mauro BC (1996). Effects of problem difficulty and reinforcer quality on time allocated to concurrent arithmetic problems. J Appl Behav Anal 29:11-24.
65. MacPhail RC, Gollub LR (1975), Separating the effects of response rate and reinforcement frequency in the rate dependent effects of scopolamine on the schedule-controlled performance of rats and pigeons. J Pharmacol Exp Ther 194:332-342.
66. Martens BK, Houk JL (1989). The application of Herrnstein's law of effect to disruptive and on-task behavior of a retarded adolescent girl. J Exp Anal Behav 51:17-27.
67. McDowell JJ (1982). The importance of Herrnstein's mathematical statement of the law of effect for behavior therapy. Am Psychol 37:771-779.
68. McDowell JJ (1986). On the falsifiability of matching theory. J Exp Anal Behav 45:63-74.
69. McDowell JJ (1988). Matching theory in natural human environments. Behav Analyst 11:95-109.
70. McDowell JJ (1989). Two modern developments in matching theory. Behav Analyst 12:153-166.
71. McDowell JJ, Dallery J (1999). Falsification of matching theory: Changes in the asymptote of Herrnstein's hyperbola as a function of water deprivation. J Exp Anal Behav 72:251-268.
72. McDowell JJ, Kessel R (1979). A multivariate rate equation for variable-interval performance. J Exp Anal Behav 36:9-19.
73. McDowell JJ, Wood HM (1984). Confirmation of linear system theory prediction: Changes in Herrnstein's k as a function of changes in reinforcer magnitude. J Exp Anal Behav 41:183-192.
74. McDowell JJ, Wood HM (1985), Confirmation of linear system theory prediction: Rate of change of Herrnstein's k as a function of response-force requirement. J Exp Anal Behav 43:61-73.
75. Mobini S, Chiang TJ, Ho MY, Bradshaw CM, Szabadi E (2000). Comparison of the effects of clozapine, haloperidol, chlorpromazine and d-amphetamine on performance on a time-constrained progressive ratio schedule and on locomotor behaviour in the rat. Psychopharmacology (Berl) 152:47-54.
76. Morley MJ, Bradshaw CM, Szabadi E (1984). The effect of pimozide on variable-interval performance: A test of the 'anhedonia' hypothesis of the mode of action of neuroleptics. Psychopharmacology (Berl) 84:531-536.
77. Morley MJ, Bradshaw CM, Szabadi E (1985). The effect of d-amphetamine on operant behaviour maintained under variable-interval schedules of reinforcement. Psychopharmacology (Berl) 87:207-211.
78. Murray LK, Kollins SH (2000). Effects of methylphenidate on sensitivity to reinforcement in children diagnosed with attention deficit hyperactivity disorder: An application of the matching law. J Appl Behav Anal 33: 573-591.
79. Ohmori T, Abekawa T, Ito K, Koyama T (2000). Context determines the type of sensitized behaviour: A brief review and a hypothesis on the role of environment in behavioural sensitization. Behav Pharmacol 11:211-221.
80. Perkins KA (1999). Baseline-dependency of nicotine effects: A review. Behav Pharmacol 10:597-615.
81. Phillips G, Willner P, Muscat R (1991 a). Suppression or facilitation of operant behavior by ralcopride dependent on concentration of sucrose reward. Psychopharmacology (Berl) 105:239-246.
82. Phillips G, Willner P, Muscat R (1991b). Reward-dependent suppression or facilitation of consummatory behavior by ralcopride. Psychopharmacology (Berl) 105:355-360.
83. Phillips G, Willner P, Sampson D, Nunn J, Muscat R (1991c). Time-, schedule-, and reinforcer-dependent effects of pimozide and amphetamine. Psychopharmacology (Berl) 104:125-131.
84. Pierce DW, Epling FE (1995). The applied importance of research on the matching law. J Appl Behav Anal 28:237-241.
85. Pitts RC, Febbo SM (2004). Quantitative analyses of methamphetamine's effects on self-control choices: implications for elucidating behavioral mechanisms of drug action. Behav Processes 66:213-233.
86. Ploog BO, Ziegler HP (1996). Effects of food-pellet size on rate, latency, and topography of autoshaped key pecks and gapes in pigeons. J Exp Anal Behav 65:21-35.
87. Ploog BO, Ziegler HP (1997). Key-peck probability and topography in a concurrent variable-interval variable-interval schedule with food and water reinforcers. J Exp Anal Behav 67:109-129.
88. Reilly MP (2003). Extending mathematical principles of reinforcement into the domain of behavioral pharmacology. Behav Processes 62:75-88.
89. Ruddle HV, Morley MJ, Bradshaw CM, Szabadi E (1984). The effect of pentobarbitone on variable-interval performance: Analysis in terms of Herrnstein's equation. Psychopharmacology (Berl) 84:520-525.
90. Sanger DJ, Blackman DE (1976). Rate-dependent effects of drugs: a review of the literature. Pharmacol Biochem Behav 4:73-83.
91. Schrier AM (1965). Response rates of monkeys (Wacaca mulatta) under varying conditions of sucrose reinforcement. J Comp Physiol Psychol 59:378-384.
92. Schuster CR, Dockens WS, Woods JH (1966). Behavioral variables affecting the development of amphetamine tolerance. Psychopharmacologia 9:170-182.
93. Shah K, Bradshaw CM, Szabadi E (1990). Interaction between antidepressants and d-amphetamine on variable-interval performance. Psychopharmacology (Berl) 100:548-554.
94. Shull RL (1991). Mathematical description of operant behavior: an introduction. In: Iversen IH, Lattal A (editors): Experimental Analysis of Behavior, Vol. 2. New York: Elsevier; pp. 243-282.
95. Sidman M (1960). Tactics of Scientific Research; Evaluating Experimental Data in Psychology. New York: Basic Books.
96. Smith JB (1986). Effects of chronically administered d-amphetamine on spaced responding under multiple and single-component schedules. Psychopharmacology (Berl) 88:296-300.
97. Snyderman M (1983). Body weight and response strength. Behav Anal Lett 3:255-265.
98. Staddon JER (1977). On Herrnstein's equation and related forms. J Exp Anal Behav 28:163-170.
99. Staddon JER, Cerutti DT (2003). Operant conditioning. Annu Rev Psychol 54:115-144.
100. Thompson T (1984). Behavioral mechanisms of drug dependence. In: Thompson T, Dews PB, Barrett JE (editors): Advances in Behavioral Pharmacology, Vol. 4. New York: Academic Press; pp. 1-45.
101. Thompson T, Schuster CR (1968). Behavioral Pharmacology. Englewood Cliffs, NJ: Prentice-Hall.
102. Vollmer TR, Bourret J (2000). An application of the matching law to evaluate the allocation of two- and three-point shots by college basketball players. J Appl Behav Anal 33:137-150.
103. White KG, Mclean AP, Aldiss MF (1986). The context for reinforcement: Modulation of the response-reinforcer relation by concurrently available extraneous reinforcement. Anim Learn Behav 14:398-404.
104. Williams BA (1988). Reinforcement, choice, and response strength. In: Atkinson AC, Herrnstein RJ, Lindzey G, and Luce RD (editors): Stevens' Handbook of Experimental Psychologym, Vol. 2. 2nd ed. New York: Wiley; pp. 167-244.
105. Willner P, Sampson D, Phillips G, Muscat R (1990). A matching law analysis of the effects of dopamine receptor antagonists. Psychopharmacology (Berl) 101:560-567.
106. Wise RA (1982). Neuroleptics and operant behavior: The anhedonia hypothesis. Behav Brain Sci 5:39-87.
107. Wolgin DL (1989). The role of instrumental learning in behavioral tolerance to drugs. In: Goudie AJ, Emmett-Oglesby MW (editors): Psycoactive Drugs: Tolerance and Sensitization. Clifton, NJ: Humana Press; pp. 17-114.
108. Woolverton WL (1996). Intravenous self-administration of cocaine under concurrent VI schedules of reinforcement. Psychopharmacology (Berl) 127:195-203.