Mathematical models and the experimental analysis of behavior

Journal of the Experimental Analysis of Behavior

Volumn 85, Issue 2, 2006, Pages 275-291

  Mazur, James E ^a  

^a SOUTHERN CONNECTICUT STATE UNIVERSITY   (United States)

Author keywords

Behavior; Equations; Mathematical models; Reinforcement

Indexed keywords

ARTICLE; HUMAN; REINFORCEMENT; SOCIAL BEHAVIOR; THEORETICAL MODEL;

HUMANS; MODELS, THEORETICAL; REINFORCEMENT (PSYCHOLOGY); SOCIAL BEHAVIOR;

EID: 33746478039     PISSN: 00225002     EISSN: None     Source Type: Journal    
DOI: 10.1901/jeab.2006.65-05     Document Type: Article

References (58)

1. Ainslie, G. W. (1975). Specious reward: A behavioral theory of impulsiveness and impulse control. Psychological Bulletin, 82, 463-496.
2. Baum, W. M. (1974). On two types of deviation from the matching law: Bias and undermatching. Journal of the Experimental Analysis of Behavior, 22, 231-242.
3. Baum, W. M., & Rachlin, H. (1969). Choice as time allocation. Journal of the Experimental Analysis of Behavior, 12, 861-874.
4. Billington, E. J., & DiTommaso, N. M. (2003). Demonstrations and applications of the matching law in education. Journal of Behavioral Education, 12, 91-104.
5. Bizo, L. A., & Killeen, P. R. (1997). Models of ratio schedule performance. Journal of Experimental Psychology: Animal Behavior Processes, 23, 351-367.
6. Bulow, P. J., & Meller, P. J. (1998). Predicting teenage girls' sexual activity and contraception use: An application of the matching law. Journal of Community Psychology, 26, 581-596.
7. Correia, C. J., Simons, J., Carey, K. B., & Borsari, B. E. (1998). Predicting drug use: Application of behavioral theories of choice. Addictive Behaviors, 23, 705-710.
8. Deluty, M. Z. (1976). Choice and rate of punishment in concurrent schedules. Journal of the Experimental Analysis of Behavior, 25, 75-80.
9. de Villiers, P. A. (1977). Choice in concurrent schedules and a quantitative formulation of the law of effect. In W. K. Honig & J. E. R. Staddon (Eds.), Handbook of operant behavior (pp. 233-287). Englewood Cliffs, NJ: Prentice-Hall.
10. de Villiers, P. A. (1980). Toward a quantitative theory of punishment. Journal of the Experimental Analysis of Behavior, 33, 15-25.
11. Dinsmoor, J. A. (1954). Punishment: I. The avoidance hypothesis. Psychological Review, 61, 34-46.
12. Dinsmoor, J. A. (1977). Escape, avoidance, punishment: Where do we stand? Journal of the Experimental Analysis of Behavior, 28, 83-95.
13. Fantino, E. (1969). Choice and rate of reinforcement. Journal of the Experimental Analysis of Behavior, 12, 723-730.
14. Felton, M., & Lyon, D. O. (1966). The post-reinforcement pause. Journal of the Experimental Analysis of Behavior, 9, 131-134.
15. Ferris, T. (1988). Coming of age in the Milky Way. New York: Anchor Books.
16. Gibbon, J. (1977). Scalar expectancy theory and Weber's law in animal timing. Psychological Review, 84, 279-325.
17. Grace, R. (1994). A contextual model of concurrent-chains choice. Journal of the Experimental Analysis of Behavior, 61, 113-129.
18. Grace, R. C. (1999). The matching law and amount-dependent exponential discounting as accounts of self-control choice. Journal of the Experimental Analysis of Behavior, 71, 27-44.
19. Green, L., Fisher, E. B., Perlow, S., & Sherman, L. (1981). Preference reversal and self control: Choice as a function of reward amount and delay. Behaviour Analysis letters, 1, 43-51.
20. Green, L., Fristoe, N., & Myerson, J. (1994). Temporal discounting and preference reversals in choice between delayed outcomes. Psychonomic Bulletin and Review, 1, 383-389.
21. Green, L., & Myerson, J. (1993). Alternative frameworks for the analysis of self control. Behavior and Philosophy, 21, 37-47.
22. Green, L., Myerson, J., Holt, D. D., Slevin, J. R., & Estle, S. J. (2004). Discounting of delayed food rewards in pigeons and rats: Is there a magnitude effect? Journal of the Experimental Analysis of Behavior, 81, 39-50.
23. Green, L., Myerson, J., & McFadden, E. (1997). Rate of temporal discounting decreases with amount of reward. Memory & Cognition, 25, 715-723.
24. Hall, G., & Pearce, J. M. (1983). Changes in stimulus associability during acquisition: Implications for the-ories of acquisition. In M. L. Commons, R. J. Herrnstein, & A. R. Wagner (Eds.), Quantitative analyses of behavior: Vol. 3: Acquisition (pp. 221-239). Cambridge, MA: Ballinger.
25. Herrnstein, R. J. (1961). Relative and absolute strength of response as a function of frequency of reinforcement. Journal of the Experimental Analysis of Behavior, 4, 267-272.
26. Heyman, G. M., & Monaghan, M. M. (1987). Effects of changes in response requirement and deprivation on the parameters of the matching law equation: New data and review. Journal of Experimental Psychology: Animal Behavior Processes, 13, 384-394.
27. Holmes, G. R., Heckel, R. V., Chestnut, E., Harris, N., & Cautela, J. (1987). Factor analysis of the Adolescent Reinforcement Survey Schedule (ARSS) with college freshmen. Journal of Clinical Psychology, 43, 386-390.
28. Hull, C. L. (1943). Principles of behavior. New York: Appleton-Century-Crofts.
29. Kelsey, J. E., & Allison, J. (1976). Fixed-ratio lever pressing by VMH rats: Work vs. accessibility of sucrose reward. Physiology & Behavior, 17, 749-754.
30. Kheramin, S., Body, S., Mobini, S., Ho, M.-Y, Velazquez-Martinez, D. N., Bradshaw, C. M., Szabadi, E., Deakin, J. F. W., & Anderson, I. M. (2002). Effects of quinolinic acid-induced lesions of the orbital prefrontal cortex on inter-temporal choice: A quantitative analysis. Psychopharmacology, 165, 9-17.
31. Killeen, P. R. (1975). On the temporal control of behavior. Psychological Review, 82, 89-115.
32. Killeen, P. R. (1994). Mathematical principles of reinforcement. Behavioral and Brain Sciences, 17, 105-172.
33. Killeen, P. R. (1999). Modeling modeling. Journal of the Experimental Analysis of Behavior, 71, 275-280.
34. Killeen, P. R., & Bizo, L. A. (1998). The mechanics of reinforcement. Psychonomic Bulletin and Review, 5, 221-238.
35. Killeen, P. R., Hall, S. S., Reilly, M. P., & Kettle, L. C. (2002). Molecular analyses of the principal components of response strength. Journal of the Experimental Analysis of Behavior, 78, 127-160.
36. Mace, F. C., McCurdy, B., & Quigley, E. A. (1990). A collateral effect of reward predicted by matching theory. Journal of Applied Behavior Analysis, 23, 197-205.
37. Mackintosh, N.J. (1975). A theory of attention: Variations in the associability of stimuli with reinforcement. Psychological Review, 82, 276-298.
38. Martens, B. K., & Houk, J. L. (1989). The application of Herrnstein's law of effect to disruptive and on-task behavior of a retarded adolescent girl. Journal of the Experimental Analysis of Behavior, 51, 17-27.
39. Martens, B. K., Lochner, D. G., & Kelly, S. Q. (1992). The effects of variable-interval reinforcement on academic engagement: A demonstration of matching theory. Journal of Applied Behavior Analysis. 25, 143-151.
40. Mazur, J. E. (1984). Tests of an equivalence rule for fixed and variable reinforcer delays. Journal of Experimental Psychology: Animal Behavior Processes, 10, 426-436.
41. Mazur, J. E. (1987). An adjusting procedure for studying delayed reinforcement. In M. L. Commons, J. E. Mazur, J. A. Nevin, & H. Rachlin (Eds.), Quantitative analyses of behavior: Vol. 5. The effect of delay and of intervening events on reinforcement value (pp. 55-73). Hillsdale, NJ: Erlbaum.
42. Mazur, J. E. (2000a). Tradeoffs among delay, rate and amount of reinforcement. Behavioural Processes, 49, 1-10.
43. Mazur, J. E. (2000b). Two-versus three-alternative concurrent-chain schedules: A test of three models. Journal of Experimental Psychology: Animal Behavior Processes, 26, 286-293.
44. Mazur, J. E. (2001). Hyperbolic value addition and general models of animal choice. Psychological Review, 108, 96-112.
45. McSweeney, F. K. (1978). Prediction of concurrent key-peck treadle-press responding from simple schedule performance. Animal Learning of Behavior, 6, 444-450.
46. Miller, R. R., & Schachtman, T. R. (1985). The several roles of context at the time of retrieval. In P. D. Balsam & A. Tomie (Eds.), Context and learning. Hillsdale, NJ: Erlbaum.
47. Nevin, J. A. (1992). An integrative model for the study of behavioral momentum. Journal of the Experimental Analysis of Behavior, 57, 301-316.
48. Nevin, J. A., & Grace, R. A. (2000). Behavioral momentum and the law of effect. Behavioral and Brain Sciences, 23, 73-130.
49. Ong, E. L., & White, K. G. (2004). Amount-dependent temporal discounting? Behavioural Processes, 66, 201-212.
50. Platt, M. L., & Glimcher, P. W. (1999). Neural correlates of decision variables in the parietal cortex. Nature, 400, 233-238.
51. Rachlin, H., & Herrnstein, R. J. (1969). Hedonism revisited: On the negative law of effect. In B. A. Campbell & R. M. Church (Eds.), Punishment and aversive behavior. New York: Appleton-Century-Crofts.
52. Rescorla, R. A., & Wagner, A. R. (1972). A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement. In A. H. Black & W. F. Prokasy (Eds.), Classical conditioning II: Current research and theory (pp. 64-99). New York: Appleton-Century-Crofts.
53. Richards, J. B., Mitchell, S. H., de Wit, H., & Seiden, L. S. (1997). Determination of discount functions in rats with an adjusting-amount procedure. Journal of the Experimental Analysis of Behavior, 67, 353-366.
54. Savastano, H. I., & Fantino, E. (1996). Differences in delay, not ratios, control choice in concurrent chains. Journal of the Experimental Analysis of Behavior, 66, 97-116.
55. Skinner, C. H., Robinson, S. L., Johns, G. A., Logan, P., & Belfiore, P. J. (1996). Applying Herrnstein's matching law to influence students' choice to complete difficult academic tasks. Journal of Experimental Education, 65, 5-17.
56. Snyderman, M. (1983). Body weight and response strength. Behaviour Analysis Letters, 3, 255-265.
57. Squires, N., & Fantino, E. (1971). A model for choice in simple concurrent and concurrent-chains schedules. Journal of the Experimental Analysis of Behavior, 15, 27-38.
58. Wagner, A. R. (1981). SOP: A model of automatic memory processing in animal behavior. In N. E. Spear & R. R. Miller (Eds.), Information processing in animals: Memory mechanisms. Hillsdale, NJ: Erlbaum.