Choice, delay, probability, and conditioned reinforcement

Animal Learning and Behavior

Volumn 25, Issue 2, 1997, Pages 131-147

  Mazur, James E ^a  

^a SOUTHERN CONNECTICUT STATE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; BEHAVIOR; CONDITIONING; DECISION MAKING; MODEL; NONHUMAN; REINFORCEMENT; THEORY;

EID: 0030920737     PISSN: 00904996     EISSN: None     Source Type: Journal    
DOI: 10.3758/BF03199051     Document Type: Article

References (64)

1. AINSLIE, G. W. (1974). Impulse control in pigeons. Journal of the Experimental Analysis of Behavior, 21, 485-489.
2. AINSLIE, G. W. (1975). Specious reward: A behavioral theory of impulsiveness and impulse control. Psychological Bulletin, 82, 463-496.
3. BAUM, W. M. (1974). On two types of deviation from the matching law: Bias and undermatching. Journal of the Experimental Analysis of Behavior, 22, 231-242.
4. BAUM, W. M. (1979). Matching, undermatching, and overmatching in studies of choice. Journal of the Experimental Analysis of Behavior, 32, 269-281.
5. BAUM, W. M., & RACHLIN, H. (1969). Choice as time allocation. Journal of the Experimental Analysis of Behavior, 12, 861-874.
6. BENZION, U., RAPAPORT, A., & YAGIL, J. (1989). Discounting rates inferred from decisions: An experimental study. Management Science, 35, 270-284.
7. CICERONE, R. A. (1976). Preference for mixed versus constant delay of reinforcement. Journal of the Experimental Analysis of Behavior, 25, 257-261.
8. DAVISON, M. C. (1969). Preference for mixed-interval versus fixed-interval schedules. Journal of the Experimental Analysis of Behavior, 12, 247-252.
9. DAVISON, M. C. (1972). Preference for mixed-interval versus fixed-interval schedules: Number of component intervals. Journal of the Experimental Analysis of Behavior, 17, 169-176.
10. DAVISON, M. C. (1983). Bias and sensitivity to reinforcement in a concurrent-chain schedule. Journal of the Experimental Analysis of Behavior, 40, 15-34.
11. DAVISON, M. C. (1988). Delay of reinforcers in a concurrent-chain schedule: An extension of the hyperbolic-decay model. Journal of the Experimental Analysis of Behavior, 50, 219-236.
12. DAVISON, M. C., & TEMPLE, W. (1973). Preference for fixed-interval schedules: An alternative model. Journal of the Experimental Analysis of Behavior, 20, 393-403.
13. DOMJAN, M. (1993). Domjan and Burkhard's 'The principles of learning and behavior' (3rd ed.). Pacific Grove, CA: Brooks/Cole.
14. DUNN, R., & SPETCH, M. L. (1990). Choice with uncertain outcomes: Conditioned reinforcement effects. Journal of the Experimental Analysis of Behavior, 53, 201-218.
15. DUNN, R., WILLIAMS, B., & ROYALTY, P. (1987). Devaluation of stimuli contingent on choice: Evidence for conditioned reinforcement. Journal of the Experimental Analysis of Behavior, 48, 117-131.
16. FANTINO, E. (1967). Preference for mixed-versus fixed-ratios. Journal of the Experimental Analysis of Behavior, 10, 35-43.
17. FANTINO, E. (1969). Choice and rate of reinforcement. Journal of the Experimental Analysis of Behavior, 12, 723-730.
18. FANTINO, E. (1977). Conditioned reinforcement: Choice and information. In W. K. Honig & J. E. R. Staddon (Eds.), Handbook of operant behavior (pp. 313-339). Englewood Cliffs, NJ: Prentice-Hall.
19. FANTINO, E., & DAVISON, M. (1983). Choice: Some quantitative relations. Journal of the Experimental Analysis of Behavior, 40, 1-13.
20. FANTINO, E., & DUNN, R. (1983). The delay-reduction hypothesis: Extension to three-alternative choice. Journal of Experimental Psychology: Animal Behavior Processes, 9, 132-146.
21. FANTINO, E., PRESTON, R. A., & DUNN, R. (1993). Delay reduction: Current status. Journal of the Experimental Analysis of Behavior, 60. 159-169.
22. FIELD, D. P., TONNEAU, F., AHEARN, W., & HINELINE, P. N. (1996). Preference between variable-ratio and fixed-ratio schedules: Local and extended relations. Journal of the Experimental Analysis of Behavior, 66, 283-295.
23. GIBBON, J. (1977). Scalar expectancy theory and Weber's law in animal timing. Psychological Review, 84, 279-325.
24. GRACE, R. C. (1993). Violations of transitivity: Implications for a theory of contextual choice. Journal of the Experimental Analysis of Behavior, 60, 185-201.
25. GRACE, R. C. (1994). A contextual model of concurrent-chains choice. Journal of the Experimental Analysis of Behavior, 61, 113-129.
26. GRACE, R. C. (1996). Choice between fixed and variable delays to reinforcement in the adjusting-delay procedure and concurrent chains. Journal of Experimental Psychology: Animal Behavior Processes, 22, 362-383.
27. GREEN, L., FISHER, E. B., PERLOW, S., & SHERMAN, L. (1981). Preference reversal and self control: Choice as a function of reward amount and delay. Behaviour Analysis Letters, 1, 43-51.
28. GREEN, L., FRISTOE, N., & MYERSON, J. (1994). Temporal discounting and preference reversals in choice between delayed outcomes. Psychonomic Bulletin & Review, 1, 383-389.
29. GROSSBARD, C. L., & MAZUR, J. E. (1986). A comparison of delays and ratio requirements in self-control choice. Journal of the Experimental Analysis of Behavior, 45, 305-315.
30. HERRNSTEIN, R. J. (1964). Aperiodicity as a factor in choice. Journal of the Experimental Analysis of Behavior, 7, 179-182.
31. HULL, C. L. (1943). Principles of behavior. New York: Appleton-Century-Crofts.
32. KILLEEN, P. (1968). On the measurement of reinforcement frequency in the study of preference. Journal of the Experimental Analysis of Behavior, 11, 263-270.
33. KILLEEN, P. R. (1982). Incentive theory: II. Models for choice. Journal of the Experimental Analysis of Behavior, 38, 217-232.
34. KILLEEN, P. R., & FANTINO, E. (1990). Unification of models for choice between delayed reinforcers. Journal of the Experimental Analysis of Behavior, 53, 189-200.
35. MACEWEN, D. (1972). The effects of terminal-link fixed-interval and variable-interval schedules on responding under concurrent-chained schedules. Journal of the Experimental Analysis of Behavior, 18, 253-261.
36. MAZUR, J. E. (1984). Tests of an equivalence rule for fixed and variable reinforcer delays. Journal of Experimental Psychology: Animal Behavior Processes, 10, 426-436.
37. MAZUR, J. E. (1986a). Choice between single and multiple delayed reinforcers. Journal of the Experimental Analysis of Behavior, 46, 67-77.
38. MAZUR, J. E. (1986b). Fixed and variable ratios and delays: Further tests of an equivalence rule. Journal of Experimental Psychology: Animal Behavior Processes, 12, 116-124.
39. MAZUR, J. E. (1987). An adjusting procedure for studying delayed reinforcement. In M. L. Commons, J. E. Mazur, J. A. Nevin, & H. Rachlin (Eds.), Quantitative analyses of behavior: Vol. 5. The effect of delay and of intervening events on reinforcement value (pp. 55-73). Hillsdale, NJ: Erlbaum.
40. MAZUR, J. E. (1989). Theories of probabilistic reinforcement. Journal of the Experimental Analysis of Behavior, 51, 87-99.
41. MAZUR, J. E. (1991). Choice with probabilistic reinforcement: Effects of delay and conditioned reinforcers. Journal of the Experimental Analysis of Behavior, 55, 63-77.
42. MAZUR, J. E. (1995). Conditioned reinforcement and choice with delayed and uncertain primary reinforcers. Journal of the Experimental Analysis of Behavior, 63, 139-150.
43. MAZUR, J. E., & ROMANO, A. (1992). Choice with delayed and probabilistic reinforcers: Effects of variability, time between trials, and conditioned reinforcers. Journal of the Experimental Analysis of Behavior, 58, 513-525.
44. MCDIARMID, C. G., & RILLING, M. E. (1965). Reinforcement delay and reinforcement rate as determinants of schedule preference. Psychonomic Science, 2, 195-196.
45. MILLAR, A., & NAVARICK, D. J. (1984). Self-control and choice in humans: Effects of video game playing as a positive reinforcer. Learning & Motivation, 15, 203-218.
46. MYERSON, J., & GREEN, L. (1995). Discounting of delayed rewards: Models of individual choice. Journal of the Experimental Analysis of Behavior, 64, 263-276.
47. NAVARICK, D. J. (1985). Choice in humans: Functional properties of reinforcers established by instruction. Behavioural Processes, 11, 269-277.
48. NAVARICK, D. J. (1986). Human impulsivity and choice: A challenge to traditional operant methodology. Psychological Record, 36, 343-356.
49. NAVARICK, D. J., & FANTINO, E. (1972). Transitivity as a property of choice. Journal of the Experimental Analysis of Behavior, 18, 389-401.
50. OMINO, T. (1993). A quantitative analysis of sensitivity to the conditioned reinforcing value of terminal-link stimuli in a concurrent-chains schedule. Journal of the Experimental Analysis of Behavior, 60, 587-594.
51. OMINO, T., & ITO, M. (1993). Choice and delay of reinforcement: Effects of terminal-link stimulus and response conditions. Journal of the Experimental Analysis of Behavior, 59, 361-371.
52. RACHLIN, H., & GREEN, L. (1972). Commitment, choice, and self-control. Journal of the Experimental Analysis of Behavior, 17, 15-22.
53. RACHLIN, H., LOGUE, A. W., GIBBON, J., & FRANKEL, M. (1986). Cognition and behavior in studies of choice. Psychological Review, 93, 33-45.
54. RAINERI, A., & RACHLIN, H. (1993). The effect of temporal constraints on the value of money and other commodities. Journal of Behavioral Decision Making, 6, 77-94.
55. RIDER, D. P. (1983). Preference for mixed versus constant delays of reinforcement: Effect of probability of the short, mixed delay. Journal of the Experimental Analysis of Behavior, 39, 257-266.
56. RODRIGUEZ, M. L., & LOGUE, A. W. (1988). Adjusting delay to reinforcement: Comparing choice in pigeons and humans. Journal of Experimental Psychology: Animal Behavior Processes, 14, 105-117.
57. SHERMAN, J. A., & THOMAS, J. R. (1968). Some factors controlling preference between fixed-ratio and variable-ratio schedules of reinforcement. Journal of the Experimental Analysis of Behavior, 11, 689-702.
58. SHULL, R. L., & SPEAR, D. J. (1987). Detention time after reinforcement: Effects due to delay of reinforcement? In M. L. Commons, J. E. Mazur, J. A. Nevin, & H. Rachlin (Eds.), Quantitative analyses of behavior: Vol. 5. The effect of delay and of intervening events on reinforcement value (pp. 187-204). Hillsdale, NJ: Erlbaum.
59. SOLNICK, J. V., KANNENBERG, C. H., ECKERMAN, D. A., & WALLER, M. B. (1980). An experimental analysis of impulsivity and impulse control in humans. Learning & Motivation, 11, 61-77.
60. SPETCH, M. L., BELKE, T. W., BARNET, R. C., DUNN, R., & PIERCE, W. D. (1990). Suboptimal choice in a percentage-reinforcement procedure: Effects of signal condition and terminal-link length. Journal of the Experimental Analysis of Behavior, 53, 219-234.
61. SPETCH, M. L., MONDLOCH, M. V., BELKE, T. W., & DUNN, R. (1994). Determinants of pigeons' choice between certain and probabilistic outcomes. Animal Learning & Behavior, 22, 239-251.
62. SQUIRES, N., & FANTINO, E. (1971). A model for choice in simple concurrent and concurrent-chains schedules. Journal of the Experimental Analysis of Behavior, 15, 27-38.
63. WILLIAMS, B. A., & DUNN, R. (1991). Preference for conditioned reinforcement. Journal of the Experimental Analysis of Behavior, 55, 37-46.
64. WILLIAMS, B. A., & FANTINO, E. (1978). Effects on choice of reinforcement delay and conditioned reinforcement. Journal of the Experimental Analysis of Behavior, 29, 77-86.