The effect of rate of reinforcement and time in session on preference for variability

Learning and Behavior

Volumn 31, Issue 3, 2003, Pages 225-241

  McSweeney, Frances K ^a   Kowal, Benjamin P ^a   Murphy, Eric S ^a  

^a WASHINGTON STATE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMAL BEHAVIOR; ANIMAL EXPERIMENT; ARTICLE; CONTROLLED STUDY; ENERGY BALANCE; FEMALE; FOOD DEPRIVATION; HABITUATION; LIGHT DARK CYCLE; MALE; MODEL; NONHUMAN; PIGEON; REINFORCEMENT; THEORY; TIME;

EID: 0141557918     PISSN: 15434494     EISSN: None     Source Type: Journal    
DOI: 10.3758/bf03195985     Document Type: Article

References (84)

1. AHEARN, W., HINELINE, P. N., & DAVID, F. G. (1992). Relative preferences for various bivalued ratio schedules. Animal Learning & Behavior, 20, 407-415.
2. AOYAMA, K., & MCSWEENEY, F. K. (2001). Habituation may contribute to within-session decreases in responding under high-rate schedules of reinforcement. Animal Learning & Behavior, 29, 79-91.
3. AUTOR, S. M. (1969). The strength of conditioned reinforcers as a function of frequency and probability of reinforcement. In D. P. Hendry (Ed.), Conditioned reinforcement (pp. 127-162). Homewood, IL: Dorsey.
4. BACOTTI, A. V. (1977). Matching under concurrent fixed-ratio variable-interval schedules of food presentation. Journal of the Experimental Analysis of Behavior, 27, 171-182.
5. BATESON, M., & KACELNIK, A. (1995). Preferences for fixed and variable food sources: Variability in amount and delay. Journal of the Experimental Analysis of Behavior, 63, 313-329.
6. BATESON, M., & KACELNIK, A. (1997). Starlings' preferences for predictable and unpredictable delays to food. Animal Behaviour, 53, 1129-1142.
7. BATTALIO, R. C., KAGEL, J. H., & MACDONALD, D. N. (1985). Animals' choices over uncertain outcomes: Some initial experimental results. American Economic Review, 75, 597-613.
8. BAUM, W. M. (1974). On two types of deviation from the matching law: Bias and undermatching. Journal of the Experimental Analysis of Behavior, 22, 231-242.
9. BEDNEKOFF, P. A. (1996). Risk-sensitive foraging, fitness, and life histories: Where does reproduction fit into the big picture? American Zoologist, 36, 471-483.
10. BROSTER, B. S., & RANKIN, C. H. (1994). Effects of changing interstimulus interval during habituation in Caenorhabditis elegans. Behavioral Neuroscience, 108, 1019-1029.
11. CARACO, T. (1980). On foraging time allocation in a stochastic environment. Ecology, 61, 119-128.
12. CARACO, T., BLANCKENHORN, W. U., GREGORY, G. M., NEWMAN, J. A., RECER, G. M., & ZWICKER, S. M. (1990). Risk-sensitivity: Ambient temperature affects foraging choice. Animal Behaviour, 39, 338-345.
13. CARACO, T., MARTINDALE, S., & WHITTAM, T. S. (1980). An empirical demonstration of risk-sensitive foraging preferences. Animal Behaviour, 28, 820-830.
14. CARTAR, R. V., & DILL, L. M. (1990). Why are bumble bees risk-sensitive foragers? Behavioral Ecology & Sociobiology, 26, 121-127.
15. CASE, D. A., NICHOLS, P., & FANTINO, E. (1995). Pigeons' preference for variable-interval water reinforcement under widely varied water budgets. Journal of the Experimental Analysis of Behavior, 64, 299-311.
16. CICERONE, R. A. (1976). Preference for mixed versus constant delay of reinforcement. Journal of the Experimental Analysis of Behavior, 25, 257-261.
17. DAVIS, M. (1970). Effects of interstimulus interval length and variability on startle-response habituation in the rat. Journal of Comparative & Physiological Psychology, 72, 177-192.
18. DAVISON, M. C. (1969). Preference for mixed-interval versus fixed-interval schedules. Journal of the Experimental Analysis of Behavior, 12, 247-252.
19. DAVISON, M. C. (1972). Preference for mixed-interval versus fixed-interval schedules: Number of component intervals. Journal of the Experimental Analysis of Behavior, 17, 169-176.
20. DUNCAN, B., & FANTINO, E. (1970). Choice for periodic schedules of reinforcement. Journal of the Experimental Analysis of Behavior, 14, 73-86.
21. ESSOCK, S. M., & REESE, E. P. (1974). Preference for and effects of variableas opposed to fixed-reinforcer duration. Journal of the Experimental Analysis of Behavior, 21, 89-97.
22. FANTINO, E. (1967). Preference for mixed-versus fixed-ratio schedules. Journal of the Experimental Analysis of Behavior, 10, 35-43.
23. FANTINO, E. (1969). Choice and rate of reinforcement. Journal of the Experimental Analysis of Behavior, 12, 723-730.
24. FANTINO, E., & DAVISON, M. (1983). Choice: Some quantitative relations. Journal of the Experimental Analysis of Behavior, 40, 1-13.
25. FLESHLER, M., & HOFFMAN, H. S. (1962). A progression for generating variable-interval schedules. Journal of the Experimental Analysis of Behavior, 5, 529-530.
26. FRANKEL, P. W., & VOM SAAL, W. (1976). Preference between fixed-interval and variable-interval schedules of reinforcement: Separate roles of temporal scaling and predictability. Animal Learning & Behavior, 4, 71-76.
27. GIBBON, J. (1977). Scalar expectancy theory and Weber's Law in animal timing. Psychological Review, 84, 279-325.
28. GRACE, R. C. (1994). A contextual model of concurrent-chains choice. Journal of the Experimental Analysis of Behavior, 61, 113-129.
29. GRACE, R. C. (1996). Choice between fixed and variable delays to reinforcement in the adjusting-delay procedure and concurrent chains. Journal of Experimental Psychology: Animal Behavior Processes, 22, 362-383.
30. GRAHAM, F. K. (1973). Habituation and dishabituation of responses innervated by the autonomic nervous system. In H. V. S. Peeke & M. J. Herz (Eds.), Habituation: Vol. 1. Behavioral studies (pp. 163-218). New York: Academic Press.
31. HA, J. C. (1991). Risk-sensitive foraging: The role of ambient temperature and foraging time. Animal Behaviour, 41, 528-529.
32. HA, J. C., LEHNER, P. N., & FARLEY, S. D. (1990). Risk-prone foraging behaviour in captive grey jays, Perisoreus canadensis. Animal Behaviour, 39, 91-96.
33. HAMM, S. L., & SHETTLEWORTH, S. J. (1987). Risk aversion in pigeons. Journal of Experimental Psychology: Animal Behavior Processes, 13, 376-383.
34. HASTJARJO, T., SILBERBERG, A., & HURSH, S. R. (1990). Risky choice as a function of amount and variance in food supply. Journal of the Experimental Analysis of Behavior, 53, 155-161.
35. HERRNSTEIN, R. J. (1964). Aperiodicity as a factor in choice. Journal of the Experimental Analysis of Behavior, 7, 179-182.
36. HOUSTON, A. I., & MCNAMARA, J. M. (1982). A sequential approach to risk-taking. Animal Behaviour, 30, 1260-1261.
37. HURLY, T. A., & OSEEN, M. D. (1999). Context-dependent, risk-sensitive foraging preferences in wild rufous hummingbirds. Animal Behaviour, 58, 59-66.
38. HURSH, S. R., & FANTINO, E. (1973). Relative delay of reinforcement and choice. Journal of the Experimental Analysis of Behavior, 19, 437-450.
39. ITO, M., TAKATSURU, S., & SAEKI, D. (2000). Choice between constant and variable alternatives by rats: Effects of different reinforcer amounts and energy budgets. Journal of the Experimental Analysis of Behavior, 73, 79-92.
40. KACELNIK, A., & BATESON, M. (1996). Risky theories: The effects of variance on foraging decisions. American Zoologist, 36, 402-434.
41. KAGEL, J. H., MACDONALD, D. N., BATTALIO, R. C., WHITE, S., & GREEN, L. (1996). Risk aversion in rats (Rattus norvegicus) under varying levels of resource availability. Journal of Comparative Psychology, 100, 95-100.
42. KILLEEN, P. (1968). On the measurement of reinforcement frequency in the study of preference. Journal of the Experimental Analysis of Behavior, 11, 263-269.
43. LAMING, P. R., & MCKINNEY, S. J. (1990). Habituation in goldfish (Carassius auratus) is impaired by increased interstimulus interval, interval variability, and telencephalic ablation. Behavioral Neuroscience, 104, 869-875.
44. LAWES, M. J., & PERRIN, M. R. (1995). Risk-sensitive foraging behaviour of the round-eared elephant shrew (Macroscelides proboscideus). Behavioral Ecology & Sociobiology, 37, 31-37.
45. LEVENTHAL, A. M., MORRELL, R. F., MORGAN, E. F., JR., & PERKINS, C. C., JR. (1959). The relation between mean reward and mean reinforcement. Journal of Experimental Psychology, 57, 284-287.
46. LOBB, B., & DAVISON, M. C. (1975). Performance in concurrent interval schedules: A systematic replication. Journal of the Experimental Analysis of Behavior, 24, 191-197.
47. LOGAN, F. A. (1965). Decision making by rats: Uncertain outcome choices. Journal of Comparative & Physiological Psychology, 59, 246-251.
48. MACEWEN, D. (1972). The effects of terminal-link fixed-interval and variable-interval schedules on responding under concurrent chained schedules. Journal of the Experimental Analysis of Behavior, 18, 253-261.
49. MAZUR, J. E. (1984). Tests of an equivalence rule for fixed and variable reinforcer delays. Journal of Experimental Psychology: Animal Behavior Processes, 10, 426-436.
50. MAZUR, J. E. (1986). Fixed and variable ratios and delays: Further tests of an equivalence rule. Journal of Experimental Psychology: Animal Behavior Processes, 12, 116-124.
51. MAZUR, J. E. (1988). Choice between small certain and large uncertain reinforcers. Animal Learning & Behavior, 16, 199-205.
52. MAZUR, J. E. (2001). Hyperbolic value addition and general models of animal choice. Psychological Review, 108, 96-112.
53. MCNAMARA, J. M. (1996). Risk-prone behavior under rules which have evolved in a changing environment. American Zoologist, 36, 484-495.
54. MCSWEENEY, F. K. (1992). Rate of reinforcement and session duration as determinants of within-session patterns of responding. Animal Learning & Behavior, 20, 160-169.
55. MCSWEENEY, F. K., HINSON, J. M., & CANNON, C. B. (1996). Sensitization-habituation may occur during operant conditioning. Psychological Bulletin, 120, 256-271.
56. MCSWEENEY, F. K., MURPHY, E. S., & KOWAL, B. P. (2001). Within-session changes in responding during concurrent variable interval variable ratio schedules. Behavioural Processes, 55, 163-169.
57. MCSWEENEY, F. K., ROLL, J. M., & CANNON, C. B. (1994). The generality of within-session patterns of responding: Rate of reinforcement and session length. Animal Learning & Behavior, 22, 252-266.
58. MCSWEENEY, F. K., ROLL, J. M., & WEATHERLY, J. N. (1994). Within-session changes in responding during several simple schedules. Journal of the Experimental Analysis of Behavior, 62, 109-132.
59. MCSWEENEY, F. K., SWINDELL, S., & WEATHERLY, J. N. (1996). Within-session changes in responding during concurrent schedules with different reinforcers in the components. Journal of the Experimental Analysis of Behavior, 66, 369-390.
60. MCSWEENEY, F. K., SWINDELL, S., & WEATHERLY, J. N. (1999). Within-session changes in responding during concurrent fixed interval variable interval schedules. Animal Learning & Behavior, 27, 236-248.
61. MCSWEENEY, F. K., WEATHERLY, J. N., & ROLL, J. M. (1995). Within-session changes in responding during concurrent schedules that employ two different operanda. Animal Learning & Behavior, 23, 237-244.
62. MCSWEENEY, F. K., WEATHERLY, J. N., & SWINDELL, S. (1996). Within-session changes in responding during concurrent variable-interval schedules. Journal of the Experimental Analysis of Behavior, 66, 75-95.
63. MENLOVE, R. L., INDEN, H. M., & MADDEN, E. G. (1979). Preference for fixed over variable access to food. Animal Learning & Behavior, 7,499-503.
64. MORRIS, C. J. (1986). The effects of occasional short (FR 1) reinforcement ratios on choice behavior. Psychological Record, 36, 63-68.
65. NAVARICK, D. J., & FANTINO, E. (1972). Transitivity as a property of choice. Journal of the Experimental Analysis of Behavior, 18, 389-401.
66. NAVARICK, D. J., & FANTINO, E. (1974). Stochastic transitivity and unidimensional behavior theories. Psychological Review, 81, 426-441.
67. NAVARICK, D. J., & FANTINO, E. (1975). Stochastic transitivity and the unidimensional control of choice. Learning & Motivation, 6, 179-201.
68. PEREZ, S. M., & WADDINGTON, K. D. (1996). Carpenter bee (Xylocopa micans) risk indifference and a review of nectivore risk-sensitivity studies. American Zoologist, 36, 435-446.
69. PUBOLS, B. H., JR. (1962). Constant versus variable delay of reinforcement. Journal of Comparative & Physiological Psychology, 55, 52-56.
70. REBOREDA, J. C., & KACELNIK, A. (1991). Risk sensitivity in starlings: Variability in food amount and food delay. Behavioral Ecology, 2, 301-308.
71. RIDER, D. P. (1979). Concurrent ratio schedules: Fixed vs. variable response requirements. Journal of the Experimental Analysis of Behavior, 31, 225-237.
72. RIDER, D. P. (1981). Concurrent fixed-interval variable-ratio schedules and the matching relation. Journal of the Experimental Analysis of Behavior, 36, 317-328.
73. RIDER, D. P. (1983a). Choice for aperiodic versus periodic ratio schedules: A comparison of concurrent and concurrent-chains procedures. Journal of the Experimental Analysis of Behavior, 40, 225-237.
74. RIDER, D. P. (1983b). Preference for mixed versus constant delays of reinforcement: Effect of probability of the short, mixed delay. Journal of the Experimental Analysis of Behavior, 39, 257-266.
75. SHAFIR, S., WIEGMANN, D. D., SMITH, B. H., & REAL, L. A. (1999). Risk-sensitive foraging: Choice behavior of honeybees in response to variability in volume of reward. Animal Behaviour, 53, 1055-1061.
76. SHERMAN, J. A., & THOMAS, J. R. (1968). Some factors controlling preference between fixed-ratio and variable-ratio schedules of reinforcement. Journal of the Experimental Analysis of Behavior, 11, 689-702.
77. STADDON, J. E. R., & INNIS, N. K. (1966). Preference for fixed vs. variable amounts of reward. Psychonomic Science, 4, 193-194.
78. STEPHENS, D. W., & CHARNOV, E. L. (1982). Optimal foraging: Some simple stochastic models. Behavioral Ecology & Sociobiology, 10, 251-263.
79. STUBBS, D. A., & PLISKOFF, S. S. (1969). Concurrent responding with fixed relative rate of reinforcement. Journal of the Experimental Analysis of Behavior, 12, 887-895.
80. THOMPSON, R. F., & SPENCER, W. A. (1966). Habituation: A model phenomenon for the study of neuronal substrates of behavior. Psychological Review, 73, 16-43.
81. TREVETT, A. J., DAVISON, M. C., & WILLIAMS, R. J. (1972). Performance in concurrent interval schedules. Journal of the Experimental Analysis of Behavior, 17, 369-374.
82. WILLIAMS, B. A., & FANTINO, E. (1978). Effects on choice of reinforcement delay and conditioned reinforcement. Journal of the Experimental Analysis of Behavior, 29, 77-86.
83. YOUNG, J. S. (1981). Discrete-trial choice in pigeons: Effects of reinforcer magnitude. Journal of the Experimental Analysis of Behavior, 35, 23-29.
84. ZABLUDOFF, S. D., WECKER, J., & CARACO, T. (1988). Foraging choice in laboratory rats: Constant vs. variable delay. Behavioural Processes, 16, 95-110.