A decision model for steady-state choice in concurrent chains

Journal of the Experimental Analysis of Behavior

Volumn 94, Issue 2, 2010, Pages 227-240

  Christensen, Darren R ^a   Grace, Randolph C ^a,b  

^a UNIVERSITY OF MELBOURNE   (Australia)

^b UNIVERSITY OF CANTERBURY   (New Zealand)

Author keywords

Acquisition; Choice; Concurrent chains; Conditioned reinforcement; Contextual choice model; Decision model; Hyperbolic value added model; Key peck; Pigeons

Indexed keywords

ANIMAL; ARTICLE; DECISION MAKING; DISCRIMINATION LEARNING; INSTRUMENTAL CONDITIONING; PIGEONS AND DOVES; PSYCHOLOGICAL MODEL; REINFORCEMENT; TIME;

ANIMALS; CHOICE BEHAVIOR; COLUMBIDAE; CONDITIONING, OPERANT; DECISION MAKING; DISCRIMINATION LEARNING; MODELS, PSYCHOLOGICAL; REINFORCEMENT (PSYCHOLOGY); TIME FACTORS;

EID: 78049265959     PISSN: 00225002     EISSN: None     Source Type: Journal    
DOI: 10.1901/jeab.2010.94-227     Document Type: Article

References (51)

1. Alsop, B., & Davison, M. (1988). Concurrent-chain performance: Effects of absolute and relative terminal-link entry frequency. Journal of the Experimental Analysis of Behavior, 49, 351-365.
2. Baum, W. M. (1974). On two types of deviation from the matching law: Bias and undermatching. Journal of the Experimental Analysis of Behavior, 22, 231-242.
3. Berg, M. E., & Grace, R. C. (2006). Initial-link duration and acquisition of preference in concurrent chains. Learning & Behavior, 34, 50-60.
4. Christensen, D. R., & Grace, R. C. (2008). Rapid acquisition in concurrent chains: Effects of initial-link duration. Behavioural Processes, 78, 217-223.
5. Christensen, D. R., & Grace, R. C. (2009a). Response allocation in a rapid-acquisition concurrent-chains procedure: Effects of overall terminal-link duration. Behavioural Processes, 81, 233-237.
6. Christensen, D. R., & Grace, R. C. (2009b). Response allocation in concurrent chains when terminal-link delays follow an ascending and descending series. Journal of the Experimental Analysis of Behavior, 91, 1-20.
7. Chung, S.-H., & Herrnstein, R. J. (1967). Choice and delay of reinforcement. Journal of the Experimental Analysis of Behavior, 10, 67-74.
8. Davison, M. C. (1976). Preference for fixed-interval schedules: Effects of unequal initial links. Journal of the Experimental Analysis of Behavior, 25, 371-376.
9. Davison, M. (1983). Bias and sensitivity to reinforcement in a concurrent-chain schedule. Journal of the Experimental Analysis of Behavior, 40, 15-34.
10. Davison, M. C. (1988). Delay of reinforcers in a concurrent-chain schedule: An extension of the hyperbolicdecay model. Journal of the Experimental Analysis of Behavior, 50, 219-236.
11. Davison, M., & McCarthy, D. (1988). The Matching Law: A Research Review. Hillsdale, NJ: Lawrence Erlbaum.
12. Davison, M. C., & Temple, W. (1973). Preference for fixedinterval schedules: An alternative model. Journal of the Experimental Analysis of Behavior, 20, 393-403.
13. Duncan, B., & Fantino, E. (1970). Choice for periodic schedules of reinforcement. Journal of the Experimental Analysis of Behavior, 14, 73-86.
14. Dunn, R., & Fantino, E. (1982). Choice and the relative immediacy of reinforcement. Journal of the Experimental Analysis of Behavior, 38, 321-326.
15. Fantino, E. (1969). Choice and rate of reinforcement. Journal of the Experimental Analysis of Behavior, 12, 723-730.
16. Fantino, E., & Davison, M. (1983). Choice: Some quantitative relations. Journal of the Experimental Analysis of Behavior, 40, 1-13.
17. Fantino, E., Preston, R. A., & Dunn, R. (1993). Delay reduction: Current status. Journal of the Experimental Analysis of Behavior, 60, 159-169.
18. Fantino, E., & Romanowich, P. (2007). The effect of conditioned reinforcement rate on choice: A review. Journal of the Experimental Analysis of Behavior, 87, 409-421.
19. Fantino, E., & Royalty, P. (1987). A molecular analysis of choice on concurrent-chains schedules. Journal of the Experimental Analysis of Behavior, 48, 145-159.
20. Fleshler, M., & Hoffman, M. (1962). A progression for generating variable-interval schedules. Journal of the Experimental Analysis of Behavior, 5, 529-530.
21. Gallistel, C. R., & Gibbon, J. (2000). Time, rate, and conditioning. Psychological Review, 107, 289-344.
22. Gallistel, C. R., Mark, T. A., King, A. P., & Latham, P. E. (2001). The rat approximates an ideal detector of changes in rates of reward: Implications for the law of effect. Journal of Experimental Psychology: Animal Behavior Processes, 27, 354-372.
23. Gentry, G. D., & Marr, M. J. (1980). Choice and reinforcement delay. Journal of the Experimental Analysis of Behavior, 33, 27-37.
24. Gibbon, J. (1977). Scalar expectancy theory and Weber's law in animal timing. Psychological Review, 84, 279-325.
25. Gibbon, J., Church, R. M., Fairhurst, S., & Kacelnik, A. (1988). Scalar expectancy theory and choice between delayed rewards. Psychological Review, 95, 102-114.
26. Grace, R. C. (1994). A contextual model of concurrentchains choice. Journal of the Experimental Analysis of Behavior, 61, 113-129.
27. Grace, R. C. (2002). The value hypothesis and acquisition of preference in concurrent chains. Animal Learning & Behavior, 30, 21-33.
28. Grace, R. C. (2004). Temporal context in concurrent chains: I. Terminal-link duration. Journal of the Experimental Analysis of Behavior, 81, 215-237.
29. Grace, R. C., & Bragason, O. (2004). Does the terminallink effect depend on duration or reinforcement rate? Behavioural Processes, 67, 67-79.
30. Grace, R. C., Bragason, O., & McLean, A. P. (2003). Rapid acquisition of preference in concurrent chains. Journal of the Experimental Analysis of Behavior, 80, 235-252.
31. Grace, R. C., & McLean, A. P. (2006). Rapid acquisition in concurrent chains: Evidence for a decision model. Journal of the Experimental Analysis of Behavior, 85, 181-202.
32. Grace, R. C., & Nevin, J. A. (1999). Timing and choice in concurrent chains. Behavioural Processes, 45, 115-127.
33. Aperiodicity as a factor in choice
34. Hunter, I., & Davison, M. (1985). Determination of a behavioral transfer function: White-noise analysis of session-to-session response-ratio dynamics on concurrent VI VI schedules. Journal of the Experimental Analysis of Behavior, 43(1), 43-59.
35. Killeen, P. (1968). On the measurement of reinforcement frequency in the study of preference. Journal of the Experimental Analysis of Behavior, 11, 263-269.
36. Killeen, P. (1970). Preference for fixed-interval schedules of reinforcement. Journal of the Experimental Analysis of Behavior, 14, 127-131.
37. Killeen, P. (1981). Averaging theory. In C. Bradshaw, E. Szabadi, & C. Lowe (Eds.), Quantification of steady state operant behavior (pp. 21-34). North Holland, Amsterdam: Elsevier.
38. Kyonka, E. G. E., & Grace, R. C. (2007). Rapid acquisition of choice and timing in pigeons. Journal of Experimental Psychology: Animal Behavior Processes, 33, 392-408.
39. Kyonka, E. G. E., & Grace, R. C. (2008). Rapid acquisition of preference in concurrent chains when alternatives differ on multiple dimensions of reinforcement. Journal of the Experimental Analysis of Behavior, 89, 49-69.
40. MacEwen, D. (1972). The effects of terminal-link fixedinterval and variable-interval schedules on responding under concurrent chained schedules. Journal of the Experimental Analysis of Behavior, 18, 253-261.
41. Mazur, J. E. (1984). Tests for an equivalence rule for fixed and variable reinforcer delays. Journal of Experimental Psychology: Animal Behavior Processes, 10, 426-436.
42. Mazur, J. E. (2001). Hyperbolic value addition and general models of animal choice. Psychological Review, 108, 96-112.
43. Nevin, J. A. (1984). Quantitative analysis. Journal of the Experimental Analysis of Behavior, 42, 421-434.
44. Omino, T., & Ito, M. (1993). Choice and delay of reinforcement: Effects of terminal-link stimulus and response conditions. Journal of the Experimental Analysis of Behavior, 59, 361-371.
45. Preston, R. A., & Fantino, E. (1991). Conditioned reinforcement value and choice. Journal of the Experimental Analysis of Behavior, 55, 155-175.
46. Roberts, S. (1981). Isolation of an internal clock. Journal of Experimental Psychology: Animal Behavior Processes, 7, 242-268.
47. Schofield, G., & Davison, M. (1997). Nonstable concurrent choice in pigeons. Journal of the Experimental Analysis of Behavior, 68, 219-232.
48. Squires, N., & Fantino, E. (1971). A model for choice in simple concurrent and concurrent-chains schedules. Journal of the Experimental Analysis of Behavior, 15, 27-38.
49. Sutton, N. P., Grace, R. C., McLean, A. P., & Baum, W. M. (2008). Comparing the generalized matching law and contingency discriminability model as accounts of concurrent schedule performance using residual meta-analysis. Behavioural Processes, 78, 224-230.
50. Wardlaw, G. R., & Davison, M. C. (1974). Preference for fixed-interval schedules: Effects of initial-link length. Journal of the Experimental Analysis of Behavior, 21, 331-340.
51. Williams, B. A., & Fantino, E. (1978). Effects on choice of reinforcement delay and conditioned reinforcement. Journal of the Experimental Analysis of Behavior, 29, 77-86.