Temporal context and conditioned reinforcement value

Journal of Experimental Psychology: General

Volumn 129, Issue 4, 2000, Pages 427-443

  Grace, Randolph C ^b   Savastano, Hernán I ^a  

^a BINGHAMTON UNIVERSITY   (United States)

^b UNIVERSITY OF CANTERBURY   (New Zealand)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMAL; ARTICLE; INSTRUMENTAL CONDITIONING; PIGEONS AND DOVES; PSYCHOLOGICAL MODEL; REINFORCEMENT; TIME;

ANIMALS; COLUMBIDAE; CONDITIONING, OPERANT; MODELS, PSYCHOLOGICAL; REINFORCEMENT SCHEDULE; TIME FACTORS;

EID: 0034547265     PISSN: 00963445     EISSN: None     Source Type: Journal    
DOI: 10.1037/0096-3445.129.4.427     Document Type: Article

References (76)

1. Abarca, N., & Fantino, E. (1982). Choice and foraging. Journal of the Experimental Analysis of Behavior, 38, 117-123.
2. Antonitis, J. J. (1951). Response variability in the white rat during conditioning, extinction, and reconditioning. Journal of Experimental Psychology, 42, 273-281.
3. Autor, S. M. (1960). The strength of conditioned reinforcers as a function of frequency and probability of reinforcement. Unpublished doctoral dissertation, Harvard University.
4. Barnet, R. C., Grahame, N. J., & Miller, R. R. (1993). Local context and the comparator hypothesis. Animal Learning & Behavior, 21, 1-13.
5. Barnet, R. C., Grahame, N. J., & Miller, R. R. (1995). Trial spacing effects in Pavlovian conditioning: A role for local context. Animal Learning & Behavior, 21, 1-13.
6. Baum, W. M. (1974). On two types of deviation from the matching law: Bias and undermatching. Journal of the Experimental Analysis of Behavior, 22, 231-242.
7. Baum, W. M. (1979). Matching, undermatching, and overmatching in studies of choice. Journal of the Experimental Analysis of Behavior, 32, 269-281.
8. Belke, T. W. (1992). Stimulus preference and the transitivity of preference. Animal Learning & Behavior, 20, 401-406.
9. Catania, A. C. (1975). Freedom and knowledge: An experimental analysis of preference in pigeons. Journal of the Experimental Analysis of Behavior, 24, 89-106.
10. Davison, M. C. (1983). Bias and sensitivity to reinforcement in a concurrent-chain schedule. Journal of the Experimental Analysis of Behavior, 40, 15-34.
11. Davison, M. C. (1987). The analysis of concurrent-chain performance. In M. L. Commons, J. E. Mazur, J. A. Nevin, & H. Rachlin (Eds.), Quantitative analyses of behavior: Vol. 5. The effect of delay and of intervening events on reinforcement value (pp. 225-241). Hillsdale, NJ: Erlbaum.
12. Davison, M. C., & McCarthy, D. (1988). The matching law: A research review. Hillsdale, NJ: Erlbaum.
13. de Villiers, P. A. (1977). Choice in concurrent schedules and quantitative formulations of the law of effect. In W. K. Honig & J. E. R. Staddon (Eds.), Handbook of operant behavior (pp. 233-287). Englewood Cliffs, NJ: Prentice Hall.
14. Duncan, B., & Fantino, E. (1972). The psychological distance to reward. Journal of the Experimental Analysis of Behavior, 18, 23-34.
15. Durlach, P. J. (1989). Learning and performance in Pavlovian conditioning: Are failures of contiguity failures of learning or performance? In S. B. Klein & R. R. Mowrer (Eds.), Contemporary learning theories: Pavlovian conditioning and the status of traditional learning theory (pp. 19-59). Hillsdale, NJ: Erlbaum.
16. Egger, M. D., & Miller, N. E. (1962). Secondary reinforcement in rats as a function of information value and reliability of the stimulus. Journal of Experimental Psychology, 64, 97-104.
17. Fantino, E. (1969a). Conditioned reinforcement, choice, and the psychological distance to reward. In D. P. Hendry (Ed.), Conditioned reinforcement (pp. 163-191). Homewood, IL: The Dorsey Press.
18. Fantino, E. (1969b). Choice and rate of reinforcement. Journal of the Experimental Analysis of Behavior, 12, 723-730.
19. Fantino, E. (1977). Conditioned reinforcement: Choice and information. In W. K. Honig & J. E. R. Staddon (Eds.), Handbook of operant behavior (pp. 313-339). Englewood Cliffs, NJ: Prentice Hall.
20. Fantino, E. (1981). Contiguity, response strength, and the delay-reduction hypothesis. In P. Harzem & M. D. Zeiler (Eds.), Advances in analysis of behaviour: Vol. 2. Predictability, correlation, and contiguity (pp. 169-201). Chichester, England: Wiley.
21. Fantino, E., & Abarca, N. (1985). Choice, optimal foraging, and the delay-reduction hypothesis. Behavioral and Brain Sciences, 8, 315-330.
22. Fantino, E., & Dunn, R. (1983). The delay-reduction hypothesis: Extension to three-alternative choice. Journal of Experimental Psychology: Animal Behavior Processes, 9, 132-146.
23. Fantino, E., & Navarick, D. J. (1974). Recent developments in choice. In G. H. Bower (Ed.), The psychology of learning and motivation (Vol. 8, pp. 147-185). New York: Academic Press.
24. Fantino, E., Preston, R. A., & Dunn, R. (1993). Delay reduction: Current status. Journal of the Experimental Analysis of Behavior, 60, 159-169.
25. Fleshler, M., & Hoffman, H. S. (1962). A progression for generating variable-interval schedules. Journal of the Experimental Analysis of Behavior, 5, 529-530.
26. Gallistel, C. R. (1990). The organization of learning. Cambridge, MA: MIT Press.
27. Garner, W. R. (1954). Context effects and the validity of loudness scales. Journal of Experimental Psychology, 48, 218-224.
28. Garner, W. R., Hake, H. W., & Eriksen, C. W. (1956). Operationism and the concept of perception. Psychological Review, 63, 149-159.
29. Gibbon, J. (1977). Scalar expectancy theory and Weber's law in animal timing. Psychological Review, 84, 279-325.
30. Gibbon, J. (1995). Dynamics of time matching: Arousal makes better seem worse. Psychonomic Bulletin & Review, 2, 208-215.
31. Gibbon, J., & Balsam, P. (1981). Spreading association in time. In C. M. Locurto, H. S. Terrace, & J. Gibbon (Eds.), Autoshaping and conditioning theory (pp. 219-253). New York: Academic Press.
32. Gibbon, J., Church, R. M., Fairhurst, S., & Kacelnik, A. (1988). Scalar expectancy theory and choice between delayed rewards. Psychological Review, 95, 102-114.
33. Grace, R. C. (1994). A contextual model of concurrent-chains choice. Journal of the Experimental Analysis of Behavior, 61, 113-129.
34. Grace, R. C. (1995). Independence of reinforcement delay and magnitude in concurrent chains. Journal of the Experimental Analysis of Behavior, 63, 255-276.
35. Grace, R. C. (1996). Choice between fixed and variable delays to reinforcement in the adjusting-delay procedure and concurrent chains. Journal of Experimental Psychology: Animal Behavior Processes, 22, 362-383.
36. Grace, R. C., & Savastano, H. I. (1997). Transfer tests of stimulus value in concurrent chains. Journal of the Experimental Analysis of Behavior, 68, 93-115.
37. Helson, H. (1964). Adaptation level theory: An experimental and systematic approach to behavior. New York: Harper & Row.
38. Hendry, D. P. (Ed.). (1969). Conditioned reinforcement. Homewood, IL: The Dorsey Press.
39. Herrnstein, R. J. (1961). Relative and absolute strength of response as a function of frequency of reinforcement. Journal of the Experimental Analysis of Behavior, 4, 267-272.
40. Herrnstein, R. J. (1964). Secondary reinforcement and rate of primary reinforcement. Journal of the Experimental Analysis of Behavior, 7, 27-36.
41. Herrnstein, R. J. (1970). On the law of effect. Journal of the Experimental Analysis of Behavior, 13, 243-266.
42. Houston, A. I., Sumida, B. H., & McNamara, J. M. (1987). The maximization of overall reinforcement rate on concurrent chains. Journal of the Experimental Analysis of Behavior, 48, 133-143.
43. Hursh, S., & Fantino, E. (1974). An appraisal of preference for multiple versus mixed schedules. Journal of the Experimental Analysis of Behavior, 22, 31-38.
44. Ito, M. (1985). Choice and amount of reinforcement in rats. Learning and Motivation, 16, 95-108.
45. Kahneman, D., & Tversky, A. (1979). Prospect theory: An analysis of decisions under risk. Econometrica, 47, 263-291.
46. Kendall, S. B. (1974). Preference for intermittent reinforcement. Journal of the Experimental Analysis of Behavior, 21, 463-473.
47. Killeen, P. (1968). On the measurement of reinforcement frequency in the study of preference. Journal of the Experimental Analysis of Behavior, 11, 263-269.
48. Killeen, P. (1982). Incentive theory: II. Models for choice. Journal of the Experimental Analysis of Behavior, 38, 217-232.
49. Kollins, S. H., Newland, M. C., & Critchfield, T. S. (1997). Human sensitivity to reinforcement in operant choice: How much do consequences matter? Psychonomic Bulletin & Review, 4, 208-220.
50. Lea, S. E. G. (1979). Foraging and reinforcement schedules in the pigeon: Optimal and non-optimal aspects of choice. Animal Behaviour, 27, 875-886.
51. Lockhead, G. (1992). Psychophysical scaling: Judgments of attributes or objects? Behavioral and Brain Sciences, 15, 543-558.
52. MacEwen, D. (1972). The effects of terminal-link fixed-interval and variable-interval schedules on responding under concurrent chained schedules. Journal of the Experimental Analysis of Behavior, 18, 253-261.
53. Mazur, J. E. (1984). Tests for an equivalence rule for fixed and variable reinforcer delays. Journal of Experimental Psychology: Animal Behavior Processes, 10, 426-436.
54. Miller, R. R., & Barnet, R. C. (1993). The role of time in elementary associations. Current Directions in Psychological Science, 2, 106-111.
55. Miller, R. R., & Matzel, L. D. (1988). The comparator hypothesis: A response rule for the expression of associations. In G. H. Bower (Ed.), The psychology of learning and motivation (Vol. 22, pp. 51-92). San Diego, CA: Academic Press.
56. Navarick, D. J., & Fantino, E. (1976). Self-control and general models of choice. Journal of Experimental Psychology: Animal Behavior Processes, 2, 75-87.
57. Preston, R. A., & Fantino, E. (1991). Conditioned reinforcement value and choice. Journal of the Experimental Analysis of Behavior, 55, 155-175.
58. Rachlin, H., & Green, L. (1972). Commitment, choice and self-control. Journal of the Experimental Analysis of Behavior, 17, 15-22.
59. Rescorla, R. A. (1968). Probability of shock in the presence and absence of CS in fear conditioning. Journal of Comparative and Physiological Psychology, 66, 1-5.
60. Rescorla, R. A. (1980). Pavlovian second-order conditioning: Studies in associative learning. Hillsdale, NJ: Erlbaum.
61. Rescorla, R. A., & Wagner, A. R. (1972). A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement. In A. H. Black & W. F. Prokasy (Eds.), Classical conditioning II: Current research and theory (pp. 64-99). New York: Appleton-Century-Crofts.
62. Savastano, H. I., & Fantino, E. (1996). Differences in delay, not ratios, control choice in concurrent chains. Journal of the Experimental Analysis of Behavior, 66, 97-116.
63. Spetch, M. L., Belke, T. W., Barnet, R. C., Dunn, R., & Pierce, W. D. (1990). Suboptimal choice in a percentage-reinforcement procedure: Effects of signal condition and terminal-link length. Journal of the Experimental Analysis of Behavior, 53, 219-234.
64. Spetch, M. L., & Dunn, R. (1987). Choice between reliable and unreliable outcomes: Mixed percentage-reinforcement in concurrent chains. Journal of the Experimental Analysis of Behavior, 47, 57-72.
65. Squires, N., & Fantino, E. (1971). A model for choice in simple concurrent and concurrent-chains schedules. Journal of the Experimental Analysis of Behavior, 15, 27-38.
66. Stubbs, D. A., & Pliskoff, S. S. (1969). Concurrent responding with fixed relative rate of reinforcement. Journal of the Experimental Analysis of Behavior, 12, 887-895.
67. Vaughan, W., Jr. (1985). Choice: A local analysis. Journal of the Experimental Analysis of Behavior, 43, 383-405.
68. White, K. G., & Pipe, M.-E. (1987). Sensitivity to reinforcer duration in a self-control procedure. Journal of the Experimental Analysis of Behavior, 48, 235-249.
69. Williams, B. A. (1988). Reinforcement, choice, and response strength. In R. C. Atkinson, R. J. Hermstein, G. Lindzey, & R. D. Luce (Eds.), Stevens' handbook of experimental psychology: Vol. 2. Learning and cognition (2nd ed., pp. 167-244). New York: Wiley.
70. Williams, B. A. (1994a). Reinforcement and choice. In N. J. Mackintosh (Ed.), Animal learning and cognition (pp. 81-108). San Diego, CA: Academic Press.
71. Williams, B. A. (1994b). Conditioned reinforcement: Neglected or outmoded explanatory construct? Psychonomic Bulletin & Review, 1, 457-475.
72. Williams, B. A., & Bell, M. C. (1996). Changeover behavior and preference in concurrent schedules. Journal of the Experimental Analysis of Behavior, 65, 513-526.
73. Williams, B. A., & Fantino, E. (1978). Effects on choice of reinforcement delay and conditioned reinforcement. Journal of the Experimental Analysis of Behavior, 29, 77-86.
74. Williams, B. A., & Royalty, P. (1989). A test of the melioration theory of matching. Journal of Experimental Psychology: Animal Behavior Processes, 15, 99-113.
75. Wixted, J. T. (1989). Nonhuman short-term memory: A quantitative reanalysis of selected findings. Journal of the Experimental Analysis of Behavior, 52, 409-426.
76. Yin, H., Barnet, R. C., & Miller, R. R. (1994). Trial spacing and trial distribution effects in Pavlovian conditioning: Contributions of a comparator mechanism. Journal of Experimental Psychology: Animal Behavior Processes, 20, 123-134.