Time, rate, and conditioning

Psychological Review

Volumn 107, Issue 2, 2000, Pages 289-344

  Gallistel, C R ^a   Gibbon, John ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b Box 951563 ^*

Author keywords

[No Author keywords available]

Indexed keywords

ANIMAL; APPETITE; BIOLOGICAL MODEL; INSTRUMENTAL CONDITIONING; PHYSIOLOGY; REACTION TIME; REINFORCEMENT; REVIEW;

ANIMALS; APPETITIVE BEHAVIOR; CONDITIONING, OPERANT; MODELS, BIOLOGICAL; REACTION TIME; REINFORCEMENT (PSYCHOLOGY);

EID: 0034169238     PISSN: 0033295X     EISSN: None     Source Type: Journal    
DOI: 10.1037/0033-295X.107.2.289     Document Type: Article

References (239)

1. Adams, C. D., & Dickinson, A. (1981). Instrumental responding following reinforcer devaluation. Quarterly Journal of Experimental Psychology: Comparative and Physiological Psychology, 33B, 109-121.
2. Anderson, N. H. (1969). Variation of CS-US interval in long-term avoidance conditioning in the rat with wheel turn and with shuttle tasks. Journal of Comparative and Physiological Psychology, 68, 100-106.
3. Annau, Z., & Kamin, L. (1961). The conditioned emotional response as a function of intensity of the US. Journal of Comparative and Physiological Psychology, 54, 428-432.
4. Aronson, L., Balsam, P. D., & Gibbon, J. (1991, November). Context value modulates levels of response recovery after random control training. Paper presented at the meeting of the Psychonomic Society, San Francisco.
5. Autor, S. M. (1969). The strength of conditioned reinforcers as a function of frequency and probability of reinforcement. In D. P. Hendry (Ed.), Conditioned reinforcement (pp. 127-162). Homewood, IL: Dorsey Press.
6. Baker, A. G., & Mackintosh, N. J. (1977). Excitatory and inhibitory conditioning following uncorrelated presentations of the CS and US. Animal Learning and Behavior, 5, 315-319.
7. Baker, A. G., & Mercier, P. (1989). Attention, retrospective processing and cognitive representations. In S. B. Klein & R. R. Mowrer (Eds.), Contemporary learning theories: Pavlovian conditioning and the status of traditional learning theory (pp. 85-116). Hillsdale, NJ: Erlbaum.
8. Balsam, P. (1985). The functions of context in learning and performance. In P. Balsam & A. Tomie (Eds.), Context and learning (pp. 1-21). Hillsdale, NJ: Erlbaum.
9. Balsam, P. D., & Payne, D. (1979). Intertrial interval and unconditioned stimulus durations in autoshaping. Animal Learning and Behavior, 7, 477-482.
10. Balsam, P., & Schwartz, A. L. (1981). Rapid contextual conditioning in autoshaping. Journal of Experimental Psychology: Animal Behavior Processes, 7, 382-393.
11. Barela, P. B. (1999). Theoretical mechanisms underlying the trial-spacing effect in Pavlovian fear conditioning. Journal of Experimental Psychology: Animal Behavior Processes, 25, 177-193.
12. Barnet, R. C., Arnold, H. M., & Miller, R. R. (1991). Simultaneous conditioning demonstrated in second-order conditioning: Evidence for similar associative structure in forward and simultaneous conditioning. Learning and Motivation, 22, 253-268.
13. Barnet, R. C., Cole, R. P., & Miller, R. R. (1997). Temporal integration in second-order conditioning and sensory preconditioning. Animal Learning and Behavior, 25, 221-233.
14. Barnet, R. C., Grahame, N. J., & Miller, R. R. (1993a). Local context and the comparator hypothesis. Animal Learning and Behavior, 21, 1-13.
15. Barnet, R. C., Grahame, N. J., & Miller, R. R. (1993b). Temporal encoding as a determinant of blocking. Journal of Experimental Psychology: Animal Behavior Processes, 19, 327-341.
16. Barnet, R. C., & Miller, R. R. (1996). Second-order excitation mediated by a backward conditioned inhibitor. Journal of Experimental Psychology: Animal Behavior Processes, 22, 279-296.
17. Bateson, M., & Kacelnik, A. (1995). Preferences for fixed and variable food sources: Variability in amount and delay. Journal of the Experimental Analysis of Behavior, 63, 313-329.
18. Bateson, M., & Kacelnik, A. (1996). Rate currencies and the foraging starling: The fallacy of the averages revisited. Behavioral Ecology, 7, 341-352.
19. Baum, W. M. (1981). Optimization and the matching law as accounts of instrumental behavior. Journal of the Experimental Analysis of Behavior, 36, 387-403.
20. Baum, W. M. (1992). In search of the feedback function for variable-interval schedules. Journal of the Experimental Analysis of Behavior, 57, 365-375.
21. Baum, W. M., & Rachlin, H. C. (1969). Choice as time allocation. Journal of the Experimental Analysis of Behavior, 12, 861-874.
22. Belke, T. W. (1992). Stimulus preference and the transitivity of preference. Animal Learning and Behavior, 20, 401-406.
23. Bevins, R. A., & Ayres, J. J. B. (1995). One-trial context fear conditioning as a function of the interstimulus interval. Animal Learning and Behavior, 23, 400-410.
24. Bouton, M. E. (1991). Context and retrieval in extinction and in other examples of interference in simple associative learning. In L. Dachowski & C. R. Flaherty (Eds.), Current topics in animal learning (pp. 25-53). Hillsdale, NJ: Erlbaum.
25. Bouton, M. E. (1993). Context, ambiguity, and classical conditioning. Current Directions in Psychological Science, 3, 49-53.
26. Bouton, M. E., & Ricker, S. T. (1994). Renewal of extinguished responding in a second context. Animal Learning and Behavior, 22, 317-324.
27. Brelsford, J., & Theios, J. (1965). Single-session conditioning of the nictitating membrane in the rabbit: Effect of intertrial interval. Psychonomic Science, 2, 81-82.
28. Brooks, D. C., Hale, B., Nelson, J. B., & Bouton, M. E. (1995). Reinstatement after counterconditioning. Animal Learning and Behavior, 23, 383-390.
29. Brown, P. L., & Jenkins, H. M. (1968). Autoshaping of the pigeon's key-peck. Journal of the Experimental Analysis of Behavior, 11, 1-8.
30. Brunner, D., Gallistel, C. R., Fairhurst, S., & Gibbon, J. (2000). Pretraining determines choice strategy in concurrent choice. Manuscript in preparation.
31. Brunner, D., & Gibbon, J. (1995). Value of food aggregates: Parallel versus serial discounting. Animal Behaviour, 50, 1627-1634.
32. Brunner, D., Gibbon, J., & Fairhurst, S. (1994). Choice between fixed and variable delays with different reward amounts. Journal of Experimental Psychology: Animal Behavior Processes, 20, 331-346.
33. Capaldi, E. J., & Miller, D. J. (1988). Counting in rats: Its functional significance and the independent cognitive processes that constitute it. Journal of Experimental Psychology: Animal Behavior Processes, 14, 3-17.
34. Catania, A. C. (1963). Concurrent performances: A baseline for the study of reinforcement magnitude. Journal of the Experimental Analysis of Behavior, 6, 299-300.
35. Catania, A. C. (1970). Reinforcement schedules and psychophysical judgments. In W. N. Schoenfeld (Ed.), Theory of reinforcement schedules (pp. 1-42). New York: Appleton-Century-Crofts.
36. Church, R. M., & Broadbent, H. A. (1990). Alternative representations of time, number, and rate. Cognition, 37, 55-81.
37. Church, R. M., & Deluty, M. Z. (1977). Bisection of temporal intervals. Journal of Experimental Psychology: Animal Behavior Processes, 3, 216-228.
38. Church, R. M., & Gibbon, J. (1982). Temporal generalization. Journal of Experimental Psychology: Animal Behavior Processes, 8, 165-186.
39. Church, R. M., Meck, W. H., & Gibbon, J. (1994). Application of scalar timing theory to individual trials. Journal of Experimental Psychology: Animal Behavior Processes, 20, 135-155.
40. Church, R. M., Miller, K. D., Meck, W. H., & Gibbon, J. (1991). Symmetrical and asymmetrical sources of variance in temporal generalization. Animal Learning and Behavior, 19, 207-214.
41. Churchland, P. S., & Sejnowski, T. J. (1992). The computational brain. Cambridge, MA: MIT Press.
42. Clayton, N. S., & Dickinson, A. (1998). Episodic-like memory during cache recovery by scrub jays. Nature, 395, 272-274.
43. Clayton, N. S., & Dickinson, A. (1999). Memory for the content of caches by scrub jays (Aphelocoma coerulescens). Journal of Experimental Psychology: Animal Behavior Processes, 25, 82-91.
44. Cole, R. P., Barnet, R. C., & Miller, R. R. (1995a). Effect of relative stimulus validity: Learning or performance deficit? Journal of Experimental Psychology: Animal Behavior Processes, 21, 293-303.
45. Cole, R. P., Barnet, R. C., & Miller, R. R. (1995b). Temporal encoding in trace conditioning. Animal Learning and Behavior, 23, 144-153.
46. Colwill, R. M. (1993). Signaling the omission of a response-contingent outcome reduces discriminative control. Animal Learning and Behavior, 21, 337-345.
47. Colwill, R. M., Absher, R. A., & Roberts, M. L. (1988). Context-US learning in Aplysia californica. Journal of Neuroscience, 8, 4434-4439.
48. Colwill, R. M., & Delamater, B. A. (1995). An associative analysis of instrumental biconditional discrimination learning. Animal Learning and Behavior, 23, 218-233.
49. Colwill, R., & Rescorla, R. (1986). Associative structures in instrumental learning. In G. H. Bower (Ed.), Psychology of learning and motivation (Vol. 20, pp. 55-104). New York: Academic Press.
50. Commons, M. L., Herrnstein, R. J., & Rachlin, H. (Eds.). (1982). Quantitative analyses of behavior: Vol. 2. Matching and maximizing accounts. Cambridge, MA: Ballinger Press.
51. Cooper, L. D., Aronson, L., Balsam, P. D., & Gibbon, J. (1990). Duration of signals for intertrial reinforcement and nonreinforcement in random control procedures. Journal of Experimental Psychology: Animal Behavior Processes, 16, 14-26.
52. Davis, D. G., Staddon, J. E., Machado, A., & Palmer, R. G. (1993). The process of recurrent choice. Psychological Review, 100, 320-341.
53. Davison, M. C. (1969). Preference for mixed-interval versus fixed-interval schedules. Journal of the Experimental Analysis of Behavior, 12, 247-252.
54. Davison, M. C. (1988). Concurrent schedules: Interactions of reinforcer and frequency and reinforcer duration. Journal of the Experimental Analysis of Behavior, 49, 339-349.
55. Davison, M., & McCarthy, D. (1988). The matching law: A research review. Hillsdale, NJ: Erlbaum.
56. Devenport, L. D., & Devenport, J. A. (1994). Time-dependent averaging of foraging information in least chipmunks and golden-mantled squirrels. Animal Behaviour, 47, 787-802.
57. Dews, P. B. (1970). The theory of fixed-interval responding. In W. N. Schoenfeld (Ed.), The theory of reinforcement schedules (pp. 43-61). New York: Appleton-Century-Crofts.
58. Dickinson, A. (1989). Expectancy theory in animal conditioning. In S. B. Klein & R. R. Mowrer (Eds.), Contemporary learning theories: Pavlovian conditioning and the status of traditional learning theory (pp. 279-308). Hillsdale, NJ: Erlbaum.
59. Dickinson, A., & Burke, J. (1996). Within-compound associations mediate the retrospective revaluation of causality judgements. Quarterly Journal of Experimental Psychology: Comparative and Physiological Psychology, 49B, 60-80.
60. Dickinson, A., Hall, G., & Mackintosh, N. J. (1976). Surprise and the attenuation of blocking. Journal of Experimental Psychology: Animal Behavior Processes, 2, 213-222.
61. Durlach, P. J. (1983). Effect of signaling intertrial unconditioned stimuli in autoshaping. Journal of Experimental Psychology: Animal Behavior Processes, 9, 374-389.
62. Durlach, P. J. (1986). Explicitly unpaired procedure as a response elimination technique in autoshaping. Journal of Experimental Psychology: Animal Behavior Processes, 12, 172-185.
63. Durlach, P. J. (1989). Role of signals for unconditioned stimulus absence in the sensitivity of autoshaping to contingency. Journal of Experimental Psychology: Animal Behavior Processes, 15, 202-211.
64. Edmon, E. L., Lucki, I., & Grisham, M. G. (1980). Choice responding following multiple schedule training. Animal Learning and Behavior, 8, 287-292.
65. Fanselow, M. S. (1986). Associative vs topographical accounts of the immediate-shock freezing deficit in rats: Implications for the response selection rules governing species-specific defensive reactions. Learning and Motivation, 17, 16-39.
66. Fanselow, M. S. (1989). The adaptive function of conditioned defensive behavior: An ecological approach to Pavlovian stimulus-substitution theory. In R. J. Blanchard, P. F. Brain, D. C. Blanchard, & S. Parmigiani (Eds.), Ethoexperimental approaches to the study of behavior (MATO ASI Series D, Vol. 48, pp. 151-166). Boston: Kluwer Academic.
67. Fanselow, M. S. (1990). Factors governing one-trial contextual conditioning. Animal Learning and Behavior, 18, 264-270.
68. Fanselow, M. S., DeCola, J. P., & Young, S. L. (1993). Mechanisms responsible for reduced contextual conditioning with massed unsignaled unconditional stimuli. Journal of Experimental Psychology: Animal Behavior Processes, 19, 121-137.
69. Fanselow, M. S., & Stote, D. (1995, November). Temporal vs. associative accounts of the immediate shock deficit in contextual fear. Paper presented at the annual meeting of the Psychonomic Society, Los Angeles.
70. Fantino, E. (1969). Conditioned reinforcement, choice, and the psychological distance to reward. In D. P. Hendry (Ed.), Conditioned reinforcement (pp. 163-191). Homewood, IL: Dorsey Press.
71. Fantino, E., Preston, R. A., & Dunn, R. (1993). Delay reduction: Current status. Journal of the Experimental Analysis of Behavior, 60, 159-169.
72. Fiala, J. C., Grossberg, S., & Bullock, D. (1996). Metobotropic glutamate receptor activation in cerebellar Purkinje cells as substrate for adaptive timing of the classically conditioned eye-blink response. Journal of Neuroscience, 16, 3760-3774.
73. Foree, D. D., & LoLordo, V. M. (1973). Attention in the pigeon: Differential effects of food-getting versus shock-avoidance procedures. Journal of Comparative and Physiological Psychology, 85, 551-558.
74. Gallistel, C. R. (1989). Animal cognition: The representation of space, time and number. Annual Review of Psychology, 40, 155-189.
75. Gallistel, C. R. (1990). The organization of learning. Cambridge, MA: Bradford Books/MIT Press.
76. Gallistel, C. R. (1992a). Classical conditioning as an adaptive specialization: A computational model. In D. L. Medin (Ed.), The psychology of learning and motivation: Advances in research and theory (Vol. 28, pp. 35-67). New York: Academic Press.
77. Gallistel, C. R. (1992b). Classical conditioning as a non-stationary, multivariate time series analysis: A spreadsheet model. Behavior Research Methods, Instruments, and Computers, 24, 340-351.
78. Gallistel, C. R. (1999). Can response timing be explained by a decay process? Journal of the Experimental Analysis of Behavior, 71, 264-271.
79. Gamzu, E., & Williams, D. R. (1971). Classical conditioning of a complex skeletal response. Science, 171, 923-925.
80. Gamzu, E., & Williams, D. R. (1973). Associative factors underlying the pigeon's keypecking in autoshaping procedures. Journal of the Experimental Analysis of Behavior, 19, 225-232.
81. Ganesan, R., & Pearce, J. M. (1988). Effect of changing the unconditioned stimulus on appetitive blocking. Journal of Experimental Psychology: Animal Behavior Processes, 14, 280-291.
82. Gibbon, J. (1971). Scalar timing and semi-Markov chains in free-operant avoidance. Journal of Mathematical Psychology, 8, 109-138.
83. Gibbon, J. (1972). Timing and discrimination of shock density in avoidance. Psychological Review, 79, 68-92.
84. Gibbon, J. (1977). Scalar expectancy theory and Weber's law in animal timing. Psychological Review, 84, 279-325.
85. Gibbon, J. (1981a). The contingency problem in autoshaping. In C. M. Locurto, H. S. Terrace, & J. Gibbon (Eds.), Autoshaping and conditioning theory (pp. 285-308). New York: Academic Press.
86. Gibbon, J. (1981b). On the form and location of the psychometric bisection function for time. Journal of Mathematical Psychology, 24, 58-87.
87. Gibbon, J. (1992). Ubiquity of scalar timing with a Poisson clock. Journal of Mathematical Psychology, 36, 283-293.
88. Gibbon, J. (1995). Dynamics of time matching: Arousal makes better seem worse. Psychonomic Bulletin and Review, 2, 208-215.
89. Gibbon, J., & Allan, L. (Eds.). (1984). Timing and time perception (Vol. 423). New York: New York Academy of Sciences.
90. Gibbon, J., Baldock, M. D., Locurto, C. M., Gold, L., & Terrace, H. S. (1977). Trial and intertrial durations in autoshaping. Journal of Experimental Psychology: Animal Behavior Processes, 3, 264-284.
91. Gibbon, J., & Balsam, P. (1981). Spreading associations in time. In C. M. Locurto, H. S. Terrace, & J. Gibbon (Eds.), Autoshaping and conditioning theory (pp. 219-253). New York: Academic Press.
92. Gibbon, J., & Church, R. M. (1990). Representation of time. Cognition, 37, 23-54.
93. Gibbon, J., & Church, R. M. (1992). Comparison of variance and covariance patterns in parallel and serial theories of timing. Journal of the Experimental Analysis of Behavior, 57, 393-406.
94. Gibbon, J., Church, R. M., Fairhurst, S., & Kacelnik, A. (1988). Scalar expectancy theory and choice between delayed rewards. Psychological Review, 95, 102-114.
95. Gibbon, J., Church, R. M., & Meck, W. H. (1984). Scalar timing in memory. In J. Gibbon & L. Allan (Eds.), Timing and time perception (Vol. 423, pp. 52-77). New York: New York Academy of Sciences.
96. Gibbon, J., & Fairhurst, S. (1994). Ratio versus difference comparators in choice. Journal of the Experimental Analysis of Behavior, 62, 409-434.
97. Gibbon, J., Fairhurst, S., & Goldberg, B. (1997). Cooperation, conflict and compromise between circadian and interval clocks in pigeons. In C. M. Bradshaw & E. Szabadi (Eds.), Time and behaviour: Psychological and neurobehavioural analyses (pp. 329-384). Amsterdam: North-Holland/ Elsevier.
98. Gibbon, J., Farrell, L., Locurto, C. M., Duncan, H. J., & Terrace, H. S. (1980). Partial reinforcement in autoshaping with pigeons. Animal Learning and Behavior, 8, 45-59.
99. Gibbon, J., Locurto, C., & Terrace, H. S. (1975). Signal-food contingency and signal frequency in a continuous trials auto-shaping paradigm. Animal Learning and Behavior, 3, 317-324.
100. Gibbon, J., Malapani, C., Dale, C. L., & Gallistel, C. R. (1997). Toward a neurobiology of temporal cognition: Advances and challenges. Current Opinion in Neurobiology, 7, 170-184.
101. Gluck, M. A., & Thompson, R. F. (1987). Modeling the neural substrates of associative learning and memory: A computational approach. Psychological Review, 94, 176-191.
102. Goddard, M. J., & Jenkins, H. M. (1987). Effect of signaling extra unconditioned stimuli on autoshaping. Animal Learning and Behavior, 15, 40-46.
103. Gormezano, I., & Coleman, S. R. (1975). Effects of partial reinforcement on conditioning, conditional probabilities, asymptotic performance, and extinction of the rabbit's nictitating membrane response. Pavlovian Journal of Biological Science, 10, 13-22.
104. Grahame, N. J., Barnet, R. C., & Miller, R. R. (1992). Pavlovian inhibition cannot be obtained by posttraining A-US pairings: Further evidence for the empirical asymmetry of the comparator hypothesis. Bulletin of the Psychonomic Society, 30, 399-402.
105. Granger, R. H. J., & Schlimmer, J. C. (1986). The computation of contingency in classical conditioning. In G. H. Bower (Ed.), The psychology of learning and motivation (Vol. 20, pp. 137-192). New York: Academic Press.
106. Grossberg, S., & Merrill, J. W. L. (1996). The hippocampus and cerebellum in adaptively timed learning, recognition, and movement. Journal of Cognitive Neuroscience, 8, 257-277.
107. Grossberg, S., & Schmajuk, N. A. (1991). Neural dynamics of adaptive timing and temporal discrimination during associative learning. In G. A. Carpenter & S. Grossberg (Eds.), Pattern recognition by self-organizing neural networks (pp. 637-674). Cambridge, MA: MIT Press.
108. Hallam, S. C., Matzel, L. D., Sloat, J. S., & Miller, R. R. (1990). Excitation and inhibition as a function of post-training extinction of the excitatory cue used in Pavlovian inhibition training. Learning and Motivation, 21, 59-84.
109. Harper, D. G. C. (1982). Competitive foraging in mallards: Ideal free ducks. Animal Behaviour, 30, 575-584.
110. Herrnstein, R. J. (1961). Relative and absolute strength of response as a function of frequency of reinforcement. Journal of the Experimental Analysis of Behavior, 4, 267-272.
111. Herrnstein, R. J. (1964). Secondary reinforcement and rate of primary reinforcement. Journal of the Experimental Analysis of Behavior, 7, 27-36.
112. Herrnstein, R. J. (1991). Experiments on stable sub-optimality in individual behavior. American Economic Review, 81, 360-364.
113. Herrnstein, R. J., & Loveland, D. H. (1975). Maximizing and matching on concurrent ratio schedules. Journal of the Experimental Analysis of Behavior, 24, 107-116.
114. Herrnstein, R. J., & Prelec, D. (1991). Melioration: A theory of distributed choice. Journal of Economic Perspectives, 5, 137-156.
115. Herrnstein, R. J., & Vaughan, W. J. (1980). Melioration and behavioral allocation. In J. E. R. Staddon (Ed.), Limits to action: The allocation of individual behavior (pp. 143-176). New York: Academic Press.
116. Heyman, G. M. (1979). A Markov model description of changeover probabilities on concurrent variable-interval schedules. Journal of the Experimental Analysis of Behavior, 31, 41-51.
117. Heyman, G. M. (1982). Is time allocation unconditioned behavior? In M. Commons, R. Herrnstein, & H. Rachlin (Eds.), Quantitative analyses of behavior: Vol. 2. Matching and maximizing accounts (pp. 459-490). Cambridge, MA: Ballinger Press.
118. Holland, P. C. (1990). Event representation in Pavlovian conditioning: Image and action. Cognition, 37, 105-131.
119. Holmes, J. D., & Gormezano, I. (1970). Classical appetitive conditioning of the rabbit's jaw movement response under partial and continuous reinforcement schedules. Learning and Motivation, 1, 110-120.
120. Honig, W. K. (1981). Working memory and the temporal map. In N. E. Spear & R. R. Miller (Eds.), Information processing in animals: Memory mechanisms (pp. 167-197). Hillsdale, NJ: Erlbaum.
121. Hull, C. L. (1930). Knowledge and purpose as habit mechanisms. Psychological Review, 37, 511-525.
122. Hull, C. L. (1943). Principles of behavior. New York: Appleton-Century-Crofts.
123. Hyman, A. (1969). Two temporal parameters of free-operant discriminated avoidance in the rhesus monkey. Journal of the Experimental Analysis of Behavior, 12, 641-648.
124. James, J. H., & Wagner, A. R. (1980). One-trial overshadowing: Evidence of distributive processing. Journal of Experimental Psychology: Animal Behavior Processes, 6, 188-205.
125. Kamin, L. J. (1954). Traumatic avoidance learning: The effects of CS-US interval with a trace-conditioning procedure. Journal of Comparative and Physiological Psychology, 47, 65-72.
126. Kamin, L. J. (1967). "Attention-like" processes in classical conditioning. In M. R. Jones (Ed.), Miami Symposium on the Prediction of Behavior: Aversive stimulation (pp. 9-33). Miami, FL: University of Miami Press.
127. Kamin, L. J. (1969a). Predictability, surprise, attention, and conditioning. In B. A. Campbell & R. M. Church (Eds.), Punishment and aversive behavior (pp. 276-296). New York: Appleton-Century-Crofts.
128. Kamin, L. J. (1969b). Selective association and conditioning. In N. J. Mackintosh & W. K. Honig (Eds.), Fundamental issues in associative learning (pp. 42-64). Halifax, Nova Scotia, Canada: Dalhousie University Press.
129. Kamin, L. J., & Gaioni, S. J. (1974). Compound conditioned emotional response conditioning with differentially salient elements in rats. Journal of Comparative and Physiological Psychology, 87, 591-597.
130. Kaplan, P., & Hearst, E. (1985). Contextual control and excitatory vs inhibitory learning: Studies of extinction, reinstatement, and interference. In P. D. Balsam & A. Tomie (Eds.). Context and learning (pp. 195-224). Hillsdale, NJ: Erlbaum.
131. Kaufman, M. A., & Bolles, R. C. (1981). A nonassociative aspect of overshadowing. Bulletin of the Psychonomic Society, 18, 318-320.
132. Kehoe, E. J., & Gormezano, I. (1974). Effects of trials per session on conditioning of the rabbit's nictitating membrane response. Bulletin of the Psychonomic Society, 4, 434-436.
133. Kehoe, E. J., Graham-Clarke, P., & Schreurs, B. G. (1989). Temporal patterns of the rabbit's nictitating membrane response to compound and component stimuli under mixed CS-US intervals. Behavioral Neuroscience, 103, 283-295.
134. Keller, J. V., & Gollub, L. R. (1977). Duration and rate of reinforcement as determinants of concurrent responding. Journal of the Experimental Analysis of Behavior, 28, 145-153.
135. Killeen, P. (1968). On the measurement of reinforcement frequency in the study of preference. Journal of the Experimental Analysis of Behavior, 11, 263-269.
136. Killeen, P. (1975). On the temporal control of behavior. Psychological Review, 82, 89-115.
137. Killeen, P. R. (1982). Incentive theory: II. Models for choice. Journal of the Experimental Analysis of Behavior, 38, 217-232.
138. Killeen, P. R., & Fetterman, J. G. (1988). A behavioral theory of timing. Psychological Review, 94, 455-468.
139. Killeen, P. R., & Taylor, T. (in press). How the propagation of error through stochastic counters affects time discrimination and other psychophysical judgments. Psychological Review.
140. Killeen, P. R., & Weiss, N. A. (1987). Optimal timing and the Weber function. Psychological Review, 94, 455-468.
141. Kremer, E. F. (1978). The Rescorla-Wagner model: Losses in associative strength in compound conditioned stimuli. Journal of Experimental Psychology: Animal Behavior Processes, 4, 22-36.
142. LaBarbera, J. D., & Church, R. M. (1974). Magnitude of fear as a function of the expected time to an aversive event. Animal Learning and Behavior, 2, 199-202.
143. Lattal, K. M., & Nakajima, S. (1998). Overexpectation in appetitive Pavlovian and instrumental conditioning. Animal Learning and Behavior, 26, 351-360.
144. Leon, M. I., & Gallistel, C. R. (1998). Self-stimulating rats combine subjective reward magnitude and subjective reward rate multiplicatively. Journal of Experimental Psychology: Animal Behavior Processes, 24, 265-277.
145. Levinthal, C. F., Tartell, R. H., Margolin, C. M., & Fishman, H. (1985). The CS-US interval (ISI) function in rabbit nictitating membrane response conditioning with very long intertrial intervals. Animal Learning and Behavior, 13, 228-232.
146. Libby, M. E., & Church, R. M. (1974). Timing of avoidance responses by rats. Journal of the Experimental Analysis of Behavior, 22, 513-517.
147. Logan, G. D. (1988). Toward an instance theory of automatization. Psychological Review, 95, 492-527.
148. Logue, A. W., & Chavarro, A. (1987). Effect on choice of absolute and relative values of reinforcer delay, amount, and frequency. Journal of Experimental Psychology: Animal Behavior Processes, 13, 280-291.
149. LoLordo, V. M., & Fairless, J. L. (1985). Pavlovian conditioned inhibition: The literature since 1969. In R. R. Miller & N. E. Spear (Eds.), Information processing in animals (pp. 143-170). Hillsdale, NJ: Erlbaum.
150. LoLordo, V. M., Jacobs, W. J., & Foree, D. D. (1982). Failure to block control by a relevant stimulus. Animal Learning and Behavior, 10, 183-193.
151. Low, L. A., & Low, H. I. (1962). Effects of CS-US interval length upon avoidance responding. Journal of Comparative and Physiological Psychology, 55, 1059-1061.
152. Mackintosh, N. J. (1971). An analysis of overshadowing and blocking. Quarterly Journal of Experimental Psychology, 23, 118-125.
153. Mackintosh, N. J. (1975). A theory of attention: Variations in the associability of stimuli with reinforcement. Psychological Review, 82, 276-298.
154. Mackintosh, N. J. (1976). Overshadowing and stimulus intensity. Animal Learning and Behavior, 4, 186-192.
155. Mackintosh, N. J., & Dickinson, A. (1979). Instrumental (Type II) conditioning. In A. Dickinson & R. A. Boakes (Eds.), Mechanism of learning and motivation. Hillsdale, NJ: Erlbaum.
156. Mackintosh, N. J., & Reese, B. (1970). One-trial overshadowing. Quarterly Journal of Experimental Psychology, 31, 519-526.
157. Mark, T. A. (1997). The microstructure of choice. Unpublished doctoral dissertation, University of California, Los Angeles.
158. Mark, T. A., & Gallistel, C. R. (1993). Subjective reward magnitude of MFB stimulation as a function of train duration and pulse frequency. Behavioral Neuroscience, 107, 389-401.
159. Mark, T. A., & Gallistel, C. R. (1994). The kinetics of matching. Journal of Experimental Psychology: Animal Behavior Processes, 20, 79-95.
160. Matzel, L. D., Held, F. P., & Miller, R. R. (1988). Information and expression of simultaneous and backward associations: Implications for contiguity theory. Learning and Motivation, 19, 317-344.
161. Matzel, L. D., Schachtman, T. R., & Miller, R. R. (1985). Recovery of overshadowed association achieved by extinction of the overshadowing stimulus. Learning and Motivation, 16, 398-412.
162. Mazur, J. E. (1984). Tests of an equivalence rule for fixed and variable delays. Journal of Experimental Psychology: Animal Behavior Processes, 10, 426-436.
163. Mazur, J. E. (1986). Fixed and variable ratios and delays: Further test of an equivalence rule. Journal of Experimental Psychology: Animal Behavior Processes, 12, 116-124.
164. Mazur, J. E. (1989). Theories of probabilistic reinforcement. Journal of the Experimental Analysis of Behavior, 51, 87-99.
165. Mazur, J. E. (1991). Choice with probabilistic reinforcement: Effects of delay and conditioned reinforcers. Journal of the Experimental Analysis of Behavior, 55, 63-77.
166. Mazur, J. E. (1995). Development of preference and spontaneous recovery in choice behavior with concurrent variable-interval schedules. Animal Learning and Behavior, 23, 93-103.
167. Mazur, J. E. (1996). Past experience, recency, and spontaneous recovery in choice behavior. Animal Learning and Behavior, 24, 1-10.
168. Mazur, J. E. (1997). Choice, delay, probability, and conditioned reinforcement. Animal Learning and Behavior, 25, 131-147.
169. Mazur, J. E., & Wagner, A. R. (1982). An episodic model of associative learning. In M. L. Commons, R. J. Herrnstein, & A. R. Wagner (Eds.), Quantitative analyses of behavior: Acquisition (pp. 3-39). Cambridge, MA: Ballinger Press.
170. McDiarmid, C. G., & Rilling, M. E. (1965). Reinforcement delay and reinforcement rate as determinants of schedule preference. Psychonomic Science, 2, 195-196.
171. Meck, W. H., Church, R. M., & Gibbon, J. (1985). Temporal integration in duration and number discrimination. Journal of Experimental Psychology: Animal Behavior Processes, 11, 591-597.
172. Miall, C. (1996). Models of neural timing. In M. A. Pastor & J. Artieda (Eds.), Advances in psychology: Vol. 115. Time, internal clocks and movement (pp. 69-94). Amsterdam: North-Holland/Elsevier Science.
173. Miller, R. R., & Barnet, R. C. (1993). The role of time in elementary associations. Current Directions in Psychological Science, 2, 106-111.
174. Miller, R. R., Barnet, R. C., & Grahame, N. J. (1992). Responding to a conditioned stimulus depends on the current associative status of other cues that were present during training of that specific stimulus. Journal of Experimental Psychology: Animal Behavior Processes, 18, 251-264.
175. Miller, R. R., & Grahame, N. J. (1991). Expression of learning. In L. Dachowski & C. F. Flaherty (Eds.), Current topics in animal learning (pp. 95-117). Hillsdale, NJ: Erlbaum.
176. Miller, R. R., & Matzel, L. D. (1989). Contingency and relative associative strength. In S. B. Klein & R. R. Mowrer (Eds.), Contemporary learning theories: Pavlovian conditioning and the status of traditional learning theory (pp. 61-84). Hillsdale, NJ: Erlbaum.
177. Miller, R. R., & Schachtman, T. R. (1985). Conditioning context as an associative baseline: Implications for response generation and the nature of conditioned inhibition. In R. R. Miller & N. S. Spear (Eds.), Information processing in animals: Conditioned inhibition (pp. 51-88). Hillsdale, NJ: Erlbaum.
178. Mustaca, A. E., Gabelli, F., Papine, M. R., & Balsam, P. (1991). The effects of varying the interreinforcement interval on appetitive contextual conditioning. Animal Learning and Behavior, 19, 125-138.
179. Myerson, J., & Miezin, F. M. (1980). The kinetics of choice: An operant systems analysis. Psychological Review, 87, 160-174.
180. Nelson, J. B., & Bouton, M. E. (1997). The effects of a context switch following serial and simultaneous feature-negative discriminations. Learning and Motivation, 28, 56-84.
181. Nevin, J. A. (1982). Some persistent issues in the study of matching and maximizing. In M. L. Commons, R. J. Herrnstein, & H. Rachlin (Eds.), Quantitative analyses of behavior: Vol. 2. Matching and maximizing accounts (pp. 153-165). Cambridge, MA: Ballinger Press.
182. Pavlov, I. V. (1928). Lectures on conditioned reflexes: The higher nervous activity of animals (H. Gantt, Trans.). London: Lawrence & Wishart.
183. Pearce, J. M. (1994). Similarity and discrimination: A selective review and a connectionist model. Psychological Review, 101, 587-607.
184. Pearce, J. M., & Hall, G. (1980). A model for Pavlovian learning: Variation in the effectiveness of conditioned but not of unconditioned stimuli. Psychological Review, 87, 532-552.
185. Penney, T. B., Allan, L. G., Meck, W. H., & Gibbon, J. (1998). Memory mixing in duration bisection. In D. A. Rosenbaum & C. E. Collyer (Eds.), Timing of behavior: Neural, psychological, and computational perspectives (pp. 165-193). Cambridge, MA: MIT Press.
186. Pliskoff, S. S. (1971). Effects of symmetrical and asymmetrical changeover delays on concurrent performances. Journal of the Experimental Analysis of Behavior, 16, 249-256.
187. Prokasy, W. F., & Gormezano, I. (1979). The effect of US omission in classical aversive and appetitive conditioning of rabbits. Animal Learning and Behavior, 7, 80-88.
188. Pubols, B. H. (1962). Constant versus variable delay of reinforcement. Journal of Comparative and Physiological Psychology, 55, 52-56.
189. Rachlin, H. (1974). Self-control. Behaviorism, 2, 94-107.
190. Rachlin, H. (1978). A molar theory of reinforcement schedules. Journal of the Experimental Analysis of Behavior, 30, 345-360.
191. Rachlin, H. (1995). Self-control: Beyond commitment. Behavioral and Brain Sciences, 18, 109-121.
192. Rachlin, H., Logue, A. W., Gibbon, J., & Frankel, M. (1986). Cognition and behavior in studies of choice. Psychological Review, 93, 33-45.
193. Rachlin, H., Raineri, A., & Cross, D. (1991). Subjective probability and delay. Journal of the Experimental Analysis of Behavior, 55, 233-244.
194. Rashotte, M. E., Griffin, R. W., & Sisk, C. L. (1977). Second-order conditioning of pigeon's keypeck. Animal Learning and Behavior, 5, 25-38.
195. Rescorla, R. A. (1967). Inhibition of delay in Pavlovian fear conditioning. Journal of Comparative and Physiological Psychology, 64, 114-120.
196. Rescorla, R. A. (1968). Probability of shock in the presence and absence of CS in fear conditioning. Journal of Comparative and Physiological Psychology, 66, 1-5.
197. Rescorla, R. A. (1969). Pavlovian conditioned inhibition. Psychological Bulletin, 72, 77-94.
198. Rescorla, R. A. (1972). Informational variables in Pavlovian conditioning. In G. H. Bower (Ed.), The psychology of learning and motivation (Vol. 6, pp. 1-46). New York: Academic Press.
199. Rescorla, R. A. (1988). Behavioral studies of Pavlovian conditioning. Annual Review of Neuroscience, 11, 329-352.
200. Rescorla, R. A. (1991). Associations of multiple outcomes with an instrumental response. Journal of Experimental Psychology: Animal Behavior Processes, 17, 465-474.
201. Rescorla, R. A. (1992). Response-independent outcome presentation can leave instrumental R-O associations intact. Animal Learning and Behavior, 20, 104-111.
202. Rescorla, R. A. (1993). The preservation of response-outcome associations through extinction. Animal Learning and Behavior, 21, 238-245.
203. Rescorla, R. A. (1996). Spontaneous recovery after training with multiple outcomes. Animal Learning and Behavior, 24, 11-18.
204. Rescorla, R. A. (1998). Instrumental learning: Nature and persistence. In M. Sabourin, F. I. M. Craik, & M. Roberts (Eds.), Proceeding of the XXVI International Congress of Psychology: Vol. 2. Advances in psychological science: Biological and cognitive aspects (pp. 239-258). London: Psychology Press.
205. Rescorla, R. A., & Colwill, R. M. (1989). Associations with anticipated and obtained outcomes in instrumental conditioning. Animal Learning and Behavior, 17, 291-303.
206. Rescorla, R. A., & Cunningham, C. L. (1978). Within-compound flavor association. Journal of Experimental Psychology: Animal Behavior Processes, 4, 267-275.
207. Rescorla, R. A., & Durlach, P. J. (1987). The role of context in intertrial interval effects in autoshaping. Quarterly Journal of Experimental Psychology, 39B, 35-48.
208. Rescorla, R. A., & Heth, C. D. (1975). Reinstatement of fear to an extinguished conditioned stimulus. Journal of Experimental Psychology: Animal Behavior Processes, 104, 88-106.
209. Rescorla, R. A., & Wagner, A. R. (1972). A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement. In A. H. Black & W. F. Prokasy (Eds.), Classical conditioning II (pp. 64-99). New York: Appleton-Century-Crofts.
210. Reynolds, G. S. (1961). Attention in the pigeon. Journal of the Experimental Analysis of Behavior, 4, 203-208.
211. Rilling, M., & McDiarmid, C. (1965). Signal detection in fixed ratio schedules. Science, 148, 526-527.
212. Roberts, S. (1981). Isolation of an internal clock. Journal of Experimental Psychology: Animal Behavior Processes, 7, 242-268.
213. Savastano, H. I., & Miller, R. R. (1998). Time as content in Pavlovian conditioning. Behavioural Processes, 44, 147-162.
214. Schneider, B. (1969). A two-state analysis of fixed-interval responding in the pigeon. Journal of the Experimental Analysis of Behavior, 12, 667-687.
215. Schneiderman, N., & Gormezano, I. (1964). Conditioning of the nictitating membrane of the rabbit as a function of CS-US interval. Journal of Comparative and Physiological Psychology, 57, 188-195.
216. Schull, R. L., Mellon, R., & Sharp, J. A. (1990). Delay and number of food reinforcers: Effects on choice and latencies. Journal of the Experimental Analysis of Behavior, 53, 235-246.
217. Sheafor, P. J., & Gormezano, I. (1972). Conditioning the rabbit's (Oryctolagus cuniculus) jaw-movement response. Journal of Comparative and Physiological Psychology, 81, 449-456.
218. Sherry, D. (1984). Food storage by black-capped chickadees: Memory for location and contents of caches. Animal Behavior, 32, 451-464.
219. Shimp, C. P. (1969). Optimal behavior in free-operant experiments. Psychological Review, 76, 97-112.
220. Skinner, B. F. (1938). The behavior of organisms. New York: Appleton-Century-Crofts.
221. Smolensky, P. (1986). Information processing in dynamical systems: Foundations of harmony theory. In D. E. Rumelhart & J. L. McClelland (Eds.), Parallel distributed processing: Foundations (Vol. 1, pp. 194-281). Cambridge, MA: MIT Press.
222. Staddon, J. E. R., & Higa, J. J. (1993). Temporal learning. In D. Medin (Ed.), The psychology of learning and motivation (Vol. 27, pp. 265-294). New York: Academic Press.
223. Staddon, J. E. R., & Motheral, S. (1979). On matching and maximizing in operant choice experiments. Psychological Review, 85, 436-444.
224. Sutton, R. S., & Barto, A. G. (1990). Time-derivative models of Pavlovian reinforcement. In M. Gabriel & J. Moore (Eds.), Learning and computational neuroscience: Foundations of adaptive networks (pp. 497-537). Cambridge, MA: Bradford Books/MIT Press.
225. Terrace, H. S., Gibbon, J., Farrell, L., & Baldock, M. D. (1975). Temporal factors influencing the acquisition and maintenance of an autoshaped keypeck. Animal Learning and Behavior, 3, 53-62.
226. Timberlake, W., & Lucas, G. A. (1989). Behavior systems and learning: From misbehavior to general principles. In S. B. Klein & R. R. Mowrer (Eds.), Contemporary learning theories: Instrumental conditioning theory and the impact of biological constraints on learning (pp. 237-275). Hillsdale, NJ: Erlbaum.
227. Tomie, A. (1976a). Interference with autoshaping by prior context conditioning. Journal of Experimental Psychology: Animal Behavior Processes, 2, 323-334.
228. Tomie, A. (1976b). Retardation of autoshaping: Control by contextual stimuli. Science, 192, 1244-1246.
229. Usherwood, P. N. R. (1993). Memories are made of this. Trends in Neurosciences, 16, 427-429.
230. Van Hamme, L. J., & Wasserman, E. A. (1994). Cue competition in causality judgments: The role of nonpresentation of compound stimulus elements. Learning and Motivation, 25, 127-151.
231. Wagner, A. R. (1981). SOP: A model of automatic memory processing in animal behavior. In N. E. Spear & R. R. Miller (Eds.), Information processing in animals: Memory mechanisms (pp. 5-47). Hillsdale, NJ: Erlbaum.
232. Wagner, A. R., Logan, F. A., Haberlandt, K., & Price, T. (1968). Stimulus selection in animal discrimination learning. Journal of Experimental Psychology, 76, 171-180.
233. Wasserman, E. A., Franklin, S. R., & Hearst, E. (1974). Pavlovian appetitive contingencies and approach versus withdrawal to conditioned stimuli in pigeons. Journal of Comparative and Physiological Psychology, 86, 616-627.
234. Wasserman, E. A., & McCracken, S. B. (1974). The disruption of autoshaped keypecking in the pigeon by food-tray illumination. Journal of the Experimental Analysis of Behavior, 22, 39-45.
235. Wasserman, E. A., & Miller, R. R. (1997). What's elementary about associative learning? Annual Review of Psychology, 48, 573-607.
236. Weidemann, G., Georgilas, A., & Kehoe, E. J. (1999). Temporal specificity in patterning of the rabbit nictitating membrane response. Animal Learning and Behavior, 27, 99-107.
237. Williams, B. A. (1981). Invariance in reinforcements to acquisition, with implications for the theory of inhibition. Behaviour Analysis Letters, 1, 73-80.
238. Williams, B. A. (1982). Blocking the response-reinforcer association. In M. L. Commons, R. J. Herrnstein, & A. R. Wagner (Eds.), Quantitative analyses of behavior: Acquisition (pp. 427-447). Cambridge, MA: Ballinger Press.
239. Williams, B. A., & Royalty, P. (1989). A test of the melioration theory of matching. Journal of Experimental Psychology: Animal Behavior Processes, 15, 99-113.