Response rates track the history of reinforcement times

Journal of Experimental Psychology: Animal Behavior Processes

Volumn 37, Issue 3, 2011, Pages 277-286

  Harris, Justin A ^a   Gharaei, Saba ^a   Pincham, Hannah L ^a  

^a UNIVERSITY OF SYDNEY   (Australia)

Author keywords

Exponential distribution; Hazard function; Pavlovian conditioning; Rat; Uniform distribution; Variable interval

Indexed keywords

ANIMAL; ARTICLE; CONDITIONED REFLEX; LEARNING; MALE; PHYSIOLOGY; RAT; REINFORCEMENT; WISTAR RAT;

ANIMALS; ASSOCIATION LEARNING; CONDITIONING, CLASSICAL; MALE; RATS; RATS, WISTAR; REINFORCEMENT SCHEDULE;

RATTUS;

EID: 79960600923     PISSN: 00977403     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0023079     Document Type: Article

References (32)

1. Balsam P.D., Gallistel C.R. Temporal maps and informativeness in associative learning. Trends in Neurosciences 2009, 32:73-78.
2. Brunner D., Fairhurst S., Stolovitzky G., Gibbon J. Mnemonics for variability: Remembering food delay. Journal of Experimental Psychology: Animal Behavior Processes 1997, 23:68-83.
3. Catania A.C., Reynolds G.S. A quantitative analysis of the responding maintained by interval schedules of reinforcement. Journal of the Experimental Analysis of Behavior 1968, 11:327-383.
4. Church R.M., Lacourse D.M. Temporal memory of interfood interval distributions with the same mean and variance. Learning & Motivation 2001, 32:2-21.
5. Church R.M., Lacourse D.M., Crystal J. Temporal search as a function of the variability of interfood intervals. Journal of Experimental Psychology: Animal Behavior Processes 1998, 24:291-315.
6. Davis M., Schlesigner L.S., Sorenson C.A. Temporal specificity of fear conditioning: Effects of different conditioned stimulus-unconditioned stimulus intervals on the fear-potentiated startle effect. Journal of Experimental Psychology: Animal Behavior Processes 1989, 15:295-310.
7. Desmond J.E., Moore J.W. Adaptive timing in neural networks: The conditioned response. Biological Cybernetics 1988, 58:405-415.
8. Farwell B.J., Ayres J.J. Stimulus-reinforcer and response-reinforcer relations in the control of conditioned appetitive headpoking (goal tracking) in rats. Learning and Motivation 1979, 10:295-312.
9. Gallistel C.R., Gibbon J. Time, rate, and conditioning. Psychological Review 2000, 107:289-344.
10. Gibbon J. Scalar expectancy theory and Weber's law in animal timing. Psychological Review 1977, 84:279-325.
11. Gibbon J., Church R.M., Fairhurst S., Kacelnik A. Scalar expectancy theory and choice between delayed rewards. Psychological Review 1988, 95:102-114.
12. Harzem P., Lowe C.P., Priddle-Higson P.J. Inhibition function of reinforcement: Magnitude effects on variable-interval schedules. Journal of the Experimental Analysis of Behavior 1978, 30:1-10.
13. Holland P.C. Differential effects of omission contingencies on various components of Pavlovian appetitive conditioned responding in rats. Journal of Experimental Psychology: Animal Behavior Processes 1979, 5:178-193.
14. Joscelyne A., Kehoe E.J. Time and stimulus specificity in extinction of the conditioned nictitating membrane response in the rabbit (Oryctolagus cuniculus). Behavioral Neuroscience 2007, 121:50-62.
15. Kehoe E.J., Horne P.S., Macrae M., Horne S.J. Real-time processing of serial stimuli in classical conditioning of the rabbit's nictitating membrane response. Journal of Experimental Psychology: Animal Behavior Processes 1993, 19:265-283.
16. Kehoe E.J., Joscelyne A. Temporally specific extinction of conditioned responses in the rabbit (Oryctolagus cuniculus) nictitating membrane preparation. Behavioral Neuroscience 2005, 119:1011-1022.
17. Kirkpatrick K., Church R.M. Stimulus and temporal cues in classical conditioning. Journal of Experimental Psychology: Animal Behavior Processes 2000, 26:206-219.
18. Kirkpatrick K., Church R.M. Tracking the expected time to reinforcement in temporal conditioning procedures. Learning & Behavior 2003, 31:3-21.
19. Ludwig E.A., Sutton R.S., Kehoe E.J. Stimulus representation and the timing of reward-prediction errors in models of the dopamine system. Neural Computation 2008, 20:3034-3054.
20. Lund C.A. Effects of variations in the temporal distribution of reinforcements on interval schedule performance. Journal of the Experimental Analysis of Behavior 1976, 26:155-164.
21. O'Brien R.G., Kaiser M.K. MANOVA method for analyzing repeated measures designs: An extensive primer. Psychological Bulletin 1985, 97:316-333.
22. Pavlov, I. P. (1927). Conditioned reflexes: An investigation of the physiological activity of the cerebral cortex. (G. V. Anrep, Trans.). New York, NY: Dover.
23. Rescorla R.A., Wagner A.R. A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement. Classical conditioning II: Current research and theory 1972, 64-99. Appleton-Century-Crofts, New York, NY. A.H. Black, W.F. Prokasy (Eds.).
24. Roberts S. Isolation of an internal clock. Journal of Experimental Psychology: Animal Behavior Processes 1981, 7:242-268.
25. Schultz W., Dayan P., Montague P.R. A neural substrate of prediction and reward. Science 1997, 275:1593-1599.
26. Schwartz B. Stimulus-reinforcer contingencies and local behavioral contrast. Journal of the Experimental Analysis of Behavior 1978, 29:297-308.
27. Smith M.C. CS-US interval and US intensity in classical conditioning of the rabbit's nictitating membrane response. Journal of Comparative and Physiological Psychology 1968, 66:679-687.
28. Sutton R.S., Barto A.G. Toward a modern theory of adaptive networks: Expectation and prediction. Psychological Review 1981, 88:135-171.
29. Sutton R.S., Barto A.G. Time-derivative models of Pavlovian reinforcement. Learning and computational neuroscience: Foundations of adaptive networks 1990, 497-537. Bradford Books/MIT Press, Cambridge, MA. M. Gabriel, J. Moore (Eds.).
30. Waelti P., Dickinson A., Schultz W. Dopamine responses comply with basic assumptions of formal learning theory. Nature 2001, 412(6842):43-48.
31. Wagner A.R., Brandon S.E. A componential theory of Pavlovian conditioning. Handbook of contemporary learning theories 2001, 23-64. Erlbaum, Mahwah, NJ. R.R. Mowrer, S.B. Klein (Eds.).
32. Williams D.A., Lawson C., Cook R., Mather A.A., Johns K.W. Timed excitatory conditioning under zero and negative contingencies. Journal of Experimental Psychology: Animal Behavior Processes 2008, 34:94-105.