Temporal contingency

Behavioural Processes

Volumn 101, Issue , 2014, Pages 89-96

  Gallistel, C R ^a   Craig, Andrew R ^b   Shahan, Timothy A ^b  

^a RUTGERS UNIVERSITY   (United States)

^b UTAH STATE UNIVERSITY   (United States)

Author keywords

Classical conditioning; Information theory; Operant conditioning; Temporal pairing; Timing

Indexed keywords

CLASSICAL CONDITIONING; INFORMATION THEORY; OPERANT CONDITIONING; TEMPORAL PAIRING; TIMING;

ANIMALS; ASSOCIATION LEARNING; CONDITIONING, CLASSICAL; CONDITIONING, OPERANT; REINFORCEMENT SCHEDULE; TIME FACTORS;

EID: 84894226216     PISSN: 03766357     EISSN: 18728308     Source Type: Journal    
DOI: 10.1016/j.beproc.2013.08.012     Document Type: Review

References (32)

1. Allan L.G., Hannah S.D., et al. The psychophysics of contingency assessment. Journal of Experimental Psychology: General 2008, 137(2):226-243.
2. Balsam P., Gallistel C.R. Temporal maps and informativeness in associative learning. Trends in Neurosciences 2009, 32(2):73-78.
3. Balsam P.D., Fairhurst S., et al. Pavlovian contingencies and temporal information. Journal of Experimental Psychology: Animal Behavior Processes 2006, 32:284-294.
4. Baum W.M. In search of the feedback function for variable-interval schedules. Journal of the Experimental Analysis of Behavior 1992, 57:365-375.
5. Gallistel C.R., Gibbon J. Time, rate, and conditioning. Psychological Review 2000, 107(2):289-344.
6. Gallistel C.R., King A., et al. Sources of variability and systematic error in mouse timing behavior. Journal of Experimental Psychology: Animal Behavior Processes 2004, 30(1):3-16.
7. Gibbon J. Scalar expectancy theory and Weber's Law in animal timing. Psychological Review 1977, 84:279-335.
8. Gibbon J., Berryman R., et al. Contingency spaces and measures in classical and instrumental conditioning. Journal of the Experimental Analysis of Behavior 1974, 21(3):585-605.
9. Gottlieb D.A. Acquisition with partial and continuous reinforcement in pigeon autoshaping. Learning & Behavior 2004, 32(3):321-335.
10. Harris J., Gharaei S., et al. Response rates track the history of reinforcement times. Journal of Experimental Psychology: Animal Behavior Processes 2011.
11. Harris J.A. The acquisition of conditioned responding. Journal of Experimental Psychology: Animal Behavior Processes 2011, 37:151-164.
12. Ho S.-W., Chan T., et al. The confidence interval of entropy estimation through a noisy channel. IEEE Xplore: Information Theory Workshop (ITW), 2010 IEEE 2010.
13. Killeen P.R., Weiss N.A. Optimal timing and the Weber function. Psychological Review 1987, 94:455-468.
14. Lattal K.A., Freeman T.J., et al. Response-reinforcer dependency location in interval schedules of reinforcement. Journal of the Experimental Analysis of Behavior 1989, 51(1):101-117.
15. Nemenman I., Bialek W., et al. Entropy and information in neural spike trains: progress on the sampling problem. Physical Review E: Statistical, Nonlinear, and Soft Matter Physics 2004, 69(5 Pt 2):056111.
16. Nevin J.A., Grace R.C., et al. Variable-ratio versus variable-interval schedules: Response rate, resistance to change, and preference. Journal of the Experimental Analysis of Behavior 2001, 76(1):43-74.
17. Paninski L. Estimation of entropy and mutual information. Neural Computation 2003, 15:1191-1253.
18. Paninski L. Estimating entropy on m bins given fewer than m samples. IEEE Transactions on Information Theory 2004, 50(9).
19. Pavlov I. Conditioned Reflexes 1927, Dover, New York.
20. Rescorla R.A. Pavlovian conditioning and its proper control procedures. Psychological Review 1967, 74:71-80.
21. Rescorla R.A. Probability of shock in the presence and absence of CS in fear conditioning. Journal of Comparative and Physiological Psychology 1968, 66(1):1-5.
22. Rescorla R.A. Informational variables in Pavlovian conditioning. The psychology of learning and motivation. G. H. Bower 1972, 6:1-46. Academic, New York.
23. Rescorla R.A., Wagner A.R. A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement. Classical conditioning II 1972, 64-99. Appleton-Century-Crofts, New York. A.H. Black, W.F. Prokasy (Eds.).
24. Shannon C.E. A mathematical theory of communication. Bell Systems Technical Journal 1948, 27(379-423):623-656.
25. Shwartz S., Zibulevsky M., et al. Fast kernel entropy estimation and optimization. Signal Processing 2005, 85:1045-1058.
26. Skinner B.F. The Behavior of Organisms 1938, Appleton-Century-Crofts, New York.
27. Skinner B.F. Superstition in the pigeon. Journal of Experimental Psychology 1948, 38:168-172.
28. Sricharan K., Raich R., et al. k-Nearest Neighbor Estimation of Entropies with Confidence 2011.
29. Staddon J.E., Zhang Y. On the assignment-of-credit problem in operant learning. Neural Network Models of Conditioning and Action Quantitative Analyses of Behavior Series 1991, (pp. 279-293) xx, 359pp. M.L. Commons, S. Grossberg (Eds.).
30. Thorndike E. The Fundamentals of Learning 1932, Teachers College Press, New York.
31. Ward R.D., Gallistel C.R., et al. Conditional stimulus informativeness governs conditioned stimulus-unconditioned stimulus associability. Journal of Experimental Psychology: Animal Behavior Processes 2012.
32. Williams B.A. Invariance in reinforcements to acquisition, with implications for the theory of inhibition. Behaviour Analysis Letters 1981, 1:73-80.