Temporal uncertainty during overshadowing: A temporal difference account

Computational Neuroscience for Advancing Artificial Intelligence: Models, Methods and Applications

Volumn , Issue , 2010, Pages 46-55

  Jennings, Dómhnall J ^a   Alonso, Eduardo ^b,c   Mondragón, Esther ^d   Bonardi, Charlotte ^e  

^a NEWCASTLE UNIVERSITY   (United Kingdom)

^b CITY UNIVERSITY   (United Kingdom)

^c The Society for the Study of Artificial Intelligence and the Simulation of Behaviour   (United Kingdom)

^d Centre for Computational and Animal Learning Research   (United Kingdom)

^e UNIVERSITY OF NOTTINGHAM   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84898567417     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.4018/978-1-60960-021-1.ch003     Document Type: Chapter

References (23)

1. Barnet, R. C., Grahame, N. J., & Miller, R. R. (1993). Temporal encoding as a determinant of blocking. Journal of Experimental Psychology. Animal Behavior Processes, 19, 327-341. doi:10.1037/0097-7403.19.4.327
2. Blaisdell, A. P., Denniston, J. C., & Miller, R. R. (1998). Temporal encoding as a determinant of overshadowing. Journal of Experimental Psychology. Animal Behavior Processes, 24, 72-83. doi:10.1037/0097-7403.24.1.72
3. Egger, M. D., & Miller, N. E. (1962). Secondary reinforcement in rats as a function of information value and reliability of the stimulus. Journal of Experimental Psychology, 64, 97-104.doi:10.1037/h0040364
4. Evans, M., Hastings, N., & Peacock, B. (1993). Statistical Distributions. New York: Wiley.
5. Gaioni, S. J. (1982). Blocking and nonsimultaneous compounds: Comparison of responding during compound conditioning and testing. The Pavlovian Journal of Biological Science, (January-March): 16-29.
6. Gallistel, C. R., & Gibbon, J. (2000). Time, rate and conditioning. Psychological Review, 107, 289-344.doi:10.1037/0033-295X.107.2.289
7. Gallistel, C. R., & Gibbon, J. (2002). The symbolic foundations of conditioned behavior. Mahwah, NJ: Erlbaum Associates.
8. Gibbon, J. (1977). Scalar expectancy theory and Weber's law in animal timing. Psychological Review, 84, 279-325.doi:10.1037/0033-295X.84.3.279
9. Jennings, D. J., Bonardi, C., & Kirkpatrick, K. (2007). Overshadowing and stimulus duration. Journal of Experimental Psychology. Animal Behavior Processes, 33, 464-475.doi:10.1037/0097-7403.33.4.464
10. Jennings, D. J., & Kirkpatrick, K. (2006). Interval duration effects on blocking in appetitive conditioning. Behavioural Processes, 71, 318-329. doi:10.1016/j.beproc.2005.11.007
11. Kirkpatrick, K., & Church, R. M. (1998). Are separate theories of conditioning and timing necessary? Behavioural Processes, 44, 163-182. doi:10.1016/S0376-6357(98)00047-3
12. Kirkpatrick, K., & Church, R. M. (2000). Stimulus and temporal cues in classical conditioning. Journal of Experimental Psychology. Animal Behavior Processes, 26, 206-219.doi:10.1037/0097-7403.26.2.206
13. Kirkpatrick, K., & Church, R. M. (2003). Tracking of the expected time to reinforcement in temporal conditioning procedures. Learning & Behavior, 31, 3-21.
14. Kohler, E. A., & Ayres, J. J. B. (1982). Blocking with serial and simultaneous compounds in a trace conditioning procedure. Animal Learning & Behavior, 10, 277-287.
15. Mackintosh, N. J. (1975). A theory of attention: Variations in the associability of stimuli with reinforcement. Psychological Review, 82, 276-298. doi:10.1037/h0076778
16. Mackintosh, N. J. (1976). Overshadowing and stimulus intensity. Animal Learning & Behavior, 4, 186-192.
17. Moore, J. W., & Choi, J.-S. (1997). The TD model of classical conditioning: Response topography and brain implementation. In Donahoe, J. W., & Dorsel, V. P. (Eds.), Neural-networks models of cognition (pp. 387-405). New York: Elsevier Science.
18. Pearce, J. M., & Hall, G. (1980). A model for Pavlovian learning: Variations in the effectiveness of conditioned but not unconditioned stimuli. Psychological Review, 87, 532-552. doi:10.1037/0033-295X.87.6.532
19. Rescorla, R. A., & Wagner, A. R. (1972). A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement. In Black, A. H., & Prokasy, W. F. (Eds.), Classical conditioning: II. Theory and research (pp. 64-99). New York: Appleton-Century-Crofts.
20. Savastano, H. I., & Miller, R. R. (1998). Time as content in Pavlovian conditioning. Behavioural Processes, 44, 147-162.doi:10.1016/S0376-6357(98)00046-1
21. Sutton, R. S., & Barto, A. G. (1987). A temporal difference model of classical conditioning. In Proceedings of the Seventh Annual Conference of the Cognitive Science Society (pp. 355-378). Erlbaum.
22. Sutton, R. S., & Barto, A. G. (1990). Time derivative models of Pavlovian reinforcement. In Gabriel, M. R., & Moore, J. W. (Eds.), Learning and computational neuroscience: Foundations of adaptive networks (pp. 497-537). Cambridge, MA: MIT Press.
23. Vogel, E. H., Brandon, S. E., & Wagner, A. R. (2000). Stimulus representation in SOP II: An application to inhibition of delay. Behavioural Processes, 110, 67-72.