Timing in simple conditioning and occasion setting: A neural network approach

Behavioural Processes

Volumn 45, Issue 1-3, 1999, Pages 33-57

  Buhusi, Catalin V ^a   Schmajuk, Nestor A ^a  

^a DUKE UNIVERSITY   (United States)

Author keywords

Blocking; Classical conditioning; Configuration; Neural networks; Occasion setting; Timing

Indexed keywords

ARTICLE; ARTIFICIAL NEURAL NETWORK; CONDITIONING; MODEL; NONHUMAN; REACTION TIME; TIME;

EID: 0032974481     PISSN: 03766357     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0376-6357(99)00008-X     Document Type: Article

References (37)

1. Barnet R.C., Grahame N.J., Miller R.R. Temporal encoding as a determinant of blocking. J. Exp. Psychol.: Anim. Behav. Process. 19(4):1993;327-341.
2. Buhusi C.V., Schmajuk N.A. Attention, configuration and hippocampal function. Hippocampus. 6(6):1996;621-642.
3. Church, R.M., Broadbent, H.A., 1990. A connectionist model of timing. In: Commons, M.L. , Grossberg, S., Staddon, J.E.R. (Eds.), Quantitative models of behavior: Neural networks and conditioning, Erlbaum, Hillsdale, NJ, pp. 225-240.
4. Desmond J.E., Moore J.W. Adaptive timing in neural networks: The conditioned response. Biol. Cybern. 58:1988;405-415.
5. Esmoriz-Arranz F.J., Miller R.R., Matute H. Blocking of subsequent and antecedent events. J. Exp. Psychol.: Anim. Behav. Process. 23(2):1997;145-156.
6. Gibbon J. Scalar expectancy and Weber's law in animal timing. Psychol. Rev. 84:1977;279-325.
7. Goddard M.J., Jenkins H.M. Blocking of a CS-US association by a US-US association. J. Exp. Psychol.: Anim. Behav. Process. 14:1988;177-186.
8. Grossberg S., Merrill J.W.L. A neural network model of adaptively timed reinforcement learning and hippocampal dynamics. Cogn. Brain Res. 1:1992;3-38.
9. Grossberg S., Schmajuk N.A. Neural dynamics of adaptive timing and temporal discrimination during associative learning. Neural Netw. 2:1989;79-102.
10. Holland. P.C., 1983. Occasion-setting in Pavlovian feature positive discriminations. In: Commons, M.L., Herrnstein, R.J., Wagner, A.R. (Eds.), Quantitative analyses of behavior: Discrimination processes, Ballinger, New York, vol. 4, pp. 183-206.
11. Holland, P.C., 1992. Occasion setting in Pavlovian conditioning. In: Medin, D. (Ed.), The psychology of learning and motivation, Academic Press, San Diego, CA, vol. 2, pp. 69-125.
12. Holland. P.C., 1998. Temporal control in Pavlovian occasion setting. Behav. Process. 44, 225-236.
13. Holland P.C., Hamlin P.A., Parsons J.P. Temporal specificity in serial feature-positive discrimination learning. J. Exp. Psychol.: Anim. Behav. Process. 23(1):1997;95-109.
14. Kamin, L.J., 1969. Predictability, surprise, attention and conditioning. In: Campbell, B.A., Church, R.M. (Eds.), Punishment and aversive behavior, Appleton-Century-Crofts, New York, pp. 279-296.
15. Killeen P.R., Fetterman J.G. A behavioral theory of timing. Psychol. Rev. 95:1988;274-295.
16. Lamoureux, J.A., Buhusi, C.V., Schmajuk, N.A., 1998. A real-time theory of Pavlovian conditioning: Simple stimuli and occasion setters. In: Schmajuk, N.A., Holland, P.C. (Eds.), Occasion Setting: Associative Learning and Cognition in Animals, American Psychological Association, Washington, DC, pp. 383-424.
17. Machado A. Learning the temporal dynamics of behavior. Psychol. Rev. 104(2):1997;241-265.
18. Mackintosh, N.J., 1983. Conditioning and Associative Learning. Clarendon Press, Oxford, p. 100.
19. Meck W.H., Church J. Abstraction of temporal attributes. J. Exp. Psychol.: Anim. Behav. Process. 10:1982;1-29.
20. Meck W.H., Church J. Cholinergic modulation of the content of temporal memory. Behav. Neurosci. 101:1987;457-464.
21. Moore, J.W., Choi, J.-S., 1998. Conditioned stimuli are occasion setters. In: Schmajuk, N.A., Holland, P.C. (Eds.), Occasion Setting: Associative Learning and Cognition in Animals, American Psychological Association, Washington, DC, pp. 279-318.
22. Moore J. W., Stickney K.J. Formation of attentional-associative networks in real-time: Role of the hippocampus and implications for conditioning. J. Comp. Physiol. Psychol. 8:1980;207-217.
23. Rescorla, R.A., Wagner, A.R., 1972. A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement. In: Black, A.H., Prokasy, W.F. (Eds.), Classical conditioning II: Current research and theory, Appleton-Century-Crofts, New York, pp. 64-99.
24. Roberts W.A., Cheng K., Cohen J.S. Timing light and tone signals in pigeons. J. Exp. Psychol.: Anim. Behav. Process. 15:1989;23-25.
25. Rumelhart, D.E., Hinton, G.E., Williams, R.J., 1986. Learning internal representations by error propagation. In: Rumelhart, D.E., McClelland, J.L. (Eds.), Parallel distributed processing, MIT Press, Cambridge, MA, vol. 1, pp. 318-362.
26. Schmajuk N.A. Role of the hippocampus in temporal and spatial navigation: An adaptive neural network. Behav. Brain Res. 39:1990;205-229.
27. Schmajuk, NT.A., 1997. Animal learning and cognition: A neural network approach. Cambridge University Press, New York.
28. Schmajuk N.A., Buhusi C.V. Occasion setting, stimulus configuration, and the hippocampus. Behav. Neurosci. 111(2):1997;235-258.
29. Schmajuk N.A., DiCarlo J.J. Stimulus configuration, classical conditioning, and the hippocampus. Psychol. Rev. 99:1992;268-305.
30. Schmajuk N.A., Lamoureux J.A., Holland P.C. Occasion setting: A neural network approach. Psychol. Rev. 105(1):1998;3-32.
31. Schmajuk N.A., Moore J.W. The hippocampus and the classically conditioned nictitating membrane response: A real-time attentional-associative model. Psychobiology. 46:1988;20-35.
32. Schreurs B.G., Westbrook R.F. The effect of changes in the CS-US interval during compound conditioning upon an otherwise blocked element. Q. J. Exp. Psychol. 34B:1982;19-30.
33. Smith M.C. CS-US interval and US intensity in classical conditioning of the rabbit's nictitating membrane response. J. Comp. Physiol. Psychol. 3:1968;679-687.
34. Staddon, J.E.R., Higa, J., 1999. Time and memory: towards a pacemaker-free theory of interval timing. J. Exp. Anal. Behav. 71.
35. Sutton, R.S., Barto, A.G., 1990. Time-derivative models of Pavlovian reinforcement. In: Gabriel, M., Moore, J. (Eds.), Learning and computational neuroscience: Foundations of adaptive networks, MIT Press, Cambridge, MA, pp. 497-537.
36. Werbos, P., 1974. Beyond regression: New tools for prediction and analysis in the behavioral sciences. Doctoral dissertation, Harvard University, Cambridge, MA.
37. Zimmer-Hart C.L., Rescorla R.A. Extinction of Pavlovian conditioned inhibition. J. Comp. Physiol. Psychol. 86:1974;837-845.