Interval Timing as an Emergent Learning Property

Psychological Review

Volumn 110, Issue 1, 2003, Pages 126-144

  Dragoi, Valentin ^b   Staddon, J E R ^a   Palmer, Richard G ^a   Buhusi, Catalin V ^a  

^a DUKE UNIVERSITY   (United States)

^b MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; HUMAN; INSTRUMENTAL CONDITIONING; LEARNING; PERIODICITY; PSYCHOLOGICAL MODEL; TIME PERCEPTION;

CONDITIONING, OPERANT; HUMANS; LEARNING; MODELS, PSYCHOLOGICAL; PERIODICITY; TIME PERCEPTION;

EID: 85047687985     PISSN: 0033295X     EISSN: None     Source Type: Journal    
DOI: 10.1037/0033-295X.110.1.126     Document Type: Article

References (57)

1. Breukelaar, J. W., & Dalrymple-Alford, J. C. (1999). Effects of lesions to the cerebellar vermis and hemispheres on timing and counting in rats. Behavioral Neuroscience, 113, 78-90.
2. Buhusi, C. V., & Schmajuk, N. A. (1999). Timing in simple conditioning and occasion setting: A neural network approach. Behavioural Processes, 45, 33-57.
3. Cahill, G. M., Hurd, M. W., & Batchelor, M. M. (1998). Circadian rhythmicity in the locomotor activity of larval zebrafish. Neuroreport, 26, 3445-3449.
4. Catania, A. C. (1970). Reinforcement schedules and the psychophysical judgements: A study of some temporal properties of behavior. In W. N. Schoenfeld (Ed.), The theory of reinforcement schedules (pp. 1-42). New York: Appleton-Century-Crofts.
5. Catania, A. C., & Reynolds, G. S. (1968). A quantitative analysis of the responding maintained by interval schedules of reinforcement. Journal of the Experimental Analysis of Behavior, 11, 327-383.
6. Cevik, M. O. (2000). Changes in signal durations and methamphetamine on duration discrimination. Unpublished doctoral dissertation, Indiana University, Bloomington.
7. Church, R. M. (1984). Properties of the internal clock. In J. Gibbon & L. G. Allan (Eds.), Annals of the New York Academy of Sciences: Timing and time perception (pp. 566-582). New York: New York Academy of Sciences.
8. Church, R. M., & Broadbent, H. A. (1990). A connectionist model of timing. In M. L. Commons, S. Grossberg, & J. E. R. Staddon (Eds.), Quantitative models of behavior: Neural networks and conditioning (pp. 135-155). Hillsdale, NJ: Erlbaum.
9. Church, R. M., Meck, W. H., & Gibbon, J. (1994). Application of scalar timing theory to individual trials. Journal of Experimental Psychology: Animal Behavior Processes, 20, 135-155.
10. Clark, F. C. (1964). Effects of repeated VI reinforcement and extinction upon operant behavior. Psychological Reports, 15, 943-955.
11. Dragoi, V. (1997). A dynamic theory of acquisition and extinction in operant learning. Neural Networks, 10, 201-229.
12. Dragoi, V., Sharma, J., & Sur, M. (2000). Adaptation-induced plasticity of orientation tuning in adult visual cortex. Neuron, 28, 287-298.
13. Dragoi, V., & Staddon, J. E. R. (1999). The dynamics of operant conditioning. Psychological Review, 106, 20-61.
14. Ferster, C. B., & Skinner, B. F. (1957). Schedules of reinforcement. New York: Appleton-Century-Crofts.
15. Gibbon, J. (1977). Scalar expectancy theory and Weber's law in animal timing. Psychological Review, 84, 279-325.
16. Gibbon, J. (1991). Origins of scalar timing. Learning and Motivation, 22, 3-38.
17. Gibbon, J. (1995). Dynamics of time matching: Arousal makes better seem worse. Psychonomic Bulletin & Review, 2, 208-215.
18. Gibbon, J., & Church, R. M. (1992). Comparison of variance and covariance patterns in parallel and serial theories of timing. Journal of the Experimental Analysis of Behavior, 57, 393-406.
19. Grossberg, S., & Schmajuk, N. A. (1989). Neural dynamics of adaptive timing and temporal discrimination during associative learning. Neural Networks, 2, 79-102.
20. Higa, J. J., & Staddon, J. E. R. (1997). Dynamic models of rapid temporal control in animals. In C. M. Bradshaw & E. Szabadi (Eds.), Time and behavior: Psychological and neurobiological analyses (pp. 1-40). Amsterdam: Elsevier Science.
21. Higa, J. J., Wynne, C. D., & Staddon, J. E. (1991). Dynamics of time discrimination. Journal of Experimental Psychology: Animal Behavior Processes, 17, 281-291.
22. Kelleher, R. T., Fry, W., & Cook, L. (1959). Interresponse time distribution as a function of differential reinforcement of temporally spaced responses. Journal of the Experimental Analysis of Behavior, 2, 91-106.
23. Killeen, P. R. (1991). The behavior's time. In G. H. Bower (Ed.), The psychology of learning and motivation (pp. 295-334). New York: Academic Press.
24. Killeen, P. R., & Fetterman, J. G. (1988). A behavioral theory of timing. Psychological Review, 95, 274-285.
25. Leak, T. M., & Gibbon, J. (1995). Simultaneous timing of multiple intervals: Implications of the scalar property. Journal of Experimental Psychology: Animal Behavior Processes, 21, 3-19.
26. Machado, A. (1997a). Increasing the variability of response sequences in pigeons by adjusting the frequency of switching between two keys. Journal of the Experimental Analysis of Behavior, 68, 1-25.
27. Machado, A. (1997b). Learning the temporal dynamics of behavior. Psychological Review, 104, 241-265.
28. Machado, A., & Cevik, M. (1998). Acquisition and extinction under periodic reinforcement. Behavioural Processes, 44, 237-262.
29. Malott, R. W., & Gumming, W. W. (1964). Schedules of interresponse time reinforcement. Psychological Record, 14, 211-252.
30. Maricq, A. V., Roberts, V., & Church, R. M. (1981). Methamphetamine and time estimation. Journal of Experimental Psychology: Animal Behavior Processes, 7, 18-30.
31. Meck, W. H. (1996). Neuropharmacology of timing and time perception. Cognitive Brain Research, 3, 227-242.
32. Meck, W. H., Church, R. M., Wenk, G. L., & Olton, D. S. (1987). Nucleus basalis magnocellularis and medial septal area lesions differentially impair temporal memory. Journal of Neuroscience, 7, 3505-3511.
33. Mel, B. W. 1993). Synaptic integration in an excitable dendritic tree. Journal of Neurophysiology, 70, 1086-1101.
34. Mirmiran, M., Swaab, D. F., Kok, J. H., Hofman, M. A., Witting, W., & Van Gool, W. A. (1992). Circadian rhythms and the suprachiasmatic nucleus in perinatal development, aging and Alzheimer's disease. Progress in Brain Research, 93, 151-162.
35. Odum, A. L., Lieving, L. M., & Schaal, D. W. (2002). Effects of d-amphetamine in a temporal discrimination procedure: Selective changes in timing or rate dependency? Journal of the Experimental Analysis of Behavior, 78, 195-214.
36. Pearson, K. G., & Fourtner, C. R. (1975). Nonspiking interneurons in walking system of the cockroach. Journal of Neurophysiology, 38, 33-52.
37. Perrett, S. P., Ruiz, B. P., & Mauk, M. D. (1993). Cerebellar cortex lesions disrupt learning-dependent timing of conditioned eyelid responses. Journal of Neuroscience, 13, 1708-1718.
38. Richelle, M., & Lejeune, H. (1980). Time in animal behavior. Oxford, England: Pergamon.
39. Salinas, E., & Abbott, L. F. (1996). A model of multiplicative neural responses in parietal cortex. Proceedings of the National Academy of Sciences USA, 93, 11956-11961.
40. Santi, A., Weise, L., & Kuiper, D. (1995). Memory for event duration in rats. Learning and Motivation, 26, 83-100.
41. Schneider, B. (1969). A two-state analysis of fixed-interval responding in the pigeon. Journal of the Experimental Analysis of Behavior, 12, 667-687.
42. Shurtleff, D., Raslear, T. G., Genovese, R. F., & Simmons, L. (1992). Perceptual bisection in rats: The effects of physostigmine, scopolamine and pirenzepine. Physiology and Behavior, 51, 381-390.
43. Sidman, M. (1956). Time discrimination and behavioral interaction in a free operant situation. Journal of Comparative and Physiological Psychology, 49, 469-473.
44. Spetch, M. L., & Treit, D. (1984). The effect of d-amphetamine on short-term memory for time in pigeons. Pharmacology Biochemistry and Behavior, 21, 663-666.
45. Staddon, J. E. R. (1965). Some properties of spaced responding in pigeons. Journal of the Experimental Analysis of Behavior, 8, 19-27.
46. Staddon, J. E. R. (1977). Schedule-induced behavior. In W. K. Honig & J. E. R. Staddon (Eds.), Handbook of operant behavior (pp. 125-152). Englewood Cliffs, NJ: Prentice-Hall.
47. Staddon, J. E. R. (2001). Adaptive dynamics: The theoretical analysis of behavior. Cambridge, MA: MIT Press.
48. Staddon, J. E. R., Chelaru, I. M., & Higa, J. J. (2002). A tuned-trace theory of interval-timing dynamics. Journal of the Experimental Analysis of Behavior, 77, 105-124.
49. Staddon, J. E. R., & Higa, J. J. (1999). Time and memory: Towards a pacemaker-free theory of interval timing. Journal of the Experimental Analysis of Behavior, 71, 215-251.
50. Staddon, J. E. R., & Simmelhag, V. G. (1971). The "superstition" experiment: A reexamination of its implications for the principles of adaptive behavior. Psychological Review, 78, 3-43.
51. Staddon, J. E. R., & Zhang, Y. (1991). On the assignment-of-eredit problem in operant learning. In M. L. Commons, S. Grossberg, & J. E. R. Staddon (Eds.), Neural networks of conditioning and action, the XIIth Harvard Symposium (pp. 279-293). Hillsdale, NJ: Erlbaum.
52. Turek, F. W. (1994). Circadian rhythms. Recent Progress in Hormone Research, 49, 43-90.
53. Treisman, M. (1963). Temporal discrimination and the indifference interval: Implications for a model of the internal clock. Psychological Monographs, 77, 1-31.
54. Welsh, D. K., Logothetis, D. E., Meister, M., & Reppert, S. M. (1995). Individual neurons dissociated from rat suprachiasmatic nucleus express independently phased circadian firing rhythms. Neuron, 14, 697-706.
55. Welzl, H., Berz, S., & Battig, K. (1991). The effects of the noncompetitive NMDA receptor antagonist MK 801 on DRL performance in rats. Psychobiology, 19, 211-216.
56. Wilson, M. P., & Keller, F. S. (1953). On the selective reinforcement of spaced responses. Journal of Comparative and Physiological Psychology, 46, 190-193.
57. Zeiler, M. D., & Powell, D. G. (1994). Temporal control in fixed-interval schedules. Journal of the Experimental Analysis of Behavior, 61, 1-9.