An adaptive drift-diffusion model of interval timing dynamics

Behavioural Processes

Volumn 95, Issue , 2013, Pages 90-99

  Luzardo, Andre ^a   Ludvig, Elliot A ^b   Rivest, François ^c  

^a CHAMPALIMAUD FOUNDATION   (Portugal)

^b Princeton University   (United States)

^c ROYAL MILITARY COLLEGE OF CANADA   (Canada)

Author keywords

Computational models; Cyclic schedules; Drift diffusion processes; Interval timing; Learning; Pigeons

Indexed keywords

BEHAVIORAL RESPONSE; BIRD; CYCLICITY; HABITUATION; LEARNING; MODEL; TIMESCALE;

ADAPTATION; ANIMAL EXPERIMENT; ARTICLE; CONTROLLED STUDY; MODEL; NONHUMAN; PIGEON; PSYCHODYNAMICS; RESPONSE TIME; TIME ADAPTIVE DRIFT DIFFUSION MODEL;

ANIMALS; BRAIN; COLUMBIDAE; COMPUTER SIMULATION; LEARNING; MODELS, NEUROLOGICAL; REACTION TIME; REINFORCEMENT SCHEDULE; TIME PERCEPTION;

ANIMALIA; COLUMBA;

EID: 84876886431     PISSN: 03766357     EISSN: 18728308     Source Type: Journal    
DOI: 10.1016/j.beproc.2013.02.003     Document Type: Article

References (44)

1. Akaike H. A new look at the statistical model identification. IEEE Trans. Automat. Control 1974, 19:716-723.
2. Balci F., Gallistel C.R., Allen B.D., Frank K.M., Gibson J.M., Brunner D. Acquisition of peak responding: what is learned?. Behav. Process. 2009, 80:67-75.
3. Balsam P.D., Drew M.R., Yang C. Timing at the start of associative learning. Learn. Motiv. 2002, 33:141-155.
4. Bogacz R. Optimal decision-making theories: linking neurobiology with behaviour. Trends Cogn. Sci. 2007, 11:118-125.
5. Buhusi C.V., Meck W.H. What makes us tick? Functional and neural mechanisms of interval timing. Nat. Rev. Neurosci. 2005, 6:755-765.
6. Burnham K.P., Anderson D.R. Model Selection and Multi-Model Inference 2002, Springer, New York.
7. Catania A.C. Reinforcement schedules and psychophysical judgments. The Theory of Reinforcement Schedules 1970, Appleton-Century-Crofts, New York. W.N. Schoenfeld (Ed.).
8. Church R.M., Lacourse D.M. Serial pattern learning in temporal intervals. Anim. Learn. Behav. 1998, 26.
9. Church R.M., Meck W.H., Gibbon J. Application of scalar timing theory to individual trials. J. Exp. Psychol. Anim. Behav. Process. 1994, 20:135-155.
10. Gallistel C.R., Gibbon J. Time, rate, and conditioning. Psychol. Rev. 2000, 107:289-344.
11. Galtress T., Marshall A.T., Kirkpatrick K. Motivation and timing: clues for modeling the reward system. Behav. Process. 2012, 90:142-153.
12. Gibbon J. Scalar expectancy theory and Weber's Law in animal timing. Psychol. Rev. 1977, 84:279-325.
13. Gibbon J., Church R.M., Meck W.H. Scalar timing in memory. Timing and Time Perception 1984, New Yord Academy of Sciences, New York. J. Gibbon, L.G. Allen (Eds.).
14. Gold J.I., Shadlen M.N. The neural basis of decision making. Annu. Rev. Neurosci. 2007, 30:535-574.
15. Grondin S. Timing and time perception: a review of recent behavioral and neuroscience findings and theoretical directions. Attent. Percept. Psychophys. 2010, 72:561-582.
16. Higa J.J., Wynne C.D., Staddon J.E. Dynamics of time discrimination. J. Exp. Psychol. Anim. Behav. Process. 1991, 17:281-291.
17. Innis N.K., Staddon J.E. Temporal tracking on cyclic-interval reinforcement schedules. J. Exp. Anal. Behav. 1971, 16:411-423.
18. Kehoe E.J., Olsen K.N., Ludvig E.A., Sutton R.S. Scalar timing varies with response magnitude in classical conditioning of the nictitating membrane response of the rabbit (Oryctolagus cuniculus). Behav. Neurosci. 2009, 123:212-217.
19. Killeen P.R., Fetterman J.G. A behavioral theory of timing. Psychol. Rev. 1988, 95:274-295.
20. Komura Y., Tamura R., Uwano T., Nishijo H., Kaga K., Ono T. Retrospective and prospective coding for predicted reward in the sensory thalamus. Nature 2001, 412:546-549.
21. Lebedev M.A., O'Doherty J.E., Nicolelis M.A. Decoding of temporal intervals from cortical ensemble activity. J. Neurophysiol. 2008, 99:166-186.
22. Leite F.P., Ratcliff R. Modeling reaction time and accuracy of multiple-alternative decisions. Attent. Percept. Psychophys. 2010, 72:246-273.
23. Leon M.I., Shadlen M.N. Representation of time by neurons in the posterior parietal cortex of the macaque. Neuron 2003, 38:317-327.
24. Lowe C.F., Davey G.C., Harzem P. Effects of reinforcement magnitude on interval and ratio schedules. J. Exp. Anal. Behav. 1974, 22:553-560.
25. Ludvig E.A., Balci F., Longpre K.M. Timescale dependence in a conditional temporal discrimination procedure. Behav. Process. 2008, 77:357-363.
26. Ludvig E.A., Conover K., Shizgal P. The effects of reinforcer magnitude on timing in rats. J. Exp. Anal. Behav. 2007, 87:201-218.
27. Ludvig E.A., Staddon J.E. The conditions for temporal tracking under interval schedules of reinforcement. J. Exp. Psychol. Anim. Behav. Process. 2004, 30:299-316.
28. Ludvig E.A., Staddon J.E. The effects of interval duration on temporal tracking and alternation learning. J. Exp. Anal. Behav. 2005, 83:243-262.
29. Ludvig E.A., Sutton R.S., Kehoe E.J. Evaluating the TD model of classical conditioning. Learn. Behav. 2012, 40:305-319.
30. Machado A. Learning the temporal dynamics of behavior. Psychol. Rev. 1997, 104:241-265.
31. Matell M.S., Meck W.H. Cortico-striatal circuits and interval timing: coincidence detection of oscillatory processes. Brain Res. Cogn. Brain Res. 2004, 21:139-170.
32. Ratcliff R. A theory of memory retrieval. Psychol. Rev. 1978, 85:59-108.
33. Ratcliff R. A diffusion model account of response time and accuracy in a brightness discrimination task: fitting real data and failing to fit fake but plausible data. Psychon. Bull. Rev. 2002, 9:278-291.
34. Ratcliff R., McKoon G. The diffusion decision model: theory and data for two-choice decision tasks. Neural Comput. 2008, 20:873-922.
35. Ratcliff R., Rouder J.N. A diffusion model account of masking in two-choice letter identification. J. Exp. Psychol. Hum. Percept. Perform. 2000, 26:127-140.
36. Reutimann J., Yakovlev V., Fusi S., Senn W. Climbing neuronal activity as an event-based cortical representation of time. J. Neurosci. 2004, 24:3295-3303.
37. Rivest F., Bengio Y. Adaptive Drift-Diffusion Process to Learn Time Intervals 2011, Cornell University Library. arxiv:1103.2382v1.
38. Roberts S. Isolation of an internal clock. J. Exp. Psychol. Anim. Behav. Process. 1981, 7:242-268.
39. Rushworth M.F., Noonan M.P., Boorman E.D., Walton M.E., Behrens T.E. Frontal cortex and reward-guided learning and decision-making. Neuron 2011, 70:1054-1069.
40. Schneider B.A. A two-state analysis of fixed-interval responding in the pigeon. J. Exp. Anal. Behav. 1969, 12:677-687.
41. Simen P., Balci F., de Souza L., Cohen J.D., Holmes P. A model of interval timing by neural integration. J. Neurosci. 2011, 31:9238-9253.
42. Staddon J.E., Chelaru I.M., Higa J.J. A tuned-trace theory of interval-timing dynamics. J. Exp. Anal. Behav. 2002, 77:105-124.
43. Staddon J.E., Higa J.J. Time and memory: towards a pacemaker-free theory of interval timing. J. Exp. Anal. Behav. 1999, 71:215-251.
44. Zeiler M.D., Powell D.G. Temporal control in fixed-interval schedules. J. Exp. Anal. Behav. 1994, 61:1-9.