A model of interval timing by neural integration

Journal of Neuroscience

Volumn 31, Issue 25, 2011, Pages 9238-9253

  Simen, Patrick ^a   Balci, Fuat ^a   deSouza, Laura ^a   Cohen, Jonathan D ^a   Holmes, Philip ^a  

^a PRINCETON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACCURACY; ARTICLE; BEHAVIOR; CONTROLLED STUDY; DECISION MAKING; INHIBITION KINETICS; LEARNING; NERVE CELL EXCITABILITY; NEURAL INTEGRATION; NEUROTRANSMISSION; POISSON DISTRIBUTION; PREDICTION; PRIORITY JOURNAL; PSYCHOPHYSIOLOGY; RESPONSE TIME; REWARD; SPIKE WAVE; STATISTICAL MODEL; TIME PERCEPTION;

ACTION POTENTIALS; ANIMALS; BIOLOGICAL CLOCKS; COMPUTER SIMULATION; HUMANS; MODELS, NEUROLOGICAL; NERVE NET; NEURONS; SYNAPTIC TRANSMISSION; TIME FACTORS;

EID: 79959659622     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.3121-10.2011     Document Type: Article

References (96)

1. Ahrens MB, Sahani M (2008) Inferring elapsed time from stochastic neural processes. Adv Neural Inform Processing 20:1-8.
2. Balci F, Ludvig EA, Gibson JM, Allen BD, Frank KM, Kapustinski BJ, Fedolak ET, Brunner D (2008a) Pharmacological manipulations of interval timing on the peak procedure in mice. Psychopharmacology 201:67-80.
3. Balci F, Papachristos EB, Gallistel CR, Brunner D, Gibson J, Shumyatsky GP (2008b) Interval timing in genetically modified mice: a simple paradigm. Genes Brain Behav 7:373-384.
4. Balci F, Freestone D, Gallistel CR (2009a) Risk assessment in man and mouse. Proc Natl Acad Sci U S A, USA 106:2459-2463.
5. Balci F, Gallistel CR, Allen BD, Frank KM, Gibson JM, Brunner D (2009b) Acquisition of peak responding: what is learned? Behav Processes 80:67-75.
6. Balci F, Simen PA, Niyogi R, Saxe A, Hughes J, Holmes P, Cohen JD (2011) Acquisition of decision making criteria: reward rate ultimately beats accuracy. Atten Percept Psychophys 73:640-657.
7. Bevins R, Ayres JJB (1995) One-trial context fear conditioning as a function of the interstimulus interval. Anim Learn Behav 23:400-410.
8. Bogacz R, Brown E, Moehlis J, Holmes P, Cohen JD (2006) The physics of optimal decision making: a formal analysis of models of performance in two-alternative forced choice tasks. Psychol Rev 113:700-765.
9. Brody CD, Hernandez A, Zainos A, Romo R (2003) Timing and neural encoding of somatosensory parametric working memory in macaque prefrontal cortex. Cereb Cortex 13:1196-1207.
10. Brunner D, Kacelnik A, Gibbon J (1992) Optimal foraging and timing processes in the starling (Starling vulgaris): effect of inter-capture interval. Anim Behav 44:597-613.
11. Buhusi CV, Meck WH (2005) What makes us tick? Functional and neural mechanisms of interval timing. Nat Rev Neurosci 6:755-765.
12. Buhusi CV, Aziz D, Winslow D, Carter RE, Swearingen JE, Buhusi MC (2009) Interval timing accuracy and scalar timing in C57BL/6 mice. Behav Neurosci 123:1102-1113.
13. Catania AC (1970) Reinforcement schedules and psychophysical judgments: a study of some temporal properties of behavior. In: The theory of reinforcement schedules (Schoenfeld WN, ed), pp. 1-42. New York: Appleton-Century-Crofts.
14. Cheng K, Westwood R (1993) Analysis of single trials in pigeons timing performance. J Exp Psychol Anim Behav Process 19:59-67.
15. Cheng K, Miceli P (1996) Modeling timing performance on the peak procedure. Behav Process 37:137-156.
16. Church RM, Meck WH, Gibbon J (1994) Application of scalar timing theory to individual trials. J Exp Psychol Anim Behav Process 20:135-155.
17. Church RM, Lacourse DM, Crystal JD (1998) Temporal search as a function of the variability of interfood intervals. J Exp Psychol Anim Behav Process 24:291-315.
18. Church RM, Broadbent HA (1992) A connectionist model of timing. In: Neural network models of conditioning and action (Commons ML, Grossberg S, Staddon JER, eds), pp. 225-240. Hillsdale, NJ: Erlbaum.
19. Cohen M, Grossberg S (1983) Absolute stability of global pattern formation and parallel memory storage by competitive neural networks. IEEE Trans Systems Man Cybern 13:815-826.
20. Cragg BG, Temperley HNV (1955) Memory-the analogy with ferromagnetic hysteresis. Brain 78:304-315.
21. Davis M, Schlesinger LS, Sorenson, CA (1989) Temporal specificity of fear conditioning: Effects of different conditioned stimulus-unconditioned stimulus intervals on the fear-potentiated startle effect. J Exp Psychol Anim Behav Process 15:295-310.
22. Dragoi V, Staddon JE, Palmer RG, Buhusi VC (2003) Interval timing as an emergent learning property. Psychological Review 110:126-144.
23. Drew MR, Zupan B, Cooke A, Couvillon PA, Balsam, PD (2005) Temporal control of conditioned responding in goldfish. J Exp Psychol Anim Behav Process 31:31-39.
24. Durstewitz D (2003) Self-organizing neural integrator predicts interval times through climbing activity. J Neurosci 23 (12):5342-5353.
25. Eckhoff P, Holmes P, Law C, Connolly P, Gold J (2008) On diffusion processes with variable drift rates as models for decision making during learning. New J Physics 10:015006.
26. Gallistel CR, Gibbon J (2000) Time, rate and conditioning. Psychol Rev 107:289-344.
27. Gardiner CW (2004) Handbook of stochastic methods, Ed 3. New York: Springer.
28. Gerstein GL, Mandelbrot B (1964) Random walk models for the spike activity of a single neuron. Biophysical J 4:41-68.
29. Gerstner W (1999) Population dynamics of spiking neurons: fast transients, asynchronous states, and locking. Neural Comput 12:43-89.
30. Gibbon J (1977) Scalar expectancy theory and Weber's law in animal timing. Psychol Rev 84:279-325.
31. Gibbon J (1992) Ubiquity of scalar timing with a Poisson clock. J Math Psychol 35:283-293.
32. Gibbon J, Church RM (1981) Time left: linear versus logarithmic subjective time. J Exp Psychol Anim Behav Process 7:87-108.
33. Gibbon J, Church RM (1990) Representation of time. Cognition 37:23-54.
34. Gibbon J, Church RM, Meck WH (1984) Scalar timing in memory. Ann N Y 423:52-77.
35. Gold JI, Shadlen MN (2000) Representation of a perceptual decision in developing oculomotor commands. Nature 404:390-394.
36. Gold JI, Shadlen MN (2001) Neural computations that underlie decisions about sensory stimuli. Trends Cogn Sci 5:10-16.
37. Goldman MS (2009) Memory without feedback in a neural network. Neuron 61:621-634.
38. Goldman MS, Levine JH, Major G, Tank DW, Seung HS (2003) Robust persistent neural activity in a model integrator with multiple hysteretic dendrites per neuron. Cereb Cortex 13:1185-1195.
39. Grossberg S, Schmajuk NA (1989) Neural dynamics of adaptive timing and temporal discrimination during associative learning. Neural Netw 2:79-102.
40. Harth EM, Csermely TJ, Beek B, Lindsay RD (1970) Brain functions and neural dynamics. J Theor Biol 26:93-120.
41. Haß J, Blaschke S, Rammsayer T, Herrmann JM (2008) A neurocomputational model for optimal temporal processing. J Comp Neurosci 25:449-464.
42. Hertz J, Krogh A, Palmer RG (1991) Introduction to the theory of neural computation. In: Santa Fe Institute studies in the sciences of complexity lecture notes, Vol. 1. Redwood City, CA: Addison Wesley.
43. Higa JJ (1997) Rapid timing of a single transition in interfood interval duration by rats. Anim Learn Behav 25:177-184.
44. Higham DJ (2001) An algorithmic introduction to numerical simulation of stochastic differential equations. Soc Indust Appl Math Rev 43:525-546.
45. Hudson TE, Maloney LT, Landy MS (2008) Optimal compensation for temporal uncertainty in movement planning. PLoS Comput Biol 4:e1000130.
46. Ivry RB, Richardson TC (2002) Temporal control and coordination: the multiple timer model. Brain Cogn 48:117-132.
47. Jackson AS (1960) Analog computation. New York: McGraw-Hill.
48. Jazayeri M, Shadlen, MN (2010) Temporal context calibrates interval timing. Nat Neurosci 13:1020-1026.
49. Jordan DW, Smith P (1999) Nonlinear ordinary differential equations, Ed 3. New York: Oxford UP.
50. Jorgensen B (1987) Exponential dispersion models. JRStat Soc B Stat Methodol 49:127-162.
51. Karmarkar UR, Buonomano, DV (2007) Timing in the absence of clocks: encoding time in neural network states. Neuron 53:427-438.
52. Killeen PR, Fetterman JG (1988) A behavioral theory of timing. Psychol Rev 95:274-295.
53. Kirkpatrick K (2002) Packet theory of conditioning and timing. Behav Process 57:89-106.
54. Komura Y, Tamura R, Uwano T, Nishijo H, Kaga K, Ono T (2001) Retrospective and prospective coding for predicted reward in the sensory thalamus. Nature 412:546-549.
55. Koulakov AA, Raghavachari S, Kepecs A, Lisman JE (2002) Model for a robust neural integrator. Nat Neurosci 5:775-782.
56. Lapique L (1907) Recherches quantitatives sur l'excitation e ́lectrique des nerfs traite ́e comme une polarization. J Physiol Pathol Genet 9:620-635.
57. Leon MI, Shadlen MN (2003) Representation of time by neurons in the posterior parietal cortex of the macaque. Neuron 38:317-327.
58. Link SW (1992) The wave theory of difference and similarity. Hillsdale, NJ: Lawrence Erlbaum.
59. Lo C-C, Wang X-J (2006) Cortico-basal ganglia circuit mechanism for a decision threshold in reaction time tasks. Nat Neurosci 9:956-963.
60. Luce RD (1986) Response times: their role in inferring elementary mental organization. New York: Oxford UP.
61. Ludvig EA, Sutton RS, Kehoe EJ (2008) Stimulus representation and the timing of reward-prediction errors. Neural Comput 20:3034-3054.
62. Macar F, Vidal F (2003) The CNV peak: an index of decision making and temporal memory. Psychophysiology 40:950-954.
63. Machado A (1997) Learning the temporal dynamics of behavior. Psychol Rev 104:241-265.
64. Major G, Tank DW (2004) Persistent neural activity: prevalence and mechanisms. Curr Opin Neurobiol 14:1-10.
65. Matell M, Meck WH (2004) Cortico-striatal circuits and interval timing: coincidence detection of oscillatory processes. Cognitive Brain Res 21 (139-170).
66. Matell MS, Portugal GS (2007) Impulsive responding on the peak-interval procedure. Behav Process 74:198-208.
67. Meck WH, Komeily-Zadeh FN, Church RM (1984) Two-step acquisition: modification of an internal clock's criterion. J Exp Psychol Anim Behav Process 10:297-306.
68. Miall RC (1989) The storage of time intervals using oscillating neurons. Neural Comput 1:359-371.
69. Mita A, Mushiake H, Shima K, Matsuzaka Y, Tanji J (2009) Interval time coding by neurons in the presupplementary and supplementary motor areas. Nat Neurosci 12:502-507.
70. Onn SP, Grace AA (2000) Amphetamine withdrawal alters bistable states and cellular coupling in rat prefrontal cortex and nucleus accumbens neurons recorded in vivo. J Neurosci 20:2332-2345.
71. Rakitin BC, Gibbon J, Penney TB, Malapani C, Hinton SC, Meck WH (1998) Scalar expectancy theory theory and peak-interval timing in humans. J Exp Psychol Anim Behav Process 24:15-33.
72. Ratcliff R, Rouder J (1998) Modeling response times for two-choice decisions. Psychol Sci 9:347-356.
73. Ratcliff R, McKoon G (2008) The diffusion decision model: theory and data for two-choice decision tasks. Neural Comput 20:873-922.
74. Renart A, de la Rocha J, Bartho P, Hollender L, Parga N, Reyes A, Harris K (2010) The asynchronous state in cortical circuits. Science 327:587-590.
75. Reutimann J, Yakovlev V, Fusi S, Senn W (2004) Climbing neuronal activity as an event-based cortical representation of time. J Neurosci 24:3295-3303.
76. Roberts S (1981) Isolation of an internal clock. J Exp Psychol Anim Behav Process 7:242-268.
77. Roitman J, Shadlen M (2002) Response of neurons in the lateral intraparietal area during a combined visual discrimination reaction time task. J Neurosci 22:9475-9489.
78. Ross S (1998) A first course in probability, Ed 5. Upper Saddle River, NJ: Prentice Hall.
79. Seung HS (1996) How the brain keeps the eyes still. Proc Natl Acad Sci U S A 93:13339-13344.
80. Seung HS, Lee DD, Reis BY, Tank DW (2000) The autapse: a simple illustration of short-term analog memory storage by tuned synaptic feedback. J Comput Neurosci 9:171-185.
81. Shadlen MN, Newsome WT (1998) The variable discharge of cortical neurons: implications for connectivity, computation, and information coding. J Neurosci 18:3870-3896.
82. Shadlen MN, Newsome WT (2001) Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey. J Neurophysiol 86:1916-1936.
83. Shea-Brown E, Rinzel J, Rakitin B, MalapaniC (2006) A firing-rate model of parkinsonian deficits in interval timing. Brain Res 1070:189-201.
84. Simen P, Cohen JD, Holmes P (2006) Rapid decision threshold modulation by reward rate in a neural network. Neural Netw 19:1013-1026.
85. Simen P, Contreras D, Buck C, Hu P, Holmes P, Cohen JD (2009) Reward rate optimization in two-alternative decision making: empirical tests of theoretical predictions. J Exp Psychol Human Percept Perform 35: 1865-1897.
86. Skellam JG (1946) The frequency distribution of the difference between two Poisson variates belonging to different populations. J R Stat Soc Ser A 109:296.
87. Smith PL (2010) From Poisson shot noise to the integrated Ornstein-Uhlenbeck process: Neurally principled models of information accumulation in decision-making and response time. J Math Psychol 54:266-283.
88. Treisman M (1963) Temporal discrimination and the indifference interval: implications for a model of the "internal clock." Psychol Monographs 77:1-31.
89. Usher M, McClelland JL (2001) The time course of perceptual choice: the leaky, competing accumulator model. Psychol Rev 108:550-592.
90. van Vreeswijk C, Sompolinsky H (1996) Chaos in neuronal networks with balanced excitatory and inhibitory activity. Science 274:1724-1726.
91. Wackermann J, Ehm W (2006) The dual klepsydra model of internal time representation and time reproduction. J Theoretical Biol 239:482-493.
92. Wald A (1947) Sequential analysis. New York: Wiley.
93. Wang XJ (2001) Synaptic reverberation underlying mnemonic persistent activity. Trends Neurosci 24:455-463.
94. Wilson HR, Cowan JD (1973) A mathematical theory of the functional dynamics of cortical and thalamic nervous tissue. Kybernetik 13:55-80.
95. Wynne CDL, Staddon J (1988) Typical delay determines waiting time on periodic-food schedules: static and dynamic tests. J Exp Anal Behav 50:197-210.
96. Yi L (2007) Applications of timing theories to a peak procedure. Behav Process 75:188-198.