Optimal temporal risk assessment

Frontiers in Integrative Neuroscience

Volumn 5, Issue , 2011, Pages

  Balci, Fuat ^a,b   Freestone, David ^c   Simen, Patrick ^b   Desouza, Laura ^b   Cohen, Jonathan D ^b   Holmes, Philip ^b,d  

^a KOÇ UNIVERSITY   (Turkey)

^b PRINCETON UNIVERSITY   (United States)

^c BROWN UNIVERSITY   (United States)

^d Princeton University   (United States)

Author keywords

Decision making; Interval timing; Optimality; Psychophysics; Reward maximization; Risk assessment; Uncertainty

Indexed keywords

ANIMAL BEHAVIOR; ANIMAL EXPERIMENT; BEHAVIOR; CONTROLLED STUDY; DATA ANALYSIS; DECISION MAKING; ENVIRONMENT; EVOLUTION; HUMAN; HUMAN EXPERIMENT; HYPOTHESIS; INTERVAL TIMING; NONHUMAN; OPTIMAL TEMPORAL RISK ASSESSMENT; PERCEPTION; PREDICTION; RAT; RESPONSE TIME; REVIEW; REWARD; RISK ASSESSMENT; SECONDARY ANALYSIS; TASK PERFORMANCE; TIME PERCEPTION; TIMING UNCERTAINTY;

EID: 82255182554     PISSN: 16625145     EISSN: None     Source Type: Journal    
DOI: 10.3389/fnint.2011.00056     Document Type: Review

References (71)

1. Allan, L. G. (2002). Are the referents remembered in temporal bisection? Learn. Motiv. 33, 10-31.
2. Balcells-Olivero, M., Cousins, M. S., and Seiden, L. S. (1998).Holtz-man and Harlan Sprague-Dawley rats: differences in DRL 72-sec performance and 8-hydroxy-di-propylaminotetralin-induced hypothermia. J. Pharmacol. Exp. Ther. 286, 742-752.
3. Balci, F., Freestone, D., and Gallistel, C. R. (2009). Risk assessment in man and mouse. Proc. Natl. Acad. Sci. U.S.A. 106, 2459-2463.
4. Balci, F., and Gallistel, C. R. (2006). Cross-domain transfer of quantitative discriminations: Is it all a matter of proportion? Psychon. Bull. Rev. 13, 636-642.
5. Balci, F., Papachristos, E. B., Gallistel, C. R., Brunner, D., Gibson, J., and Shumyatsky, G. P. (2008). Interval timing in the genetically modified mouse: a simple paradigm. Genes Brain Behav. 7, 373-384.
6. Balci, F., Simen, P., Niyogi, R., Saxe, A., Hughes, J., Holmes, P., and Cohen, J. D. (2011). Acquisition of decision-making criteria: reward rate ultimately beats accuracy. Atten. Percept. Psychophys. 73, 640-657.
7. Barnard, G. A. (1946). Sequential tests in industrial statistics. J. R. Stat. Soc. 8(Suppl.), 1-26.
8. Battaglia, P. W., and Schrater, P. R. (2007). Humans trade off viewing time and movement duration to improve visuomotor accuracy in a fast reaching task. J. Neurosci. 27, 6984-6994.
9. Blough, D. S. (1967). Stimulus generalization as a signal detection in pigeons. Science 158, 940-941.
10. Bogacz, R., Hu, P. T., Holmes, P., and Cohen, J. D.(2010). Do humanspro-duce the speed accuracy tradeoff that maximizes reward rate? Q. J. Exp. Psychol. 63, 863-891.
11. Bogacz, R., Shea-Brown, E., Moehlis, J., Holmes, P., and Cohen, J. D. (2006). The physics of optimal decision making: a formal analysis of models of performance in two-alternative forced choice tasks. Psychol. Rev. 113, 700-765.
12. Breukelaar, J. W., and Dalrymple-Alford, J. C. (1999). Effects of lesions to the cerebellar vermis and hemispheres on timing and counting in rats. Behav. Neurosci. 113, 78-90.
13. Brunner, D., Kacelnik, A., and Gibbon, J. (1992). Optimal foraging and timing processes in the starling, Sturnus vulgaris: effect of intercapture interval. Anim. Behav. 44, 597-613.
14. Catania, A. C. (1970). "Reinforcement schedules and psychophysical judgments: a study of some temporal properties of behavior," in The Theory of Reinforcement Schedules, ed. W. N. Schoenfeld (New York: Appleton-Century-Crofts), 1-42.
15. Cheng, R.-K., MacDonald, C. J., Williams, C. L., and Meck, W. H. (2008). Prenatal choline supplementation alters the timing, emotion, and memory performance (TEMP) of adult male and female rats as indexed by differential reinforcement of low-rate schedule behavior. Learn. Mem. 15, 153-162.
16. Church, R. M., and Deluty, M. Z. (1977). Bisection of temporal intervals. J. Exp. Psychol. Anim. Behav. Process. 3, 216-228.
17. Church, R. M., Lacourse, D. M., and Crystal, J. D. (1998). Temporal search as a function of the variability of interfood intervals. J. Exp. Psychol. Anim. Behav. Process. 24, 291-315.
18. Church, R. M., Meck, W. H., and Gibbon, J. (1994). Application of scalar timing theory to individual trials. J. Exp. Psychol. Anim. Behav. Process. 20, 135-155.
19. Cui, X. (2011). Hyperbolic discounting emerges from the scalar property of interval timing. Front. Integr. Neurosci. 5:24. doi: 10.3389/fnint.2011.00024
20. Davies, N. B. (1977). Prey selection and the search strategy of the spotted flycatcher (Muscicapa striata). Anim. Behav. 25, 1016-1033.
21. Dean, M., Wu, S.-W., and Maloney, L. T. (2007). Trading off speed and accuracy in rapid, goal-directed movements. J. Vis. 7, 1-12.
22. Drew, M. R., Zupan, B., Cooke, A., Couvillon, P. A., and Balsam, P. D. (2005). Temporal control of conditioned responding in goldfish. J. Exp. Psychol. Anim. Behav. Process. 31, 31-39.
23. Foote, A., and Crystal, J. (2007). Metacognition in rats. Curr. Biol. 17, 551-555.
24. Fowler, S. C., Pinkston, J., and Vorontsova, E. (2009). Timing and space usage are disrupted by amphetamine in rats maintained on DRL 24-s and DRL 72-s schedules of reinforcement. Psychopharmacology (Berl.) 204, 213-225.
25. Frazier, P., and Yu, A. J. (2008). Sequential hypothesis testing under stochastic deadlines. Adv. Neural Inf. Process. Syst. 20, 465-472.
26. Gallistel, C. R., King, A. P., Gottlieb, D., Balci, F., Papachristos, E. B., Szalecki, M., and Carbone, K.S. (2007). Is matching innate? J. Exp. Anal. Behav. 87, 161-199.
27. Gibbon, J. (1977). Scalar expectancy theory and Weber's law in animal timing. Psychol. Rev. 84, 279-325.
28. Gibbon, J., and Church, R. M. (1981). Time left: linear versus logarithmic subjective time. J. Exp. Psychol. Anim. Behav. Process. 7, 87-108.
29. Hudson, T. E., Maloney, L. T., and Landy, M. S. (2008). Optimal movement timing with temporally asymmetric penalties and rewards. PLoS Biol. 4, e1000130. doi: 10.1371/jour-nal.pcbi.1000130
30. Jazayeri, M., and Shadlen, M. N. (2010). Temporal context calibrates interval timing. Nat. Neurosci. 13, 1020-1026.
31. Jozefowiez, J., Staddon, J. E., and Cerutti, D. T. (2010). The behavioral economics of choice and interval timing. Psychol. Rev. 116, 519-539.
32. Kahneman, D., and Tversky, A. (1979). Prospect theory: an analysis of decisions under risk. Econometrica 47, 263-291.
33. Kacelnik, A., and Brunner, D. (2002). Timing and foraging: Gibbon's scalar expectancy theory and optimal patch exploitation. Learn. Motiv. 33, 177-195.
34. Killeen, P. R., and Fetterman, J. G. (1988). A behavioral theory of timing. Psychol. Rev. 95, 274-295.
35. Latham, P. E., Roudi, Y., Ahmadi, M., and Pouget, A. (2007). Deciding when to decide. Abstr. Soc. Neurosci. 33, 740.10.
36. Lewis, P. A., and Miall, R. (2003). Brain activation patterns during measurement of sub- and supra-second intervals. Neuropsychologia 41, 1583-1592.
37. Machado, A., and Keen, R. (2003). Temporal discrimination in a long operant chamber. Behav. Process. 62, 157-182.
38. Maddox, W. T., and Bohil, C. J. (1998). Base-rate and payoff effects in multidimensional perceptual categorization. J. Exp. Psychol. Learn. Mem. Cogn. 24, 1459-1482.
39. Matell, M. S., and Meck, W. H. (2004). Cortico-striatal circuits and interval timing: coincidence detection of oscillatory processes. Brain Res. Cogn. Brain Res. 21, 139-170.
40. Montemayor, C., and Balci, F. (2007). Compositionality in language and arithmetic. J. Theor. Philos. Psychol. 27, 53-72.
41. Orduña, V., Valencia-Torres, L., and Bouzas, A. (2009). DRL performance of spontaneously hypertensive rats: dissociation of timing and inhibition of responses. Behav. Brain Res. 201, 158-165.
42. Paterson, N. E., Balci, F., Campbell, U., Olivier, B., and Hana-nia, T. (2010). The triple reup-take inhibitor DOV216,303 exhibits limited antidepressant-like properties in the differential reinforcement of low-rate 72-sec responding assay, likely due to dopamine reup-take inhibition. J. Psychopharma-col. doi: 10.1177/0269881110364272 [Epub ahead of print].
43. Penney, T. B., Gibbon, J., and Meck, W. H. (2008). Categorical scaling of duration bisection in pigeons (Columba livia), mice (Mus musculus), and humans (Homo sapiens). Psychol. Sci. 19, 1103-1109.
44. Rachlin, H. (2006). Notes on discounting. J. Exp. Anal. Behav. 85, 425-435.
45. Rao, R. P. N. (2010). Decision making under uncertainty: a neural model based on partially observable Markov decision processes. Front. Comput. Neurosci. 4:146. doi: 10.3389/fncom.2010.00146
46. Rapoport, A., and Burkheimer, G. J. (1971). Models for deferred decision making. J. Math. Psychol. 8, 508-538.
47. Ratcliff, R. (1978). A theory of memory retrieval. Psychol. Rev. 83, 59-108.
48. Ratcliff, R., and McKoon, G.(2008). The diffusion decision model: theory and data for two-choice decision tasks. Neural Comput. 20, 873-922.
49. Ratcliff, R., and Rouder, J. N. (1998). Modeling response times for two-choice decisions. Psychol. Sci. 9, 347-356.
50. Ray, D., and Bossaerts, P. (2011). Positive temporal dependence of the biological clock implies hyperbolic discounting. Front. Neurosci. 5:2. doi: 10.3389/fnins.2011.00002
51. Rivest, F., and Bengio, Y. (2011). Adaptive drift-diffusion process to learn time intervals. arXiv:1103.2382v1 [q-bio.NC].
52. Roberts, S. (1981). Isolation of an internal clock. J. Exp. Psychol. Anim. Behav. Process. 7, 242-268.
53. Sanabria, F., and Killeen, P. R. (2008). Evidence for impulsivity in the spontaneously hypertensive rat drawn from complementary response-withholding tasks. Behav. Brain Funct. 4, 7.
54. Simen, P., Balci, F., deSouza, L., Cohen, J. D., and Holmes, P. (2011). A model of interval timing by neural integration. J. Neurosci. 31, 9238-9253.
55. Simen, P., Cohen, J. D., and Holmes, P (2006). Rapid decision threshold modulation by reward rate in a neural network. Neural Netw. 19, 1013-1026.
56. Simen, P., Contreras, D., Buck, C., Hu, P., Holmes, P., and Cohen, J. D. (2009). Reward-rate optimization in two-alternative decision making: empirical tests of theoretical predictions. J. Exp. Psychol. Hum. Percept. Perform. 35, 1865-1897.
57. Stephens, D. N., and Cole, B. J. (1996). AMPA antagonists differ from NMDA antagonists in their effects on operant DRL and delayed matching to position tasks. Psychopharmacology (Berl.) 3, 249-259.
58. Stone, M. (1960). Models for choice-reaction time. Psychometrika 25, 251-260.
59. Stubbs, D. A. (1976). Response bias and the discrimination of stimulus duration. J. Exp. Anal. Behav. 25, 243-250.
60. Sukhotina, I. A., Dravolina, O. A., Novitskaya, Y., Zvartau, E. E., Danysz, W., and Bespalov, A. Y. (2008).Effects of mGlu1 receptor blockade on working memory, time estimation, and impulsivity in rats. Psychopharmacology (Berl.) 196, 211-220.
61. Takahashi, T. (2006). Time-estimation error following Weber-Fechner law may explain subadditive time-discounting. Med. Hypotheses 67, 1372-1374.
62. Trommershäuser, J., Maloney, L. T., and Landy, M. S. (2008). Decision making, movement planning, and statistical decision theory. Trends Cogn. Sci. (Regul. Ed.) 12, 291-297.
63. Wald, A. (1947). Sequential Analysis. New York: Wiley.
64. Wald, A., and Wolfowitz, J. (1948). Optimum character of the sequential probability ratio test. Ann. Math. Stat. 19, 326-339.
65. Wearden, J. H. (1990). Maximizing reinforcement rate on spaced responding schedules under conditions of temporal uncertainty. Behav. Process. 22, 47-59.
66. Wearden, J. H., and Ferrara, A. (1996). Stimulus range effects in temporal bisection by humans. Q. J. Exp. Psychol. 49B, 24-44.
67. Wu, S.-W., Dal Martello, M. F., and Maloney, L. T. (2009). Sub-optimal tradeoff of time in sequential movements. PLoS ONE 4, e8228. doi: 10.1371/journal.pone.0008228
68. Yi, L. (2009). Do rats represent time logarithmically or linearly? Behav. Process. 81, 274-279.
69. Zacksenhouse, M., Holmes, P., and Bogacz, R. (2010). Robust versus optimal strategies for two-alternative forced choice tasks. J. Math. Psychol. 54, 230-245.
70. Zeiler, M.D.(1985). Pure timingintem-poral differentiation. J. Exp. Anal. Behav. 43, 183-193.
71. Zeiler, M. D., Scott, C. K., and Hoyert, M. K. (1987). Optimal temporal differentiation. J. Exp. Anal. Behav. 47, 191-200.