A general theory of intertemporal decision-making and the perception of time

Frontiers in Behavioral Neuroscience

Volumn 8, Issue FEB, 2014, Pages

  Namboodiri, Vijay M K ^a   Mihalas, Stefan ^b   Marton, Tanya M ^a   Hussain Shuler, Marshall G ^a  

^a JOHNS HOPKINS UNIVERSITY SCHOOL OF MEDICINE   (United States)

^b ALLEN INSTITUTE FOR BRAIN SCIENCE   (United States)

Author keywords

Decision making; Discounting; Impulsivity; Intertemporal choice theory; Scalar timing; Time perception

Indexed keywords

ARTICLE; BEHAVIOR THEORY; DECISION MAKING; DECISION THEORY; DELAY DISCOUNTING; HUMAN; IMPULSIVENESS; MEMORY CONSOLIDATION; NONHUMAN; PUNISHMENT; REINFORCEMENT; RETROSPECTIVE MEMORY; REWARD; SIGNAL NOISE RATIO; TEMPORAL CORTEX; TIME PERCEPTION; TRAINING INTEGRATED MAXIMIZED ESTIMATION OF REINFORCEMENT RATE;

EID: 84896909241     PISSN: 16625153     EISSN: None     Source Type: Journal    
DOI: 10.3389/fnbeh.2014.00061     Document Type: Article

References (51)

1. Alcock, J., and Sherman, P. (1994). The utility of the proximate-ultimate dichotomy in ethology. Ethology 96, 58-62. doi: 10.1111/j.1439-0310.1994.tb00881.x
2. Allan, L. G., and Gibbon, J. (1991). Human bisection at the geometric mean. Learn. Motiv. 22, 39-58. doi: 10.1016/0023-9690(91)90016-2
3. Balci, F., Freestone, D., Simen, P., Desouza, L., Cohen, J. D., and Holmes, P. (2011). Optimal temporal risk assessment. Front. Integr. Neurosci. 5:56. doi: 10.3389/fnint.2011.00056
4. Bateson, M., and Kacelnik, A. (1996). Rate currencies and the foraging starling: the fallacy of the averages revisited. Behav. Ecol. 7, 341-352. doi: 10.1093/beheco/7.3.341
5. Baumann, A. A., and Odum, A. L. (2012). Impulsivity, risk taking, and timing. Behav. Processes 90, 408-414. doi: 10.1016/j.beproc.2012.04.005
6. Behrens, T. E. J., Woolrich, M. W., Walton, M. E., and Rushworth, M. F. S. (2007). Learning the value of information in an uncertain world. Nat. Neurosci. 10, 1214-1221. doi: 10.1038/nn1954
7. Bickel, W. K., Yi, R., Landes, R. D., Hill, P. F., and Baxter, C. (2011). Remember the future: working memory training decreases delay discounting among stimulant addicts. Biol. Psychiatry 69, 260-265. doi: 10.1016/j.biopsych.2010.08.017
8. Bizo, L. A., Chu, J. Y. M., Sanabria, F., and Killeen, P. R. (2006). The failure of Weber's law in time perception and production. Behav. Processes 71, 201-210. doi: 10.1016/j.beproc.2005.11.006
9. Blanchard, T. C., Pearson, J. M., and Hayden, B. Y. (2013). Postreward delays and systematic biases in measures of animal temporal discounting. Proc. Natl. Acad. Sci. U.S.A. 110, 15491-15496. doi: 10.1073/pnas.1310446110
10. Buhusi, C. V., and Meck, W. H. (2005). What makes us tick? Functional and neural mechanisms of interval timing. Nat. Rev. Neurosci. 6, 755-765. doi: 10.1038/nrn1764
11. Doya, K. (2008). Modulators of decision making. Nat. Neurosci. 11, 410-416. doi: 10.1038/nn2077
12. Evenden, J. L. (1999). Varieties of impulsivity. Psychopharmacology (Berl.) 146, 348-361. doi: 10.1007/PL00005481
13. Frederick, S., Loewenstein, G., Donoghue, T. O., and Donoghue, T. E. D. O. (2002). Time discounting and time preference: a critical review. J. Econ. Lit. 40, 351-401. doi: 10.1257/002205102320161311
14. Gibbon, J. (1977). Scalar expectancy theory and Weber's law in animal timing. Psychol. Rev. 84, 279-325. doi: 10.1037/0033-295X.84.3.279
15. Gibbon, J., Church, R. M., Fairhurst, S., and Kacelnik, A. (1988). Scalar expectancy theory and choice between delayed rewards. Psychol. Rev. 95, 102-114. doi: 10.1037//0033-295X.95.1.102
16. Gibbon, J., Malapani, C., Dale, C. L., and Gallistel, C. R. (1997). Toward a neurobiology of temporal cognition: advances and challenges. Curr. Opin. Neurobiol. 7, 170-184. doi: 10.1016/S0959-4388(97)80005-0
17. Hardisty, D. J., Appelt, K. C., and Weber, E. U. (2012). Good or bad, we want it now: fixed-cost present bias for gains and losses explains magnitude asymmetries in intertemporal choice. J. Behav. Decis. Making. 26, 348-361. doi: 10.1002/bdm.1771
18. Kacelnik, A., and Bateson, M. (1996). Risky theories-the effects of variance on foraging decisions. Integr. Comp. Biol. 36, 402-434. doi: 10.1093/icb/36.4.402
19. Kalenscher, T., and Pennartz, C. M. A. (2008). Is a bird in the hand worth two in the future? The neuroeconomics of intertemporal decision-making. Prog. Neurobiol. 84, 284-315. doi: 10.1016/j.pneurobio.2007.11.004
20. Kalenscher, T., Windmann, S., Diekamp, B., Rose, J., Güntürkün, O., and Colombo, M. (2005). Single units in the pigeon brain integrate reward amount and time-to-reward in an impulsive choice task. Curr. Biol. 15, 594-602. doi: 10.1016/j.cub.2005.02.052
21. Kennerley, S. W., Walton, M. E., Behrens, T. E. J., Buckley, M. J., and Rushworth, M. F. S. (2006). Optimal decision making and the anterior cingulate cortex. Nat. Neurosci. 9, 940-947. doi: 10.1038/nn1724
22. Killeen, P. R., and Fetterman, J. G. (1988). A behavioral theory of timing. Psychol. Rev. 95, 274-295. doi: 10.1037/0033-295X.95.2.274
23. Killeen, P. R., Fetterman, J. G., and Bizo, L. (1997). "Time's causes, " in Advances in Psychology: Time and Behavior: Psychological and Neurobehavioral Analyses, eds C. M. Bradshaw and E. Szabadi (Amsterdam: Elsevier), 79-131.
24. Kobayashi, S., and Schultz, W. (2008). Influence of reward delays on responses of dopamine neurons. J. Neurosci. 28, 7837-7846. doi: 10.1523/JNEUROSCI.1600-08.2008
25. Kolling, N., Behrens, T. E. J., Mars, R. B., and Rushworth, M. F. S. (2012). Neural mechanisms of foraging. Science 336, 95-98. doi: 10.1126/science.1216930
26. Lejeune, H., and Wearden, J. H. (2006). Scalar properties in animal timing: conformity and violations. Q. J. Exp. Psychol. 59, 1875-1908. doi: 10.1080/17470210600784649
27. Loewenstein, G., and Prelec, D. (1992). Anomalies in intertemporal choice: evidence and an interpretation. Q. J. Econ. 107, 573-597. doi: 10.2307/2118482
28. Luhmann, C. C., Chun, M. M., Yi, D.-J., Lee, D., and Wang, X.-J. (2008). Neural dissociation of delay and uncertainty in intertemporal choice. J. Neurosci. 28, 14459-14466. doi: 10.1523/JNEUROSCI.5058-08.2008
29. Matell, M. S., Bateson, M., and Meck, W. H. (2006). Single-trials analyses demonstrate that increases in clock speed contribute to the methamphetamine-induced horizontal shifts in peak-interval timing functions. Psychopharmacology (Berl.) 188, 201-212. doi: 10.1007/s00213-006-0489-x
30. Matell, M. S., and Meck, W. H. (2000). Neuropsychological mechanisms of interval timing behavior. Bioessays 22, 94-103. doi: 10.1002/(SICI)1521-1878(200001)22:1<94::AID-BIES14>3.0.CO;2-E
31. Myerson, J., and Green, L. (1995). Discounting of delayed rewards: models of individual choice. J. Exp. Anal. Behav. 64, 263-276. doi: 10.1901/jeab.1995.64-263
32. Niv, Y., Daw, N. D., Joel, D., and Dayan, P. (2007). Tonic dopamine: opportunity costs and the control of response vigor. Psychopharmacology (Berl.) 191, 507-520. doi: 10.1007/s00213-006-0502-4
33. Pearson, J. M., Hayden, B. Y., and Platt, M. L. (2010). Explicit information reduces discounting behavior in monkeys. Front. Psychol. 1:237. doi: 10.3389/fpsyg.2010.00237
34. Peters, J., and Büchel, C. (2011). The neural mechanisms of inter-temporal decision-making: understanding variability. Trends Cogn. Sci. 15, 227-239. doi: 10.1016/j.tics.2011.03.002
35. Platt, M. L., and Glimcher, P. W. (1999). Neural correlates of decision variables in parietal cortex. Nature 400, 233-238. doi: 10.1038/22268
36. Ray, D., and Bossaerts, P. (2011). Positive temporal dependence of the biological clock implies hyperbolic discounting. Front. Neurosci. 5:2. doi: 10.3389/fnins.2011.00002
37. Rushworth, M. F. S., and Behrens, T. E. J. (2008). Choice, uncertainty and value in prefrontal and cingulate cortex. Nat. Neurosci. 11, 389-397. doi: 10.1038/nn2066
38. Samuelson, P. A. (1937). A note on measurement of utility. Rev. Econ. Stud. 4, 155-161. doi: 10.2307/2967612
39. Schweighofer, N., Shishida, K., Han, C. E., Okamoto, Y., Tanaka, S. C., Yamawaki, S., et al. (2006). Humans can adopt optimal discounting strategy under real-time constraints. PLoS Comput. Biol. 2:e152. doi: 10.1371/journal.pcbi.0020152
40. Shamosh, N. A., Deyoung, C. G., Green, A. E., Reis, D. L., Johnson, M. R., Conway, A. R. A., et al. (2008). Individual differences in delay discounting: relation to intelligence, working memory, and anterior prefrontal cortex. Psychol. Sci. 19, 904-911. doi: 10.1111/j.1467-9280.2008.02175.x
41. Shuler, M. G., and Bear, M. F. (2006). Reward timing in the primary visual cortex. Science 311, 1606-1609. doi: 10.1126/science.1123513
42. Simen, P., Balci, F., Desouza, L., Cohen, J. D., and Holmes, P. (2011a). Interval timing by long-range temporal integration. Front. Integr. Neurosci. 5:28. doi: 10.3389/fnint.2011.00028
43. Simen, P., Balci, F., de Souza, L., Cohen, J. D., and Holmes, P. (2011b). A model of interval timing by neural integration. J. Neurosci. 31, 9238-9253. doi: 10.1523/JNEUROSCI.3121-10.2011
44. Staddon, J. E. R., and Cerutti, D. T. (2003). Operant conditioning. Annu. Rev. Psychol. 54, 115-144. doi: 10.1146/annurev.psych.54.101601.145124
45. Stephens, D. W. (2008). Decision ecology: foraging and the ecology of animal decision making. Cogn. Affect. Behav. Neurosci. 8, 475-484. doi: 10.3758/CABN.8.4.475
46. Stephens, D. W., and Anderson, D. (2001). The adaptive value of preference for immediacy: when shortsighted rules have farsighted consequences. Behav. Ecol. 12, 330-339. doi: 10.1093/beheco/12.3.330
47. Stephens, D. W., and Krebs, J. R. (1986). Foraging Theory. Princeton, NJ: Princeton University Press.
48. Takahashi, T. (2006). Time-estimation error following Weber-Fechner law may explain subadditive time-discounting. Med. Hypotheses 67, 1372-1374. doi: 10.1016/j.mehy.2006.05.056
49. Van den Bos, W., and McClure, S. M. (2013). Towards a general model of temporal discounting. J. Exp. Anal. Behav. 99, 58-73. doi: 10.1002/jeab.6
50. Wittmann, M., Leland, D. S., Churan, J., and Paulus, M. P. (2007). Impaired time perception and motor timing in stimulant-dependent subjects. Drug Alcohol Depend. 90, 183-192. doi: 10.1016/j.drugalcdep.2007.03.005
51. Wittmann, M., and Paulus, M. P. (2008). Decision making, impulsivity and time perception. Trends Cogn. Sci. 12, 7-12. doi: 10.1016/j.tics.2007.10.004