Age-based differences in strategy use in choice tasks

Frontiers in Neuroscience

Volumn , Issue JAN, 2012, Pages

  Worthy, Darrell A ^a   Maddox, W Todd ^b  

^a TEXAS A AND M UNIVERSITY   (United States)

^b UNIVERSITY OF TEXAS AT AUSTIN   (United States)

Author keywords

Aging; Computational modeling; Decision making; Heuristics; Reinforcement learning

Indexed keywords

ADULT; AGE; AGED; AGING; ARTICLE; DECISION MAKING; FEMALE; HUMAN; HUMAN EXPERIMENT; LEARNING; MALE; MATHEMATICAL MODEL; NEUROPSYCHOLOGICAL TEST; QUALITATIVE ANALYSIS; REINFORCEMENT; TASK PERFORMANCE;

EID: 84861922027     PISSN: 16624548     EISSN: 1662453X     Source Type: Journal    
DOI: 10.3389/fnins.2011.00145     Document Type: Article

References (68)

1. Akaike, H. (1974). A new look at the statistical model identification. IEEE Trans. Automat. Contr. 19, 716-723.
2. Ashby, F. G., Alfonso-Reese, L. A., Turken, A. U., and Waldron, E. M. (1998). A neuropsychological theory of multiple systems in category learning. Psychol. Rev. 105, 442-481.
3. Ashby, F. G., and Maddox, W. T. (2005). Human category learning. Annu. Rev. Psychol. 56, 149-178.
4. Baldo, J. V., Delis, D., Kramer, J., and Shimamura, A. P. (2002). Memory performance on the California Verbal Learning Test-II: findings from patients with focal lesions. J. Int. Neuropsychol. Soc. 8, 539-546.
5. Bogacz, R., McClure, S. M., Li, J., Cohen, J. D., and Montague, P. R. (2007). Short-term memory traces for action bias in human reinforcement learning. Brain Res. 1153, 111-121.
6. Brink, T. L., Yesavage, J. A., Lum, O., Heersema, P. H., Adey, M., and Rose, T. L. (1982). Screening tests for geriatric depression. Clin. Gerontol. 1, 37-43.
7. Broder, A. (2003). Decision making with the " adaptive toolbox" . Influence of environmental structure, intelligence, and working memory load. J. Exp. Psychol. Learn. Mem. Cogn. 29, 611-625.
8. Brown, S. B. R. E., and Ridderinkhof, K. R. (2009). Aging and the neu-roeconomics of decision-making. Cogn. Affect. Behav. Neurosci. 9, 365-379.
9. Cabeza, R., Anderson, N. D., Locan-tore, J. K., and McIntosh, A. R. (2002). Aging gracefully: compensatory brain activity in high-performing older adults. Neuroim-age 17, 1394-1402.
10. Cappell, K. A., Gmeindl, L., and Reuter-Lorenz, P. A. (2010). Age differences in prefrontal recruitment during verbal working memory maintenance depend on memory load. Cortex 46, 462-473.
11. Castel, A. D., Rossi, A. D., and McGillivray, S. (in press). Beliefs about the " hot hand" in Basketball across the adult lifespan. Psychol. Aging.
12. Cohen, J. E. (2003). Human population: the next half century. Science 302, 1172-1175.
13. Daw, N. D., and Doya, K. (2006). The computational neurobiology of learning and reward. Curr. Opin. Neurobiol. 16, 199-204.
14. Daw, N. D., O'Doherty, J. P., Dayan, P., Seymour, B., and Dolan, R. J. (2006). Cortical substrates for exploratory decisions in humans. Nature 441, 876-879.
15. Delis, D. C., Kramer, J. H., Kaplan, E., and Ober, B. A. (1987). California Verbal Learning Test: Adult Version Manual. San Antonio, TX: The Psychological Corporation.
16. Denburg, N. L., Tranel, D., and Bechara, A. (2005). The ability to decide advantageously declines prematurely in some normal older persons. Neuropsychologia 43, 1099-1106.
17. Frank, M. J., and Claus, E. D. (2006). Anatomy of a decision: striato-orbitofrontal interactions in reinforcement learning, decision-making, and reversal. Psychol. Rev. 113, 300-326.
18. Frank,M.J.,and Kong, L. (2008). Learning to avoid in older age. Psychol. Aging 23, 392-398.
19. Frank, M. J., O'Reilly, R. C., and Curran, T. (2006). When memory fails, intuition reigns: midazolam enhances implicit inference in humans. Psy-chol. Sci. 17, 700-707.
20. Gigerenzer, G., and Todd, P. M. (1999). " Fast and frugal heuristics: the adaptive tool box," in Simple Heuristics that Make us Smart, eds G. Gigerenzer, P. Todd, and the ABC Research Group (New York: Oxford University Press), 3-34.
21. Green, L., Fry, A. F., and Myerson, J. (1994). Discounting of delayed rewards: a life span comparison. Psy-chol. Sci. 5, 33-36.
22. Gureckis, T. M., and Love, B. C. (2009). Learning in noise: dynamic decision-making in a variable environment. J. Math. Psychol. 53, 180-193.
23. Hare, T. A., O'Doherty, J., Camerer, C. F., Schultz, W., and Rangel, A. (2008). Dissociating the role of the orbitofrontal cortex and the stria- tum in the computation of goal val ues and prediction errors. J. Neu- rosci. 28, 5623-5630.
24. Hariri, A. R., Brown, S. M., Williamson, D. E., Flory, J. D., de Wit, H., and Manuck, S. B. (2006). Preference for immediate over delayed reward is associated with magnitude of ven tral striatal activity. J. Neurosci. 20, 13213-13217.
25. Heaton, R. K. (1981). A Manual for the Wisconsin Card Sorting Test. Odessa, FL: Psychological Assessment Resources.
26. Kovalchik, S., Camerer, C. F., Grether, D. M., Plott, C. R., and Allman, J. M. (2004). Aging and decision making: a comparison between neuro-logically healthy elderly and young individuals. J. Econ. Behav. Organ. 58, 79-94.
27. Kuhnen, C. M., and Knutson, B. (2005). The neural basis of financial risk-taking. Neuron 47, 763-770.
28. Lee, M. D., Zhang, S., Munro, M., and Steyvers, M. (2011). Psychological models of human and optimal performance in bandit problems. Cogn. Syst. Res. 12, 164-174.
29. Lezak, M. D. (1995). Neuropsychologi-cal Assessment, 3rd Edn. New York: Oxford University Press.
30. Li, S. C., Biele, G., Lindenberger, U., and Sikstrom, S. (2001).Aging cognition: from neuromodulation to representation. Trends Cogn. Sci. (Regul. Ed.) 5, 97-111.
31. Loch, J., and Singh, S. P. (1998). " Using eligibility traces to find the best memoryless policy in partially observable Markov decision processes," in Proceedings of the Fifteenth International Conference on Machine Learning, Madison, 323-331.
32. Lockenhoff, C. E. (2011). Age, time, and decision making: from processing speed to global time horizons. Ann. N. Y. Acad. Sci. 1235, 44-56.
33. Lockenhoff, C. E., O'Donoghue, T., and Dunning, D. (2011). Age differences in temporal discounting: the role of dispositional affect and anticipated emotions. Psychol. Aging 26, 274-284.
34. Maddox, W. T., and Ashby, F. G. (2004). Dissociating explicit and procedural-learning systems of perceptual category learning. Behav. Processes 66, 309-332.
35. Mata, R., Schooler, L. J., and Rieskamp, J. (2007). The aging decision maker: cognitive aging and the adaptive selection of decision strategies. Psy-chol. Aging 22, 796-810.
36. McClure, S. M., Berns, G. S., and Montague, P. R. (2003). Temporal prediction errors in a passive learning task activate human striatum. Neuron 38, 329-337.
37. McClure, S. M., Ericson, K. M., Laibson, D. I., Loewenstein, G., and Cohen, J. D. (2007). Time discounting for primary rewards. J. Neurosci. 27, 5796-5804.
38. Mell, T., Heekeren, H. R., Marschner, A., Wartenburger, I., Villringer, A., and Reischies, F. M. (2005). Effects of aging on stimulus-reward association learning. Neuropsychologia 43, 554-563.
39. Mell, T., Wartenburger, I., Marschner, A., Villringer, A., Reischies, F. M., and Heekeren, H. R. (2009). Altered function of ventral striatum during reward-based decision-making in old age. Front. Hum. Neurosci. 3:34. doi:10.3389/neuro.09.034.2009.
40. Monchi, O., Petrides,M., Petre,V.,Wors-ley, K., and Dagher, A. (2001). Wisconsin Card Sorting revisited: distinct neural circuits participating in different stages of the task identified by event-related functional magnetic resonance imaging. J. Neurosci. 21, 7733.
41. Montague, P. R., Dayan, P., and Sejnowski, T. J. (1996). A framework for mesencephalic dopamine systems basedonpredictive Hebbian learning. J. Neurosci. 16, 1936-1947.
42. Otto, A. R., Markman, A. B., Gureckis, T. M., and Love, B. C. (2010). Regulatory fit and systematic exploration in a dynamic decision-making environment. J. Exp. Psychol. Learn. Mem. Cogn. 36, 797-804.
43. Otto, A. R., Taylor, E. G., and Mark-man, A. B. (2011). There are at least two kinds of probability matching: evidence from a secondary task. Cognition 118, 274-279.
44. Pagnoni G., Zink C. F., Montague P. R., and Berns G. S. (2002). Acitivity in the human ventral striatum locked to errors of reward prediction. Nat. Neurosci. 5, 97-98.
45. Pan, W. X., Schmidt, R., Wickens, J. R., and Hyland, B. I. (2005). Dopamine cells respond to predicted events during classical conditioning: evidence for eligibility traces in the reward-learning network. J. Neu-rosci. 25, 6235-6242.
46. Park, D. C., and Reuter-Lorenz, P. (2009). The adaptive brain: aging and neurocognitive scaffolding. Annu. Rev. Psychol. 60, 173-196.
47. Pessiglione, M., Seymour, B., Flandin, G., Dolan, R. J., and Frith, C. D. (2006). Dopamine-dependent prediction errors underpin reward-seeking behavior in humans. Nature 442, 1042-1045.
48. Peters, E., Hess, T. M., Vastfjall, D., and Auman, C. (2007). Adult age differences in dual information processes: implications for the role of affective and deliberative processes in older adults' decision making. Perspect. Psychol. Sci. 2, 1-23.
49. Raz, N. (2000). " Aging of the brain and its impact on cognitive performance: integration of structural and functional findings," in The Handbook of Aging and Cognition, eds F. Craik and T. A. Satlhouse (Hillsdale, NJ: Erlbaum), 1-90.
50. Raz, N., Linberger, U., Rodrique, K. M., Kennedy, K. M., Head, D., Williamson, A., Dahle, C., Gerstorf, D., and Acker, J. D. (2005). Regional brain differences in aging healthy adults: general trends,individual differences and modifiers. Cereb. Cortex 15, 1676-1689.
51. Resnick, S. M.,Pham, D. L., Kraut, M. A., Zonderman, A. B., and Davatzikos, C. (2003). Longitudinal magnetic resonance imaging studies of older adults: a shrinking brain. J. Neurosci. 23, 3295-3301.
52. Reuter-Lorenz, P. A., and Cappell, K. A. (2008). Neurocognitive aging and the compensation hypothesis. Curr. Dir. Psychol. Sci. 17, 177-182.
53. Samanez-Larkin, G. R., Gibbs, S. E. B., Khanna, K., Nielsen, L., Carstensen, L. L., and Knutson, B. (2007). Anticipation of monetary gain bus not loss in healthy older adults. Nat. Neurosci. 10, 787-791.
54. Samanez-Larkin, G. R., Kuhnen, C. K., Yoo, D. J., and Knutson, B. (2010). Variability in nucleus accumbens activity mediates age-related subop-timal financial risk-taking. J. Neu-rosci. 30, 1426-1434.
55. Samanez-Larkin, G. R., Wagner, A. D., and Knutson, B. (2011). Expected value information improves financial risk taking across the adult life span. Soc. Cogn. Affect. Neurosci. 6, 207-217.
56. Scheibehenne, B.,Wilke,A., and Todd, P. M. (2011). Expectations of clumpy resources influence predictions of sequential events. Evol. Hum. Behav. 32, 326-333.
57. Schott, B. H., Niehaus, L., Wittman, B. C., Schutze, H., Seidenbecher, C. I., Heinze, H. J., and Duzel, E. (2007). Ageing and early-stage Parkinson's disease affect separa ble neural mechanisms of mesolim- bic reward processing. Brain 130, 2412-2424.
58. Steyvers, M., Lee, M. D., and Wagen-makers, E. J. (2009). A Bayesian analysis of human decision-making on bandit problems. J. Math. Psychol. 53, 168-179.
59. Stroop, J. R. (1935). Studies of interference in serial verbal reactions. J. Exp. Psychol. 18, 643-662.
60. Sutton, R. S., and Barto, A. G. (1998). Reinforcement Learning: An Introduction. Cambridge: MIT Press.
61. Thornton, W. J. L., and Dumke, H. A. (2005). Age differences in everyday problem-solving and decision-making effectiveness: a meta-analytic review. Psychol. Aging 20, 85-99.
62. Wagenmakers, E. J., and Farrell, S. (2004). AIC model selection using Akaike weights. Psychon. Bull. Rev. 11, 192-196.
63. Wechsler, D. (1997). Wechsler Adult Intelligence Scale, 3rd Edn. San Antonio: Harcourt Brace & Company.
64. Winstanely, C. A., Dalley, J. W., Theobald, D. E., and Robbins, T. W. (2006). Double dissociation between serotonergic and dopaminergic modulation of pre-frontal and orbitofrontal cortex during a test of impulsive choice. Cereb. Cortex 16, 106-114.
65. Wood, S., Busemeyer, J., Koling, A., Davis, H., and Cox, C. R. (2005). Older adults as adaptive decision-makers: evidence from the Iowa Gambling Task. Psychol. Aging 20, 220-225.
66. Worthy, D. A., Gorlick, M. A., Pacheco, J. L., Schnyer, D. M., and Mad-dox, W. T. (2011). With age comes wisdom: decision-making in older and younger adults. Psychol. Sci. 22, 1375-1380.
67. Worthy, D. A., Maddox, W. T., and Markman, A. B. (2007). Regulatory fit effects in a choice task. Psychon. Bull. Rev. 14, 1125-1132.
68. Yechiam, E.,and Busemeyer, J. R. (2005). Comparison of basic assumptions embedded in learning models for experience based decision-making. Psychon. Bull. Rev. 12, 387-402.