Working-memory load and temporal myopia in dynamic decision making

Journal of Experimental Psychology: Learning Memory and Cognition

Volumn 38, Issue 6, 2012, Pages 1640-1658

  Worthy, Darrell A ^a   Otto, A Ross ^b   Maddox, W Todd ^a  

^a TEXAS A AND M UNIVERSITY   (United States)

^b UNIVERSITY OF TEXAS AT AUSTIN   (United States)

Author keywords

Decision making; Dual task; Reinforcement learning; Win stay lose shift; Working memory load

Indexed keywords

ARTICLE; DECISION MAKING; HUMAN; PHOTOSTIMULATION; REACTION TIME; REINFORCEMENT; REWARD; SHORT TERM MEMORY; TIME;

CHOICE BEHAVIOR; DECISION MAKING; HUMANS; MEMORY, SHORT-TERM; PHOTIC STIMULATION; REACTION TIME; REINFORCEMENT (PSYCHOLOGY); REWARD; TIME FACTORS;

EID: 84874687406     PISSN: 02787393     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0028146     Document Type: Article

References (63)

1. Akaike, H. (1974). A new look at the statistical model identification. IEEE Transactions on Automatic Control, 19, 716 -723. doi:10.1109/TAC.1974.1100705
2. Ashby, F. G., Alfonso-Reese, L. A., Turken, A. U., & Waldron, E. M. (1998). A neuropsychological theory of multiple systems in category learning. Psychological Review, 105, 442-481. doi:10.1037/0033-295X.105.3.442
3. Ashby, F. G., & Ell, S. W. (2002). Single versus multiple systems of category learning: Reply to Nosofsky & Kruschke (2002). Psychonomic Bulletin & Review, 9, 175-180. doi:10.3758/BF03196275
4. Ashby, F. G., & Maddox, W. T. (2005). Human category learning. Annual Review of Psychology, 56, 149 -178. doi:10.1146/annurev.psych.56.091103.070217
5. Bechara, A., Damasio, A. R., & Damasio, H. (2000). Emotion, decision making and the orbitofrontal cortex. Cerebral Cortex, 10, 295-307. doi:10.1093/cercor/10.3.295
6. Bechara, A., Damasio, A. R., Damasio, H., & Anderson, S. W. (1994). Insensitivity to future consequences following damage to human prefrontal cortex. Cognition, 50, 7-15. doi:10.1016/0010-0277(94)90018-3
7. Bechara, A., & Martin, E. M. (2004). Impaired decision making related to working memory deficits in individuals with substance addictions. Neuropsychology, 18, 152-162. doi:10.1037/0894-4105.18.1.152
8. Burgess, P. W. (2000). Strategy application disorder: The role of the frontal lobes in human multitasking. Psychological Research, 63, 279-288. doi:10.1007/s004269900006
9. Burgess, P. W., Veitch, E., Costello, A. D. L., & Shallice, T. (2000). The cognitive and neuroanatomical correlates of multitasking. Neuropsychologia, 38, 848-863. doi:10.1016/S0028-3932(99)00134-7
10. Cohen, J. D. (2005). The vulcanization of the human brain: A neural perspective on interactions between cognition and emotion. Journal of Economic Perspectives, 19, 3-24. doi:10.1257/089533005775196750
11. Curtis, C. E., & Lee, D. (2010). Beyond working memory: The role of persistent activity in decision making. Trends in Cognitive Sciences, 14, 216-222. doi:10.1016/j.tics.2010.03.006
12. Daw, N. D., O'Doherty, J. P., Seymour, B., & Dolan, R. J. (2006). Cortical substrates for exploratory decisions in humans. Nature, 441, 876-879.
13. Djuric, P. M. (1998). Asymptotic MAP criteria for model selection. IEEE Transactions on Signal Processing, 46, 2726 -2735. doi:10.1109/78.720374
14. Donkin, C., Brown, S., Heathcote, A., & Wagenmakers, E. J. (2011). Diffusion versus linear ballistic accumulation: Different models but the same conclusions about psychological processes? Psychonomic Bulletin & Review, 18, 61-69. doi:10.3758/s13423-010-0022-4
15. Dretsch, M. N., & Tipples, J. (2008). Working memory involved in predicting future outcomes based on past experiences. Brain and Cognition, 66, 83-90. doi:10.1016/j.bandc.2007.05.006
16. Evans, J. St. B. T. (2003). In two minds: Dual process accounts of reasoning. Trends in Cognitive Sciences, 7, 454-459. doi:10.1016/j.tics.2003.08.012
17. Evans, J. St. B. T. (2008). Dual-processing accounts of reasoning, judgment, and social cognition. Annual Review of Psychology, 59, 255-278. doi:10.1146/annurev.psych.59.103006.093629
18. Filoteo, J. V., Lauritzen, S., & Maddox, W. T. (2010). Removing the frontal lobes: The effects of engaging executive functions on perceptual category learning. Psychological Science, 21, 415-423. doi:10.1177/0956797610362646
19. Franco-Watkins, A. M., Pashler, H., & Rickard, T. C. (2006). Does working memory load lead to greater impulsivity? Commentary on Hinson, Jameson, & Whitney's (2003). Journal of Experimental Psychology: Learning, Memory, and Cognition, 32, 443-447. doi:10.1037/0278-7393.32.2.443
20. Frank, M. J., & Claus, E. D. (2006). Anatomy of a decision: Striatoorbitofrontal interactions in reinforcement learning, decision making, and reversal. Psychological Review, 113, 300-326. doi:10.1037/0033-295X.113.2.300
21. Frank, M. J., & Kong, L. (2008). Learning to avoid in older age. Psychology and Aging, 23, 392-398. doi:10.1037/0882-7974.23.2.392
22. Frank, M. J., O'Reilly, R. C., & Curran, T. (2006). When memory fails, intuition reigns: Midazolam enhances implicit inference in humans. Psychological Science, 17, 700 -707. doi:10.1111/j.1467-9280.2006.01769.x
23. Gureckis, T. M., & Love, B. C. (2009a). Learning in noise: Dynamic decision-making in a variable environment. Journal of Mathematical Psychology, 53, 180-193. doi:10.1016/j.jmp.2009.02.004
24. Gureckis, T. M., & Love, B. C. (2009b). Short-term gains, long term pains: How cues about state aid in learning in dynamic environments. Cognition, 113, 293-313. doi:10.1016/j.cognition.2009.03.013
25. Hare, T. A., O'Doherty, J., Camerer, C. F., Schultz, W., & Rangel, A. (2008). Dissociating the role of orbitofrontal cortex and the striatum in the computation of goal values and prediction errors. Journal of Neuroscience, 28, 5623-5630. doi:10.1523/JNEUROSCI.1309-08.2008
26. Hinson, J. M., Jameson, T. L., & Whitney, P. (2002). Somatic markers, working memory, and decision making. Cognitive, Affective, & Behavioral Neuroscience, 2, 341-353. doi:10.3758/CABN.2.4.341
27. Jameson, T. L., Hinson, J. M., & Whitney, P. (2004). Components of working memory and somatic markers in decision making. Psychonomic Bulletin & Review, 11, 515-520. doi:10.3758/BF03196604
28. Lee, M. D., Zhang, S., Munro, M., & Steyvers, M. (2011). Psychological models of human and optimal performance in bandit problems. Cognitive Systems Research, 12, 164-174. doi:10.1016/j.cogsys.2010.07.007
29. Maddox, W. T., & Ashby, F. G. (2004). Dissociating explicit and procedural-learning systems of perceptual category learning. Behavioural Processes, 66, 309-332. doi:10.1016/j.beproc.2004.03.011
30. Maddox, W. T., Ashby, F. G., Ing, A. D., & Pickering, A. D. (2004). Disrupting feedback processing interferes with rule-based but not information-integration category learning. Memory & Cognition, 32, 582-591. doi:10.3758/BF03195849
31. Metcalfe, J., & Mischel, W. (1999). A hot/cool system analysis of delay of gratification: Dynamics of willpower. Psychological Review, 106, 3-19. doi:10.1037/0033-295X.106.1.3
32. Miles, S. J., & Minda, J. P. (2011). The effect of concurrent verbal and visual tasks on category learning. Journal of Experimental Psychology: Learning, Memory, and Cognition, 37, 588-607. doi:10.1037/a0022309
33. Myung, I. J., & Pitt, M. A. (1997). Applying Occam's razor in modeling cognition: A Bayesian approach. Psychonomic Bulletin & Review, 4, 79-95. doi:10.3758/BF03210778
34. Newell, B. R., Dunn, J. C., & Kalish, M. (2010). The dimensionality of perceptual category learning: A state-trace analysis. Memory & Cognition, 38, 563-581. doi:10.3758/MC.38.5.563
35. Nosofsky, R. M., & Kruschke, J. K. (2002). Single-system models and interference in category learning: Commentary on Waldron and Ashby (2001). Psychonomic Bulletin & Review, 9, 169-174. doi:10.3758/BF03196274
36. Nowak, M., & Sigmund, K. (1993, July 1). A strategy of win-stay, lose-shift that outperforms tit-for-tat in the Prisoner's Dilemma game. Nature, 364, 56-58. doi:10.1038/364056a0
37. Otto, A. R., Gureckis, T. M., Markman, A. B., & Love, B. C. (2009). Navigating through abstract decision spaces: Evaluating the role of state generalization in a dynamic decision-making task. Psychonomic Bulletin & Review, 16, 957-963. doi:10.3758/PBR.16.5.957
38. Otto, A. R., Markman, A. B., Gureckis, T. M., & Love, B. C. (2010). Regulatory fit and systematic exploration in a dynamic decision-making environment. Journal of Experimental Psychology: Learning, Memory, and Cognition, 36, 797-804. doi:10.1037/a0018999
39. Otto, A. R., Markman, A. B., & Love, B. C. (2012). Taking more, now: The optimality of impulsive choice hinges on environment structure. Social Psychological & Personality Science, 3(2), 131-138. doi:10.1177/1948550611411311
40. Otto, A. R., Taylor, E. G., & Markman, A. B. (2011). There are at least two kinds of probability matching: Evidence from a secondary task. Cognition, 118, 274-279. doi:10.1016/j.cognition.2010.11.009
41. Pagnoni, G., Zink, C. F., Montague, P. R., & Berns, G. S. (2002). Activity in human ventral striatum locked to errors of reward prediction. Nature Neuroscience, 5, 97-98. doi:10.1038/nn802
42. Pessiglione, M., Seymour, B., Flandin, G., Dolan, R. J., & Frith, C. D. (2006, August 31). Dopamine-dependent prediction errors underpin reward-seeking behavior in humans. Nature, 442, 1042-1045. doi:10.1038/nature05051
43. Poldrack, R. A., & Packard, M. G. (2003). Competition among multiple memory systems: Converging evidence from animal and human brain studies. Neuropsychologia, 41, 245-251. doi:10.1016/S0028-3932(02)00157-4
44. Rakow, T., & Newell, B. R. (2010). Degrees of uncertainty: An overview and framework for future research on experience-based choice. Journal of Behavioral Decision Making, 23, 1-14. doi:10.1002/bdm.681
45. Schwarz, G. (1978). Estimating the dimension of a model. Annals of Statistics, 6, 461-464.
46. Sloman, S. A. (1996). The empirical case for two systems of reasoning. Psychological Bulletin, 119, 3-22. doi:10.1037/0033-2909.119.1.3
47. Smith, E. R., & DeCoster, J. (2000). Dual-process models in social and cognitive psychology: Conceptual integration and links to underlying memory systems. Personality and Social Psychology Review, 4, 108-131. doi:10.1207/S15327957PSPR0402_01
48. Steyvers, M., Lee, M. D., & Wagenmakers, E. J. (2009). A Bayesian analysis of human decision-making on bandit problems. Journal of Mathematical Psychology, 53, 168-179. doi:10.1016/j.jmp.2008.11.002
49. Strack, F., & Deutsch, R. (2004). Reflective and impulsive determinants of social behavior. Personality and Social Psychology Review, 8, 220-247. doi:10.1207/s15327957pspr0803_1
50. Strayer, D. L., & Drews, F. A. (2007). Cell-phone-induced driver distraction. Current Directions in Psychological Science, 16, 128-131. doi:10.1111/j.1467-8721.2007.00489.x
51. Stroop, J. R. (1935). Studies of interference in serial verbal reactions. Journal of Experimental Psychology, 18, 643-662. doi:10.1037/h0054651
52. Sutton, R. S., & Barto, A. G. (1998). Reinforcement learning: An introduction. Cambridge, MA: MIT Press.
53. Tversky, A., & Kahneman, D. (1981, January 30). The framing of decisions and the psychology of choice. Science, 211, 453-458. doi:10.1126/science.7455683
54. Vestergren, P., & Nilsson, L. G. (2011). Perceived causes of everyday memory problems in a population-based sample aged 39-99. Applied Cognitive Psychology, 25, 641-646. doi:10.1002/acp.1734
55. Wagenmakers, E. J., Ratcliff, R., Gomez, P., & Iverson, G. (2004). Assessing model mimicry using the parametric bootstrap. Journal of Mathematical Psychology, 48, 28-50. doi:10.1016/j.jmp.2003.11.004
56. Waldron, E. M., & Ashby, F. G. (2001). The effects of concurrent task interference on category learning: Evidence for multiple category learning systems. Psychonomic Bulletin & Review, 8, 168-176. doi:10.3758/BF03196154
57. Worthy, D. A., Gorlick, M. A., Pacheco, J. L., Schnyer, D. M., & Maddox, W. T. (2011). With age comes wisdom: Decision-making in younger and older adults. Psychological Science, 22, 1375-1380. doi:10.1177/0956797611420301
58. Worthy, D. A., & Maddox, W. T. (2012). Age-based differences in strategy use in choice tasks. Frontiers in Neuroscience, 5, 145-155.
59. Worthy, D. A., Maddox, W. T., & Markman, A. B. (2007). Regulatory fit effects in a choice task. Psychonomic Bulletin & Review, 14, 1125-1132. doi:10.3758/BF03193101
60. Worthy, D. A., Maddox, W. T., & Markman, A. B. (2008). Ratio and difference comparisons of expected reward in decision-making tasks. Memory & Cognition, 36, 1460-1469. doi:10.3758/MC.36.8.1460
61. Yechiam, E., & Busemeyer, J. R. (2005). Comparison of basic assumptions embedded in learning models for experience-based decision making. Psychonomic Bulletin & Review, 12, 387-402. doi:10.3758/BF03193783
62. Yechiam, E., Busemeyer, J. R., Stout, J. C., & Bechara, A. (2005). Using cognitive models to map relations between neuropsychological disorders and human decision-making deficits. Psychological Science, 16, 973-978. doi:10.1111/j.1467-9280.2005.01646.x
63. Zeithamova, D., & Maddox, W. T. (2006). Dual-task interference in perceptual category learning. Memory & Cognition, 34, 387-398. doi:10.3758/BF03193416