Working memory management and predicted utility

Frontiers in Behavioral Neuroscience

Volumn , Issue JUN, 2013, Pages

  Chatham, Christopher H ^a   Badre, David ^a  

^a BROWN UNIVERSITY   (United States)

Author keywords

Filtering; Gating; Predicted utility; Q learning; Working memory

Indexed keywords

ADULT; ARTICLE; BEHAVIOR; BRAIN FUNCTION; COGNITION; CORPUS STRIATUM; FEMALE; FRONTAL CORTEX; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; MALE; MATHEMATICAL COMPUTING; MEMORY CONSOLIDATION; NEUROIMAGING; NORMAL HUMAN; RESOURCE ALLOCATION; WORKING MEMORY;

EID: 84879727851     PISSN: 16625153     EISSN: None     Source Type: Journal    
DOI: 10.3389/fnbeh.2013.00083     Document Type: Article

References (45)

1. Ackerman, P. L., Beier, M. E., & Boyle, M. O. (2005). Working memory and intelligence: The same or different constructs? Psych. Bull. 131(1), 30. doi:10.1037/0033-2909.131.1.30
2. Baier, B., Karnath, H. O., Dieterich, M., Birklein, F., Heinze, C., & Müller, N. G. (2010). Keeping memory clear and stable-the contribution of human basal ganglia and prefrontal cortex to working memory. J. Neurosci. 30(29), 9788-9792. doi:10.1523/JNEUROSCI.1513-10.2010
3. Barch, D. M., Braver, T. S., Nystrom, L. E., Forman, S. D., Noll, D. C., & Cohen, J. D. (1997). Dissociating working memory from task difficulty in human prefrontal cortex. Neuropsychologia, 35(10), 1373-1380. doi:10.1016/S0028-3932(97)00072-9
4. Braver, T. S. & Cohen, J. D. (2000). On the control of control: The role of dopamine in regulating prefrontal function and working memory. In S. Monsell & J. Driver (Eds.), Attention and performance XVIII: Control of cognitive processes (713-737). Cambridge, MA: MIT Press
5. Cansino, S., Guzzon, D., & Casco, C. (2013). Effects of interference control on visuospatial working memory. Journal of Cognitive Psychology, 25(1):1-13. doi:10.1080/20445911.2012.739155
6. Conway, A. R., Kane, M. J., & Engle, R. W. (2003). Working memory capacity and its relation to general intelligence. Trends Cogn. Sci 7(12), 547-552. doi:10.1016/j.tics.2003.10.005
7. Cools, R., Sheridan, M., Jacobs, E., & D'Esposito, M. (2007) Impulsive personality predicts dopamine-dependent changes in frontostriatal activity during component processes of working memory. J Neurosci 27, 5506-5514. doi:10.1523/JNEUROSCI.0601-07.2007
8. Cools, R. (2008). Role of dopamine in the motivational and cognitive control of behavior. Neuroscientist,14(4), 381-395. doi:10.1177/1073858408317009
9. Cooper, R., Fox, J., Farringdon, J., & Shallice, T. (1996). A systematic methodology for cognitive modelling. Artificial Intelligence, 85(1), 3-44. doi:10.1016/0004-3702(95)00112-3
10. Conway, A. R., Kane, M. J., & Engle, R. W. (2003). Working memory capacity and its relation to general intelligence. Trends Cog. Sci. 7(12), 547-552. doi:10.1016/j.tics.2003.10.005
11. Cowan, N. (2001). The magical number 4 in short-term memory: A reconsideration of mental storage capacity. Beh. Brain Sci., 24(1), 87-114. doi:10.1017/S0140525X01003922
12. Duarte, A., Hearons, P., Jiang, Y., Delvin, M. C., Newsome, R. N., & Verhaeghen, P. (2013). Retrospective attention enhances visual working memory in the young but not the old: An ERP study. Psychophysiol, 50(5), 465-476. doi:10.1111/psyp.12034
13. Durstewitz, D., Seamans, J. K., Sejnowski, T. J. (2000) Neurocomputational models of working memory. Nat Neurosci 3, 1184-1191.
14. Frank, M. J., Loughry, B., & O'Reilly, R. C. (2001). Interactions between frontal corte1 x and basal ganglia in working memory: a computational model. Cognit. Aff. Behav. Neurosci. 1(2), 137-160. doi:10.3758/CABN.1.2.137
15. Fukai, T. (1999). Sequence generation in arbitrary temporal patterns from theta-nested gamma oscillations: a model of the basal ganglia-thalamo-cortical loops. Neural Netw. 12(7), 975-987. doi:10.1016/S0893-6080(99)00057-X
16. Fukuda, K., Vogel, E., Mayr, U., & Awh, E. (2010). Quantity, not quality: The relationship between fluid intelligence and working memory capacity. Psych. Bull Rev. 17(5), 673-679. doi:10.3758/17.5.673
17. Greve, D.N. (2002) http://surfer.nmr.mgh.harvard.edu/optseq (last accessed 7 June 2013).
18. Gruber, A.J., Dayan, P., Gutkin, B.S., Solla, S.A. (2006) Dopamine modulation in the basal ganglia locks the gate to working memory. J Comput Neurosci 20:153-166. doi:10.1007/s10827-005-5705-x
19. Hasher, L., & Zacks, R.T. (1988). Working memory, comprehension, and aging: A review and a new view. In G.H. Bower (Ed.), The psychology of learning and motivation (Vol. 22, pp 193-225). New York: Academic Press.
20. Hasher, L., Zacks, R. T., & May, C. P. (1999). Inhibitory control, circadian arousal, and age. In D. Gopher & A. Koriat (Eds.), Attention and Performance XVII, Cognitive Regulation of Performance: Interaction of Theory and Application (pp. 653-675). Cambridge, MA: MIT Press.
21. Hazy, T.E., Frank, M.J., O'Reilly, R.C. (2006) Banishing the homunculus: making working memory work. Neurosci 139:105-118. doi:10.1016/j.neuroscience.2005.04.067
22. Jost, K., Bryck, R. L., Vogel, E. K., & Mayr, U. (2011). Are old adults just like low working memory young adults? Filtering efficiency and age differences in visual working memory. Cer. Cortex. 21(5), 1147-1154. doi:10.1093/cercor/bhq185
23. Jurado-Parras, M. T., Gruart, A., & Delgado-García, J. M. (2012). Observational learning in mice can be prevented by medial prefrontal cortex stimulation and enhanced nucleus accumbens stimulation. Learning & Memory, 19(3), 99-106. doi:10.1101/lm.024760.111
24. Kane, M. J., Brown, L. H., McVay, J. C., Silvia, P. J., Myin-Germeys, I., & Kwapil, T. (2007). For Whom the Mind Wanders, and When An Experience-Sampling Study of Working Memory and Executive Control in Daily Life. Psych. Sci. 18(7), 614-621. doi:10.1111/j.1467-9280.2007.01948.x
25. Koechlin, E., Ody, C., & Kouneiher, F. (2003). The architecture of cognitive control in the human prefrontal cortex. Science, 302(5648), 1181-1185. doi:10.1126/science.1088545
26. Kuo, B. C., Stokes, M. G., & Nobre, A. C. (2012). Attention modulates maintenance of representations in visual short-term memory. J. Cognit. Neuro. 24(1), 51-60. doi:10.1162/jocn_a_00087
27. LaRocque, J. J., Lewis-Peacock, J. A., Drysdale, A. T., Oberauer, K., & Postle, B. R. (2013). Decoding attended information in short-term memory: An EEG study. J. Cognit. Neuro. 25(1), 127-142. doi:10.1162/jocn_a_00305
28. Miller EK, Cohen JD (2001) An integrative theory of prefrontal cortex function. Ann. Rev. Neurosci. 24:167-202.
29. McNab, F., & Klingberg, T. (2008). Prefrontal cortex and basal ganglia control access to working memory. Nat. Neurosci. 11(1), 103-107. doi:10.1038/nn2024
30. Oberauer, K. (2001). Removing irrelevant information from working memory. A cognitive aging study with the modified Sternberg task. JEP:LMC, 27, 948-957. doi:10.1037/0278-7393.27.4.948
31. Oberauer, K. (2003). Selective attention to elements in working memory. Exp. Psychol. 50, 257-269. doi:10.1026//1618-3169.50.4.257
32. Oberauer, K. (2005). Control of the contents of working memory--a comparison of two paradigms and two age groups. JEP:LMC, 31(4), 714. doi:10.1037/0278-7393.31.4.714
33. Oberauer, K., & Lewandowsky, S. (2011). Modeling working memory: A computational implementation of the Time-Based Resource-Sharing theory. Psych. Bull. & Rev, 18(1), 10-45. doi:10.3758/s13423---010---0020---
34. Oberauer, K., Lewandowsky, S., Farrell, S., Jarrold, C., & Greaves, M. (2012). Modeling working memory: An interference model of complex span. Psych. Bull. & Rev, 19(5), 779-819. doi:10.3758/s13423-012-0272-4
35. Olivers, C. N., & Meeter, M. (2008). A boost and bounce theory of temporal attention. Psych. Review, 115(4), 836. doi:10.1037/a0013395
36. Nee, D. E., & Brown, J. W. (2012). Rostral-caudal gradients of abstraction revealed by multi-variate pattern analysis of working memory. Neuroimage 63(3): 1285-1294. doi:10.1016/j.neuroimage.2012.08.034
37. Nee, D. E., Jahn, A., & Brown, J. W. (2013). Prefrontal Cortex Organization: Dissociating Effects of Temporal Abstraction, Relational Abstraction, and Integration with fMRI. Cer. Cortex, doi:10.1093/cercor/bht091
38. Peers, P. V., Ludwig, C. J., Rorden, C., Cusack, R., Bonfiglioli, C., Bundesen, C.,. & Duncan, J. (2005). Attentional functions of parietal and frontal cortex. Cer. Cortex, 15(10), 1469-1484. doi:10.1093/cercor/bhi029
39. Reynolds, J. R., O'Reilly, R. C., Cohen, J. D., & Braver, T. S. (2012). The function and organization of lateral prefrontal cortex: a test of competing hypotheses. PloS One, 7(2), e30284. doi:10.1371/journal.pone.0030284
40. Rosenthal, R., & Rosnow, R. L. (1985). Contrast analysis: focused comparison in the analysis of variance. Cambridge University Press.
41. Sakai, K., Rowe, J. B., Passingham, R. E. (2002). Active maintenance in prefrontal area 46 creates distractor-resistant memory. Nat Neurosci 5:479-484. doi:10.1038/nn846
42. Vogel, E. K., McCollough, A. W., & Machizawa, M. G. (2005). Neural measures reveal individual differences in controlling access to working memory. Nature, 438(7067), 500-503. doi:10.1038/nature04171
43. Woolrich, M.W., Behrens, T.E., & Smith S.M. (2004). Constrained linear basis sets for HRF modelling using Variational Bayes. NeuroImage, 21 (4), 1748-1761. doi:10.1016/j.neuroimage.2003.12.024
44. Zhang, W., & Luck, S. J. (2008). Discrete fixed-resolution representations in visual working memory. Nature, 453(7192), 233-235. doi:10.1038/nature06860
45. Zhang, W., & Luck, S. J. (2009). Sudden death and gradual decay in visual working memory. Psychol Sci, 20(4), 423-428.