Ventral Striatum and the Evaluation of Memory Retrieval Strategies

Journal of Cognitive Neuroscience

Volumn 26, Issue 9, 2014, Pages 1928-1948

  Badre, David ^a   Lebrecht, Sophie ^b   Pagliaccio, David ^c   Long, Nicole M ^d   Scimeca, Jason M ^a  

^a BROWN UNIVERSITY   (United States)

^b CARNEGIE MELLON UNIVERSITY   (United States)

^c UNIVERSITY OF WASHINGTON   (United States)

^d UNIVERSITY OF PENNSYLVANIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

OXYGEN;

ADULT; BAYES THEOREM; BLOOD; BRAIN MAPPING; COMPUTER SIMULATION; CORPUS STRIATUM; DECISION MAKING; FEMALE; HUMAN; IMAGE PROCESSING; LEARNING; MALE; PHOTOSTIMULATION; PHYSIOLOGY; PSYCHOLOGICAL MODEL; REACTION TIME; RECALL; SEMANTICS; TIME; VASCULARIZATION; YOUNG ADULT;

ADULT; BAYES THEOREM; BRAIN MAPPING; COMPUTER SIMULATION; DECISION MAKING; FEMALE; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; LEARNING; MALE; MENTAL RECALL; MODELS, PSYCHOLOGICAL; OXYGEN; PHOTIC STIMULATION; REACTION TIME; SEMANTICS; TIME FACTORS; VENTRAL STRIATUM; YOUNG ADULT;

EID: 84905180649     PISSN: 0898929X     EISSN: 15308898     Source Type: Journal    
DOI: 10.1162/jocn_a_00596     Document Type: Article

References (76)

1. Anderson, J. R., & Milson, R. (1989). Human memory: An adaptive perspective. Psychological Review, 96, 703-719.
2. Anderson, M. C., Ochsner, K. N., Kuhl, B., Cooper, J., Robertson, E., Gabrieli, S. W., et al. (2004). Neural systems underlying the suppression of unwanted memories. Science, 303, 232-235.
3. Atkinson, R. C., & Shiffrin, R. M. (1971). The control of short-term memory. Scientific American, 225, 82-90.
4. Badre, D. (2012). Opening the gate to working memory. Proceedings of the National Academy of Sciences, U.S.A., 109, 19878-19879.
5. Badre, D., Doll, B. B., Long, N. M., & Frank, M. J. (2012). Rostrolateral prefrontal cortex and individual differences in uncertainty-driven exploration. Neuron, 73, 595-607.
6. Badre, D., & Frank, M. J. (2012). Mechanisms of hierarchical reinforcement learning in cortico-striatal circuits 2: Evidence from fMRI. Cerebral Cortex, 22, 527-536.
7. Badre, D., Poldrack, R. A., Pare-Blagoev, E. J., Insler, R. Z., & Wagner, A. D. (2005). Dissociable controlled retrieval and generalized selection mechanisms in ventrolateral prefrontal cortex. Neuron, 47, 907-918.
8. Badre, D., & Wagner, A. D. (2007). Left ventrolateral prefrontal cortex and the cognitive control of memory. Neuropsychologia, 45, 2883-2901.
9. Balota, D. A., & Spieler, D. H. (1999). Word frequency, repetition, and lexicality effects in word recognition tasks: Beyond measures of central tendency. Journal of Experimental Psychology: General, 128, 32-55.
10. Barredo, J., Oztekin, I., & Badre, D. (in press). Ventral fronto temporal pathway supporting cognitive control of episodic memory retrieval. Cerebral Cortex.
11. Becker, S., & Lim, J. (2003). A computational model of prefrontal control in free recall: Strategic memory use in the California Verbal Learning Task. Journal of Cognitive Neuroscience, 15, 821-832.
12. Benjamin, A. S. (2007). Memory is more than just remembering: Strategic control of encoding, accessing memory, and making decisions. In A. S. Benjamin & B. H. Ross (Eds.), The psychology of learning and motivation: Skill and strategy in memory use (pp. 175-223). London: Academic Press.
13. Binder, J. R., & Desai, R. H. (2011). The neurobiology of semantic memory. Trends in Cognitive Sciences, 15, 527-536.
14. Bornstein, A. M., & Daw, N. D. (2011). Multiplicity of control in the basal ganglia: Computational roles of striatal subregions. Current Opinion in Neurobiology, 21, 374-380.
15. Brainard, D. H. (1997). The Psychophysics Toolbox. Spatial Vision, 10, 433-436.
16. Braver, T. S., & Cohen, J. D. (2000). On the control of control: The role of dopamine in regulating prefrontal function and working memory. In S. Monsell & J. Driver (Eds.), Attention and performance XVIII (pp. 713-737). Cambridge, MA: MIT Press.
17. Bray, S., & O'Doherty, J. (2007). Neural coding of reward prediction error signals during classical conditioning with attractive faces. Journal of Neurophysiology, 97, 3036-3045.
18. Cabeza, R., Ciaramelli, E., Olson, I. R., & Moscovitch, M. (2008). The parietal cortex and episodic memory: An attentional account. Nature Reviews Neuroscience, 9, 613-625.
19. Cavanagh, J. F., Wiecki, T. V., Cohen, M. X., Figueroa, C. M., Samanta, J., Sherman, S. J., et al. (2011). Subthalamic nucleus stimulation reverses mediofrontal influence over decision threshold. Nature Neuroscience, 14, 1462-1467.
20. Chatham, C. H., & Badre, D. (2013). Working memory management and predicted utility. Frontiers in Behavioral Neuroscience, 7, 83.
21. Chatham, C. H., Frank, M. J., & Badre, D. (2014). Cortico-striatal systems supporting output gating of working memory. Neuron, 81, 930-942.
22. Cohen, N. J., Eichenbaum, H., & Poldrack, R. A. (1997). Memory for items and memory for relations in the procedural/declarative memory framework. Memory, 5, 131-178.
23. Cools, R. (2011). Dopaminergic control of the striatum for high-level cognition. Current Opinion in Neurobiology, 21, 402-407.
24. Cools, R., Barker, R. A., Sahakian, B. J., & Robbins, T. W. (2001). Mechanisms of cognitive set flexibility in Parkinson's disease. Brain, 124, 2503-2512.
25. Crescentini, C., Marin, D., Del Missier, F., Biasutti, E., & Shallice, T. (2011). Interference from retrieval cues in Parkinson's disease. Neuropsychology, 25, 720-733.
26. Crescentini, C., Mondolo, F., Biasutti, E., & Shallice, T. (2008). Supervisory and routine processes in noun and verb generation in nondemented patients with Parkinson's disease. Neuropsychologia, 46, 434-447.
27. D'Ardenne, K., Eshel, N., Luka, J., Lenartowicz, A., Nystrom, L. E., & Cohen, J. D. (2012). Role of prefrontal cortex and the midbrain dopamine system in working memory updating. Proceedings of the National Academy of Sciences, U.S.A., 109, 19900-19909.
28. Daw, N. D., Gershman, S. J., Seymour, B., Dayan, P., & Dolan, R. J. (2011). Model-based influences on humans' choices and striatal prediction errors. Neuron, 69, 1204-1215.
29. Dobbins, I. G., Foley, H., Schacter, D. L., & Wagner, A. D. (2002). Executive control during episodic retrieval: Multiple prefrontal processes subserve source memory. Neuron, 35, 989-996.
30. Donkin, C., Heathcote, A., Brown, S., & Andrews, S. (2009). Non-decision time effects in the lexical decision task. Paper presented at Proceedings of the 31st Annual Conference of the Cognitive Science Society. Austin, TX.
31. Favreau, M., & Segalowitz, N. S. (1983). Automatic and controlled processes in the first and second-language reading of fluent bilinguals. Memory and Cognition, 11, 565-574.
32. Gabrieli, J. D., Poldrack, R. A., & Desmond, J. E. (1998). The role of left prefrontal cortex in language and memory. Proceedings of the National Academy of Sciences, U.S.A., 95, 906-913.
33. Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (2004). Bayesian data analysis (2nd ed.). Boca Raton, FL: Chapman and Hall/CRC.
34. Gershberg, F. B., & Shimamura, A. P. (1995). Impaired use of organizational strategies in free recall following frontal lobe damage. Neuropsychologia, 33, 1305-1333.
35. Glascher, J., Daw, N., Dayan, P., & O'Doherty, J. P. (2010). States versus rewards: Dissociable neural prediction error signals underlying model-based and model-free reinforcement learning. Neuron, 66, 585-595.
36. Gold, B. T., Balota, D. A., Jones, S. J., Powell, D. K., Smith, C. D., & Andersen, A. H. (2006). Dissociation of automatic and strategic lexical-semantics: Functional magnetic resonance imaging evidence for differing roles of multiple frontotemporal regions. Journal of Neuroscience, 26, 6523-6532.
37. Han, S., & Dobbins, I. G. (2009). Regulating recognition decisions through incremental reinforcement learning. Psychonomic Bulletin & Review, 16, 469-474.
38. Han, S., Huettel, S. A., Raposo, A., Adcock, R. A., & Dobbins, I. G. (2010). Functional significance of striatal responses during episodic decisions: Recovery or goal attainment? Journal of Neuroscience, 30, 4767-4775.
39. Heekeren, H. R., Marrett, S., Ruff, D. A., Bandettini, P. A., & Ungerleider, L. G. (2006). Involvement of human left dorsolateral prefrontal cortex in perceptual decision-making is independent of response modality. Proceedings of the National Academy of Sciences, U.S.A., 103, 10023-10028.
40. Hutchinson, J. B., Uncapher, M. R., & Wagner, A. D. (2009). Posterior parietal cortex and episodic retrieval: Convergent and divergent effects of attention and memory. Learning and Memory, 16, 343-356.
41. Hutchinson, J. B., Uncapher, M. R., Weiner, K. S., Bressler, D. W., Silver, M. A., Preston, A. R., et al. (2014). Functional heterogeneity in posterior parietal cortex across attention and episodic memory retrieval. Cerebral Cortex, 24, 49-66.
42. Kucera, H., & Francis, W. N. (1967). Computational analysis of present-day English. Providence, RI: Brown University Press.
43. Lauwereyns, J., Watanabe, K., Coe, B., & Hikosaka, O. (2002). A neural correlate of response bias in monkey caudate nucleus. Nature, 418, 413-417.
44. Li, J., & Daw, N. D. (2011). Signals in human striatum are appropriate for policy update rather than value prediction. Journal of Neuroscience, 31, 5504-5511.
45. Maddox, W. T., & Bohil, C. J. (2005). Optimal classifier feedback improves cost-benefit but not base-rate decision criterion learning in perceptual categorization. Memory & Cognition, 33, 303-319.
46. McNab, F., & Klingberg, T. (2008). Prefrontal cortex and basal ganglia control access to working memory. Nature Neuroscience, 11, 103-107.
47. Meyer, D. E., & Schvaneveldt, R. W. (1971). Facilitation in recognizing pairs of words: Evidence of a dependence between retrieval operations. Journal of Experimental Psychology, 90, 227-234.
48. Miller, E. K., & Cohen, J. D. (2001). An integrative theory of prefrontal cortex function. Annual Review of Neuroscience, 24, 167-202.
49. Moscovitch, M. (1992). Memory and working-with-memory-A component process model based on modules and central systems. Journal of Cognitive Neuroscience, 4, 257-267.
50. Neely, J. H. (1977). Semantic priming and retrieval from lexical memory: Roles of inhibitionless spreading activation and limited capacity attention. Journal of Experimental Psychology: General, 106, 226-254.
51. Neely, J. H. (1991). Semantic priming effects in visual word recognition: A selective review of current findings and theories. In D. Besner & G. W. Humphreys (Eds.), Basic processing in reading: Visual word recognition (pp. 264-336). Hillsdale, NJ: Lawrence Erlbaum Associates.
52. Nelson, S. M., Cohen, A. L., Power, J. D., Wig, G. S., Miezin, F. M., Wheeler, M. E., et al. (2010). A parcellation scheme for human left lateral parietal cortex. Neuron, 67, 156-170.
53. O'Connor, A. R., Han, S., & Dobbins, I. G. (2010). The inferior parietal lobule and recognition memory: Expectancy violation or successful retrieval? Journal of Neuroscience, 30, 2924-2934.
54. O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. J. (2004). Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science, 304, 452-454.
55. O'Reilly, R. C., & Frank, M. J. (2006). Making working memory work: A computational model of learning in the prefrontal cortex and basal ganglia. Neural Computation, 18, 283-328.
56. Pessiglione, M., Seymour, B., Flandin, G., Dolan, R. J., & Frith, C. D. (2006). Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans. Nature, 442, 1042-1045.
57. Rastle, K., Harrington, J., & Coltheart, M. (2002). 358,534 nonwords: The ARC Nonword Database. Quarterly Journal of Experimental Psychology A, 55, 1339-1362.
58. Ratcliff, R. (1978). A theory of memory retrieval. Psychological Review, 85, 59-108.
59. Ratcliff, R., & Frank, M. J. (2012). Reinforcement-based decision making in corticostriatal circuits: Mutual constraints by neurocomputational and diffusion models. Neural Computation, 24, 1186-1229.
60. Ratcliff, R., Gomez, P., & McKoon, G. (2004). A diffusion model account of the lexical decision task. Psychological Review, 111, 159-182.
61. Ratcliff, R., & McKoon, G. (2008). The diffusion decision model: Theory and data for two-choice decision tasks. Neural Computation, 20, 873-922.
62. Ratcliff, R., Thapar, A., Gomez, P., & McKoon, G. (2004). A diffusion model analysis of the effects of aging in the lexical-decision task. Psychology and Aging, 19, 278-289.
63. Rugg, M. D., & Wilding, E. L. (2000). Retrieval processing and episodic memory. Trends in Cognitive Sciences, 4, 108-115.
64. Schultz, W., Dayan, P., & Montague, P. R. (1997). A neural substrate of prediction and reward. Science, 275, 1593-1599.
65. Schwarze, U., Bingel, U., Badre, D., & Sommer, T. (2013). Ventral striatal activity correlates with memory confidence for old and new-responses in a difficult recognition test. PLoS One, 8, e54324.
66. Scimeca, J. M., & Badre, D. (2012). Striatal contributions to declarative memory retrieval. Neuron, 75, 380-392.
67. Shenhav, A., Botvinick, M. M., & Cohen, J. D. (2013). The expected value of control: An integrative theory of anterior cingulate cortex function. Neuron, 79, 217-240.
68. Simpson, E. H. (1951). The interpretation of interaction in contingency tables. Journal of the Royal Statistical Society, Series B, 13, 238-241.
69. Spaniol, J., Davidson, P. S., Kim, A. S., Han, H., Moscovitch, M., & Grady, C. L. (2009). Event-related fMRI studies of episodic encoding and retrieval: Meta-analyses using activation likelihood estimation. Neuropsychologia, 47, 1765-1779.
70. Squire, L. R. (1992). Memory and the hippocampus: A synthesis from findings with rats, monkeys, and humans. Psychological Review, 99, 195-231.
71. Stuss, D. T., Alexander, M. P., Palumbo, C. L., Buckle, L., Sayer, L., & Pogue, J. (1994). Organizational strategies of patients with unilateral or bilateral frontal lobe injury in word list learning tasks. Neuropsychologia, 8, 355-373.
72. Sutton, R. S., & Barto, A. G. (1998). Reinforcement learning: An introduction. Cambridge, MA: MIT Press.
73. Vilberg, K. L., & Rugg, M. D. (2008). Memory retrieval and the parietal cortex: A review of evidence from a dual-process perspective. Neuropsychologia, 46, 1787-1799.
74. Wagner, A. D., Shannon, B. J., Kahn, I., & Buckner, R. L. (2005). Parietal lobe contributions to episodic memory retrieval. Trends in Cognitive Sciences, 9, 445-453.
75. Wiecki, T. V., Sofer, I., & Frank, M. J. (2013). HDDM: hierarchical Bayesian estimation of the drift-diffusion model in Python. Frontiers in Neuroinformatics, 7, 14.
76. Yarkoni, T., Poldrack, R. A., Nichols, T. E., Van Essen, D. C., & Wager, T. D. (2011). Large-scale automated synthesis of human functional neuroimaging data. Nature Methods, 8, 665-670.