Learning representations in a gated prefrontal cortex model of dynamic task switching

Cognitive Science

Volumn 26, Issue 4, 2002, Pages 503-520

  Rougier, Nicolas P ^a   O'Reilly, Randall C ^a  

^a UNIVERSITY OF COLORADO   (United States)

Author keywords

Computational modeling; Neural networks; Reinforcement learning; Wisconsin card sorting task; Working memory

Indexed keywords

EID: 0043057281     PISSN: 03640213     EISSN: None     Source Type: Journal    
DOI: 10.1207/s15516709cog2604_4     Document Type: Article

References (29)

1. Braver, T. S., & Cohen, J. D. (2000). On the control of control: The role of dopamine in regulating prefrontal function and working memory. In S. Monsell & J. Driver (Eds.), Control of cognitive processes: Attention and performance (Vol. XVIII, pp. 713-737). Cambridge, MA: MIT Press.
2. Burgess, P.W., Veitch, E., de Lacy Costello, A., & Shallice, T. (2000). The cognitive and neuroanatomical correlates of multitasking. Neuropsychologia, 38, 848-863.
3. Cohen, J. D., Dunbar, K., & McClelland, J. L. (1990). On the control of automatic processes: A parallel distributed processing model of the Stroop effect. Psychological Review, 97(3), 332-361.
4. Cohen, J. D., & O'Reilly, R. C. (1996). A preliminary theory of the interactions between prefrontal cortex and hippocampus that contribute to planning and prospective memory. In M. Brandimonte, G. O. Einstein, & M. A. McDaniel (Eds.), Prospective memory: Theory and applications (pp. 267-296). Mahwah, NJ: Lawrence Erlbaum.
5. Dehaene, S., & Changeux, J. P. (1991). The Wisconsin card sorting test: Theoretical analysis and modeling in a neuronal network. Cerebral Cortex, 1, 62-79.
6. Dias, R., Robbins, T. W., & Roberts, A. C. (1997). Dissociable forms of inhibitory control within prefrontal cortex with an analog of the Wisconsin card sort test: Restriction to novel situations and independence from "on-line" processing. Journal of Neuroscience, 17, 9285-9297.
7. Elman, J. L. (1990). Finding structure in time. Cognitive Science, 14, 179-211.
8. Frank, M. J., Loughry, B., & O'Reilly, R. C. (2001). Interactions between the frontal cortex and basal ganglia in working memory: A computational model. Cognitive, Affective, and Behavioral Neuroscience, 1, 137-160.
9. Grant, D. A., & Berg, E. A. (1948). A behavioral analysis of degree of reinforcement and ease of shifting to new responses in a Weigl type card sorting problem. Journal of Experimental Psychology, 38, 404-411.
10. Heaton, R. K., Chelune, G. J., Talley, J. L., Kay, G. G., & Curtiss, G. (1993). Wisconsin card sorting test manual: Revised and expanded. Odessa, FL: Psychological Assessment Resources Inc.
11. Miller, E. K., & Cohen, J. D. (2001). An integrative theory of prefrontal cortex function. Annual Review of Neuroscience, 24, 167-202.
12. Milner, B. (1963). Effects of different brain lesions on card sorting. Archives of Neurology, 9, 90-100.
13. Montague, P. R., Dayan, P., & Sejnowski, T. J. (1996). A framework for mesencephalic dopamine systems based on predictive Hebbian learning. Journal of Neuroscience, 16, 1936-1947.
14. Mountain, M. A., & Snow, W. G. (1993). Wisconsin card sorting test as a measure of frontal pathology: A review. The Clinical Neuropsychologist, 7, 108-118.
15. Movellan, J. R., & McClelland, J. L. (1993). Learning continuous probability distributions with symmetric diffusion networks. Cognitive Science, 17, 463-496.
16. Munakata, Y., & Yerys, B. E. (2001). All together now: When dissociations between knowledge and action disappear. Psychological Science, 12, 335-337.
17. O'Reilly, R. C. (1996). Biologically plausible error-driven learning using local activation differences: The generalized recirculation algorithm. Neural Computation, 8(5), 895-938.
18. O'Reilly, R. C. (1998). Six principles for biologically-based computational models of cortical cognition. Trends in Cognitive Sciences, 2(11), 455-462.
19. O'Reilly, R. C., Braver, T. S., & Cohen, J. D. (1999).Abiologically based computational model of working memory. In A. Miyake & P. Shah (Eds.), Models of working memory: Mechanisms of active maintenance and executive control (pp. 375-411). New York: Cambridge University Press.
20. O'Reilly, R. C., & Munakata, Y. (2000). Computational explorations in cognitive neuroscience: Understanding the mind by simulating the brain. Cambridge, MA: MIT Press.
21. O'Reilly, R. C., Noelle, D., Braver, T. S., & Cohen, J. D. (2002). Prefrontal cortex and dynamic categorization tasks: Representational organization and neuromodulatory control. Cerebral Cortex, 12, 246-257.
22. Owen, A. M., Roberts, A. C., Hodges, J. R., Summers, B. A., Polkey, C. E., & Robbins, T. W. (1993). Contrasting mechanisms of impaired attentional set-shifting in patients with frontal lobe damage or Parkinson's disease. Brain, 116, 1159-1175.
23. Reitan, R. M., & Wolfson, D. (1994). A selective and critical review of neuropsychological deficits and the frontal lobes. Neuropsychology Review, 4, 161-198.
24. Roberts, A. C., Robbins, T. W., & Everitt, B. J. (1988). The effects of intradimensional and extradimensional shifts on visual discrimination learning in humans and non-human primates. Quarterly Journal of Experimental Psychology, 40, 321-341.
25. Schultz,W., Apicella, P.,&Ljungberg,T. (1993). Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task. Journal of Neuroscience, 13, 900-913.
26. Stuss, D. T., Levine, B., Alexander, M. P., Hong, J., Palumbo, C., Hamer, L., Murphy, K. J., & Izukawa, D. (2000). Wisconsin card sorting test performance in patients with focal frontal and posterior brain damage: Effects of lesion location and test structure on separable cognitive processes. Neuropsychologia, 38, 388-402.
27. Sutton, R. S. (1988). Learning to predict by the method of temporal diferences. Machine Learning, 3, 9-44.
28. Sutton, R. S., & Barto, A. G. (1998). Reinforcement learning: An introduction. Cambridge, MA: MIT Press.
29. Zelazo, P. D., Frye, D., & Rapus, T. (1996). An age-related dissociation between knowing rules and using them. Cognitive Development, 11, 37-63.