A neurocomputational model of dopamine and prefrontal-striatal interactions during multicue category learning by Parkinson patients

Journal of Cognitive Neuroscience

Volumn 23, Issue 1, 2011, Pages 151-167

  Moustafa, Ahmed A ^a   Gluck, Mark A ^a  

^a RUTGERS UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DOPAMINE;

ARTICLE; BASAL GANGLION; CONTROLLED STUDY; DOPAMINE BRAIN LEVEL; HUMAN; INSTRUMENTAL CONDITIONING; LEARNING ALGORITHM; PARKINSON DISEASE; PREFRONTAL CORTEX; PRIORITY JOURNAL; STRIATE CORTEX; TISSUE INTERACTION;

ALGORITHMS; ATTENTION; COMPUTER SIMULATION; CONDITIONING, OPERANT; CORPUS STRIATUM; DOPAMINE; HUMANS; LEARNING; MODELS, NEUROLOGICAL; NONLINEAR DYNAMICS; PARKINSON DISEASE; PREDICTIVE VALUE OF TESTS; PREFRONTAL CORTEX; REINFORCEMENT (PSYCHOLOGY);

EID: 78649466268     PISSN: 0898929X     EISSN: 15308898     Source Type: Journal    
DOI: 10.1162/jocn.2010.21420     Document Type: Article

References (61)

1. Amos, A. (2000). A computational model of information processing in the frontal cortex and basal ganglia. Journal of Cognitive Neuroscience, 12, 505-519.
2. Aron, A. R., Poldrack, R. A., & Wise, S. P. (2009). Cognition: Basal ganglia role. In L. R. Squire (Ed.), Encyclopedia of neuroscience (Vol. 2, pp. 1069-1077). Oxford: Academic Press.
3. Ashby, F. G., Alfonso-Reese, L. A., Turken, A. U., & Waldron, E. M. (1998). A neuropsychological theory of multiple systems in category learning. Psychological Review, 105, 442-481. (Pubitemid 128459549)
4. Ashby, F. G., Ell, S. W., Valentin, V. V., & Casale, M. B. (2005). FROST: A distributed neurocomputational model of working memory maintenance. Journal of Cognitive Neuroscience, 17, 1728-1743.
5. Braver, T. S., & Cohen, J. D. (2000). On the control of control: The role of dopamine in regulating prefrontal function and working memory. In S. Monsell & J. Driver (Eds.), Control of cognitive processes: Attention and performance XVIII (chapter 16, 779 pp.). Cambridge, MA: MIT Press.
6. Bussey, T. J., Dias, R., Redhead, E. S., Pearce, J. M., Muir, J. L., & Aggleton, J. P. (2000). Intact negative patterning in rats with fornix or combined perirhinal and postrhinal cortex lesions. Experimental Brain Research, 134, 506-519.
7. Carey, R. J., Pinheiro-Carrera, M., Dai, H., Tomaz, C., & Huston, J. P. (1995). L-DOPA and psychosis: Evidence for L-DOPA-induced increases in prefrontal cortex dopamine and in serum corticosterone. Biological Psychiatry, 38, 669-676.
8. Cohen, J. D., Barch, D. M., Carter, C., & Servan-Schreiber, D. (1999). Context-processing deficits in schizophrenia: Converging evidence from three theoretically motivated cognitive tasks. Journal of Abnormal Psychology, 108, 120-133.
9. Cohen, J. D., Braver, T. S., & Brown, J. W. (2002). Computational perspectives on dopamine function in prefrontal cortex. Current Opinion in Neurobiology, 12, 223-229.
10. Cohen, J. D., & Servan-Schreiber, D. (1992). Context, cortex, and dopamine: A connectionist approach to behavior and biology in schizophrenia. Psychological Review, 99, 45-77.
11. Cools, R., Barker, R. A., Sahakian, B. J., & Robbins, T. W. (2001). Enhanced or impaired cognitive function in Parkinson's disease as a function of dopaminergic medication and task demands. Cerebral Cortex, 11, 1136-1143. (Pubitemid 33108240)
12. Czernecki, V., Pillon, B., Houeto, J. L., Pochon, J. B., Levy, R., & Dubois, B. (2002). Motivation, reward, and Parkinson's disease: Influence of dopatherapy. Neuropsychologia, 40, 2257-2267. (Pubitemid 35303365)
13. Daw, N. D., Niv, Y., & Dayan, P. (2005). Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nature Neuroscience, 8, 1704-1711.
14. Fera, F., Weickert, T. W., Goldberg, T. E., Tessitore, A., Hariri, A., Das, S., et al. (2005). Neural mechanisms underlying probabilistic category learning in normal aging. Journal of Neuroscience, 25, 11340-11348.
15. Filoteo, J. V., Maddox, W. T., Ing, A. D., & Song, D. D. (2007). Characterizing rule-based category learning deficits in patients with Parkinson's disease. Neuropsychologia, 45, 305-320. (Pubitemid 44828776)
16. Frank, M. J. (2005). Dynamic dopamine modulation in the basal ganglia: A neurocomputational account of cognitive deficits in medicated and nonmedicated Parkinsonism. Journal of Cognitive Neuroscience, 17, 51-72.
17. Frank, M. J., Moustafa, A. A., Haughey, H. M., Curran, T., & Hutchison, K. E. (2007). Genetic triple dissociation reveals multiple roles for dopamine in reinforcement learning. Proceedings of the National Academy of Sciences, U.S.A., 104, 16311-16316.
18. Gluck, M. A., & Myers, C. E. (1993). Hippocampal mediation of stimulus representation: A computational theory. Hippocampus, 3, 491-516.
19. Gluck, M. A., Shohamy, D., & Myers, C. (2002). How do people solve the "weather prediction" task?: Individual variability in strategies for probabilistic category learning. Learning and Memory, 9, 408-418.
20. Guthrie, M., Myers, C. E., & Gluck, M. A. (2009). A neurocomputational model of tonic and phasic dopamine in action selection: A comparison with cognitive deficits in Parkinson's disease. Behavioural Brain Research, 200, 48-59.
21. Hazy, T. E., Frank, M. J., & O'Reilly, R. C. (2007). Towards an executive without a homunculus: Computational models of the prefrontal cortex/basal ganglia system. Philosophical Transaction of the Royal Society of London, Series B, Biological Sciences, 362, 1601-1613.
22. Houk, J. C. (1995). Information processing in modular circuits linking basal ganglia and cerebral cortex. In J. C. Houk, J. L. Davis, & D. G. Beiser (Eds.), Models of information processing in the basal ganglia (chapter 12, 382 pp.). Cambridge, MA: MIT Press.
23. Iba, M., & Sawaguchi, T. (2003). Involvement of the dorsolateral prefrontal cortex of monkeys in visuospatial target selection. Journal of Neurophysiology, 89, 587-599.
24. Jahanshahi, M., Wilkinson, L., Gahir, H., Dharminda, A., & Lagnado, D. A. (2010). Medication impairs probabilistic classification learning in Parkinson's disease. Neuropsychologia, 48, 1096-1103.
25. Jellinger, K. A. (1999). Post mortem studies in Parkinson's disease: Is it possible to detect brain areas for specific symptoms? Journal of Neural Transmission. Supplementum, 56, 1-29.
26. Joanisse, M. F., & Seidenberg, M. S. (1999). Impairments in verb morphology after brain injury: A connectionist model. Proceedings of the National Academy of Sciences, U.S.A., 96, 7592-7597.
27. Kaasinen, V., Nurmi, E., Bergman, J., Eskola, O., Solin, O., Sonninen, P., et al. (2001). Personality traits and brain dopaminergic function in Parkinson's disease. Proceedings of the National Academy of Sciences, U.S.A., 98, 13272-13277.
28. Kish, S. J., Shannak, K., & Hornykiewicz, O. (1988). Uneven pattern of dopamine loss in the striatum of patients with idiopathic Parkinson's disease. Pathophysiologic and clinical implications. New England Journal of Medicine, 318, 876-880.
29. Knowlton, B. J., Mangels, J. A., & Squire, L. R. (1996). A neostriatal habit learning system in humans. Science, 273, 1399-1402.
30. Kruschke, J. K. (2003). Attention in learning. Current Directions in Psychological Science, 12, 171-175.
31. Kruschke, J. K. (2005). Learning involves attention. In G. Houghton (Ed.), Connectionist models in cognitive psychology (pp. 113-140). East Sussex, UK: Psychology Press.
32. Lewis, S. J., Slabosz, A., Robbins, T. W., Barker, R. A., & Owen, A. M. (2005). Dopaminergic basis for deficits in working memory but not attentional set-shifting in Parkinson's disease. Neuropsychologia, 43, 823-832. (Pubitemid 40248892)
33. Mallet, N., Ballion, B., Le Moine, C., & Gonon, F. (2006). Cortical inputs and GABA interneurons imbalance projection neurons in the striatum of parkinsonian rats. Journal of Neuroscience, 26, 3875-3884.
34. Monchi, O., & Taylor, J. G. (1999). A hard wired model of coupled frontal working memories for various tasks. Information Sciences, 113, 221-243.
35. Monchi, O., Taylor, J. G., & Dagher, A. (2000). A neural model of working memory processes in normal subjects, Parkinson's disease and schizophrenia for fMRI design and predictions. Neural Networks, 13, 953-973.
36. Moustafa, A. A., & Maida, A. S. (2007). Using TD learning to simulate working memory performance in a model of the prefrontal cortex and basal ganglia. Cognitive Systems Research, 8, 262-281.
37. Moustafa, A. A., Sherman, S. J., & Frank, M. J. (2008). A dopaminergic basis for working memory, learning and attentional shifting in Parkinsonism. Neuropsychologia, 46, 3144-3156.
38. Myers, C. E., Kluger, A., Golomb, J., Ferris, S., de Leon, M. J., Schnirman, G., et al. (2002). Hippocampal atrophy disrupts transfer generalization in nondemented elderly. Journal of Geriatric Psychiatry and Neurology, 15, 82-90.
39. Olson, A. C., & Humphreys, G. W. (1999). Connectionist models of neuropsychological disorders. Trends in Cognitive Sciences, 1, 222-228.
40. O'Reilly, R. C., & Frank, M. J. (2006). Making working memory work: A computational model of learning in the frontal cortex and basal ganglia. Neural Computation, 18, 283-328.
41. Owen, A. M., Roberts, A. C., Hodges, J. R., Summers, B. A., Polkey, C. E., & Robbins, T. W. (1993). Contrasting mechanisms of impaired attentional set-shifting in patients with frontal lobe damage or Parkinson's disease. Brain, 116, 1159-1175.
42. Prediger, R. D., Batista, L. C., Medeiros, R., Pandolfo, P., Florio, J. C., & Takahashi, R. N. (2006). The risk is in the air: Intranasal administration of MPTP to rats reproducing clinical features of Parkinson's disease. Experimental Neurology, 202, 391-403.
43. Prescott, T. J., Montes Gonzalez, F. M., Gurney, K., Humphries, M. D., & Redgrave, P. (2006). A robot model of the basal ganglia: Behavior and intrinsic processing. Neural Networks, 19, 31-61. (Pubitemid 43090836)
44. Reynolds, J. N., Hyland, B. I., & Wickens, J. R. (2001). A cellular mechanism of reward-related learning. Nature, 413, 67-70.
45. Roberts, S., & Pashler, H. (2000). How persuasive is a good fit? A comment on theory testing. Psychological Review, 107, 358-367.
46. Rudy, J. W., & Sutherland, R. J. (1989). The hippocampal formation is necessary for rats to learn and remember configural discriminations. Behavioural Brain Research, 34, 97-109.
47. Rutledge, R. B., Lazzaro, S. C., Lau, B., Myers, C. E., Gluck, M. A., & Glimcher, P. W. (2009). Dopaminergic drugs modulate learning rates and perseveration in Parkinson's patients in a dynamic foraging task. Journal of Neuroscience, 29, 15104-15114.
48. Schultz, W. (2007). Multiple dopamine functions at different time courses. Annual Review of Neuroscience, 30, 259-288.
49. Schultz, W., Dayan, P., & Montague, P. R. (1997). A neural substrate of prediction and reward. Science, 275, 1593-1599.
50. Servan-Schreiber, D., Bruno, R. M., Carter, C. S., & Cohen, J. D. (1998). Dopamine and the mechanisms of cognition: Part I. A neural network model predicting dopamine effects on selective attention. Biological Psychiatry, 43, 713-722.
51. Servan-Schreiber, D., Cohen, J. D., & Steingard, S. (1996). Schizophrenic deficits in the processing of context. A test of a theoretical model. Archives of General Psychiatry, 53, 1105-1112.
52. Shepard, R. N., Hovland, C. I., & Jenkins, H. M. (1961). Learning and memorization of classifications. Psychological Monographs, 75.
53. Shohamy, D., Myers, C. E., Kalanithi, J., & Gluck, M. A. (2008). Basal ganglia and dopamine contributions to probabilistic category learning. Neuroscience and Biobehavioral Reviews, 32, 219-236.
54. Shohamy, D., Myers, C. E., Geghman, K. D., Sage, J., & Gluck, M. A. (2006). L-Dopa impairs learning, but spares generalization, in Parkinson's disease. Neuropsychologia, 44, 774-784.
55. Shohamy, D., Myers, C. E., Hopkins, R. O., Sage, J., & Gluck, M. A. (2009). Distinct hippocampal and basal ganglia contributions to probabilistic learning and reversal. Journal of Cognitive Neuroscience, 21, 1821-1833.
56. Shohamy, D., Myers, C. E., Onlaor, S., & Gluck, M. A. (2004). Role of the basal ganglia in category learning: How do patients with Parkinson's disease learn? Behavioral Neuroscience, 118, 676-686.
57. Silberstein, P., Pogosyan, A., Kuhn, A. A., Hotton, G., Tisch, S., Kupsch, A., et al. (2005). Cortico-cortical coupling in Parkinson's disease and its modulation by therapy. Brain, 128, 1277-1291. (Pubitemid 40826182)
58. Stafford, T., & Gurney, K. N. (2007). Biologically constrained action selection improves cognitive control in a model of the Stroop task. Philosophical Transactions of the Royal Society of London, Series B, Biological Sciences, 362, 1671-1684.
59. Suri, R. E., & Schultz, W. (1999). A neural network model with dopamine-like reinforcement signal that learns a spatial delayed response task. Neuroscience, 91, 871-890.
60. Tadaiesky, M. T., Dombrowski, P. A., Figueiredo, C. P., Cargnin-Ferreira, E., Da Cunha, C., & Takahashi, R. N. (2008). Emotional, cognitive and neurochemical alterations in a premotor stage model of Parkinson's disease. Neuroscience, 156, 830-840.
61. Takahashi, H., Kato, M., Takano, H., Arakawa, R., Okumura, M., Otsuka, T., et al. (2008). Differential contributions of prefrontal and hippocampal dopamine D(1) and D(2) receptors in human cognitive functions. Journal of Neuroscience, 28, 12032-12038.