A tutorial on computational cognitive neuroscience: Modeling the neurodynamics of cognition

Journal of Mathematical Psychology

Volumn 55, Issue 4, 2011, Pages 273-289

  Gregory Ashby, F ^a   Helie, Sebastien ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Computational cognitive neuroscience; Neural network modeling; Neuroscience

Indexed keywords

EID: 79960105097     PISSN: 00222496     EISSN: 10960880     Source Type: Journal    
DOI: 10.1016/j.jmp.2011.04.003     Document Type: Review

References (131)

1. Abraham W.C., Logan B., Wolff A., Benuskova L. Heterosynaptic LTD in the dentate gyrus of anesthetized rat requires homosynaptic activity. Journal of Neurophysiology 2007, 98:1048-1053.
2. Anderson J.R., Fincham J.M., Qin Y., Stocco A. A central circuit of the mind. Trends in Cognitive Sciences 2008, 12:136-143.
3. Aosaki T., Graybiel A.M., Kimura M. Effect of the nigrostriatal dopamine system on acquired responses in the striatum of behaving monkeys. Science 1994, 265:412-415.
4. Aosaki T., Tsubokawa H., Ishida A., Watanabe K., Graybiel A.M., Kimura M. Responses of tonically active neurons in the primate's striatum undergo systematic changes during behavioral sensorimotor conditioning. Journal of Neuroscience 1994, 14:3969-3984.
5. Arbuthnott G.W., Ingham C.A., Wickens J.R. Dopamine and synaptic plasticity in the neostriatum. Journal of Anatomy 2000, 196:587-596.
6. Ashby F.G. Statistical analysis of fMRI data 2011, MIT Press, Cambridge, MA.
7. Ashby F.G., Alfonso-Reese L.A., Turken A.U., Waldron E.M. A neuropsychological theory of multiple systems in category learning. Psychological Review 1998, 105:442-481.
8. Ashby F.G., Crossley M.J. A computational model of how cholinergic interneurons protect striatal-dependent learning. Journal of Cognitive Neuroscience 2011, 23:1549-1566.
9. Ashby F.G., Ell S.W., Waldron E.M. Procedural learning in perceptual categorization. Memory & Cognition 2003, 31:1114-1125.
10. Ashby F.G., Ell S.W., Valentin V., Casale M.B. FROST: a distributed neurocomputational model of working memory maintenance. Journal of Cognitive Neuroscience 2005, 17:1728-1743.
11. Ashby F.G., Ennis J.M., Spiering B.J. A neurobiological theory of automaticity in perceptual categorization. Psychological Review 2007, 114:632-656.
12. Ashby F.G., Maddox W.T. Relations between prototype, exemplar, and decision bound models of categorization. Journal of Mathematical Psychology 1993, 37:372-400.
13. Ashby F.G., Waldschmidt J.G. Fitting computational models to fMRI data. Behavior Research Methods 2008, 40:713-721.
14. Barnes T.D., Kubota Y., Hu D., Jin D.Z., Graybiel A.M. Activity of striatal neurons reflects dynamic encoding and recoding of procedural memories. Nature 2005, 437:1158-1161.
15. Bayer H.M., Glimcher P.W. Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron 2005, 47:129-141.
16. Bear M.F., Linden D.J. The mechanisms and meaning of long-term synaptic depression in the mammalian brain. Synapses 2001, 455-517. Johns Hopkins University Press, Baltimore, MD. W.M. Cowan, T.C. Südhof, C.F. Stevens (Eds.).
17. Best J.A., Nijhout H.F., Reed M.C. Homeostatic mechanisms in dopamine synthesis and release: a mathematical model. Theoretical Biology and Medical Modelling 2009, 6:21-41.
18. Bhalla U.S., Bower J.M. Exploring parameter space in detailed single cell models: simulations of the mitral and granule cells of the olfactory bulb. Journal of Neurophysiology 1993, 69:1948-1965.
19. Bienenstock E.L., Cooper L.N., Munro P.W. Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex. Journal of Neuroscience 1982, 2:32-48.
20. Bi G., Poo M. Synaptic modification of correlated activity: Hebb's postulate revisited. Annual Review of Neuroscience 2001, 24:139-166.
21. Bogacz R., Usher M., Zhang J., McClelland J.L. Extending a biologically inspired model of choice: multi-alternatives, nonlinearity and value-based multidimensional choice. Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences 2007, 362:1655-1670.
22. Bogacz R., Wagenmakers E.J., Forstmann B.U., Nieuwenhuis S. The neural basis of the speed-accuracy tradeoff. Trends in Neurosciences 2009, 33:10-16.
23. Brown J., Bullock D., Grossberg S. How the basal ganglia use parallel excitatory and inhibitory learning pathways to selectively respond to unexpected rewarding cues. Journal of Neuroscience 1999, 19:10502-10511.
24. Calabresi P., Picconi B., Tozzi A., Di Filippo M. Dopamine-mediated regulation of corticostriatal synaptic plasticity. Trends in Neurosciences 2007, 30:211-219.
25. Calabresi P., Pisani A., Mercuri N.B., Bernardi G. The corticostriatal projection: from synaptic plasticity to dysfunctions of the basal ganglia. Trends in Neurosciences 1996, 19:19-24.
26. Chadderdon G., Sporns O. A large-scale neurocomputational model of task-oriented behavior selection and working memory in prefrontal cortex. Journal of Cognitive Neuroscience 2006, 18:242-257.
27. Cohen J.D., Braver T.S., O'Reilly R.C. A computational approach to prefrontal cortex, cognitive control, and schizophrenia: Recent developments and current challenges. Philosophical Transactions of the Royal Society, Series B 1996, 351:1515-1527.
28. Cohen J.D., Servan-Schreiber D. Context, cortex and dopamine: a connectionist approach to behavior and biology in schizophrenia. Psychological Review 1992, 99:45-77.
29. Cragg S.J., Rice M.E., Greenfield S.A. Heterogeneity of electrically evoked dopamine release and reuptake in substantia nigra, ventral tegmental area, and striatum. Journal of Neurophysiology 1997, 77:863-873.
30. Dayan P., Abbott L.F. Theoretical neuroscience: computational and mathematical modeling of neural systems 2001, MIT Press, Cambridge, MA.
31. Derkach V., Barria A., Soderling T.R. Ca2+/calmodulin-kinase II enhances channel conductance of alpha-amino-3-hydroxy-5-methyl-4-isoxazolepropionate type glutamate receptors. Proceedings of the National Academy of Science, USA 1999, 96:3269-3274.
32. Desmurget M., Turner R.S. Motor sequences and the basal ganglia: kinematics, not habits. The Journal of Neuroscience 2010, 30:7685-7690.
33. Diana R.A., Reder L.M., Arndt J., Park H. Models of recognition: a review of arguments in favor of a dual-process account. Psychonomic Bulletin & Review 2006, 13:1-21.
34. Dum R.P., Strick P.L. Frontal lobe inputs to the digit representations of the motor areas on the lateral surface of the hemisphere. Journal of Neuroscience 2005, 25:1375-1386.
35. Ermentrout G.B. Type I membranes, phase resetting curves, and synchrony. Neural Computation 1996, 8:979-1001.
36. Feenstra M.G., Botterblom M.H. Rapid sampling of extracellular dopamine in the rat prefrontal cortex during food consumption, handling and exposure to novelty. Brain Research 1996, 742:17-24.
37. Feldman D.E. Synaptic mechanisms for plasticity in neocortex. Annual Review of Neuroscience 2009, 32:33-55.
38. FitzHugh R.A. Impulses and physiological states in theoretical models of nerve membrane. Biophysical Journal 1961, 1:445-466.
39. Földiák P. Forming sparse representations by local anti-Hebbian learning. Biological Cybernetics 1990, 64:165-170.
40. Frank M.J. Dynamic dopamine modulation in the basal ganglia: a neurocomputational account of cognitive deficits in medicated and nonmedicated Parkinsonism. Journal of Cognitive Neuroscience 2005, 17:51-72.
41. Frank M.J. Hold your horses: a dynamic computational role for the subthalamic nucleus in decision making. Neural Networks 2006, 19:1120-1136.
42. Frank M.J., Claus E.D. Anatomy of a decision: striato-orbitofrontal interactions in reinforcement learning, decision making and reversal. Psychological Review 2006, 113:300-326.
43. Frank M.J., Loughry B., O'Reilly R.C. Interactions between frontal cortex and basal ganglia in working memory: a computational model. Cognitive, Affective, and Behavioral Neuroscience 2001, 1:137-160.
44. Gabel L.A., Nisenbaum E.S. Muscarinic receptors differentially modulate the persistent potassium current in striatal spiny projection neurons. Journal of Neurophysiology 1999, 81:1418-1423.
45. Grafton S.T., Hazeltine E., Ivry R. Functional mapping of sequence learning in normal humans. Journal of Cognitive Neuroscience 1995, 7:497-510.
46. Grimwood P.D., Martin S.J., Morris R.G.M. Synaptic plasticity and memory. Synapses 2001, 519-570. Johns Hopkins University Press, Baltimore, MD. W.M. Cowan, T.C. Südhof, C.F. Stevens (Eds.).
47. Gu Q. Contribution of acetylcholine to visual cortex plasticity. Neurobiology of Learning and Memory 2003, 80:291-301.
48. Hartley T., Burgess N., Lever C., Cacucci F., O'Keefe J. Modeling place fields in terms of the cortical inputs to the hippocampus. Hippocampus 2000, 10:369-379.
49. Hartley M., Taylor N, Taylor J. Understanding spike-time-dependent plasticity: a biologically motivated computational model. Neurocomputing 2006, 69:2005-2016.
50. Haykin S. Neural networks and learning machines 2008, Prentice Hall, Upper Saddle River, NJ. 3rd ed.
51. Hélie S. An introduction to model selection: tools and algorithms. Tutorials in Quantitative Methods for Psychology 2006, 2:1-10.
52. Hodgkin A.L., Huxley A.F. A quantitative description of membrane and its application to conduction and excitation in nerve. Journal of Physiology 1952, 117:500-544.
53. Hollerman J.R., Schultz W. Dopamine neurons report an error in the temporal prediction of reward during learning. Nature Neuroscience 1998, 1:304-309.
54. Houk J., Adams J., Barto A. A model of how basal ganglia generate and use neural signals that predict reinforcement. Models of information irocessing in the basal ganglia 1995, 249-270. MIT Press, Cambridge, MA. J. Houk, J. Davis, D. Beiser (Eds.).
55. Houk J.C. Voluntary movement: control, learning and memory. Encyclopedia of behavioral neuroscience 2010, 455-458. Oxford, Academic Press. G.F. Koob, M. Le Moal, R.F. Thompson (Eds.).
56. Izhikevich E.M. Dynamical systems in neuroscience: the geometry of excitability and bursting 2007, MIT Press, Cambridge, MA.
57. Izhikevich E.M. Simple model of spiking neurons. IEEE Transactions on Neural Networks 2003, 14:1569-1572.
58. Izhikevich E.M. Which model to use for cortical spiking neurons?. IEEE Transactions on Neural Networks 2004, 15:1063-1070.
59. Izhikevich, E.M. (2005). Large-scale simulation of the human brain. http://vesicle.nsi.edu/users/izhikevich/human_brain_simulation/Blue_Brain.htm.
60. Jang Y., Wixted J.T., Huber D.E. Testing signal-detection models of~yes/no and two-alternative forced-choice recognition memory. Journal of Experimental Psychology: General 2009, 138:291-306.
61. Jörntell H., Hansel C. Synaptic memories upside down: bidirectional plasticity at cerebellar parallel fiber-Purkinje cell synapses. Neuron 2006, 52:227-238.
62. Kemp N., Bashir Z.I. Long-term depression: a cascade of induction and expression mechanisms. Progress in Neurobiology 2001, 65:339-365.
63. Kimura M., Rajkowski J., Evarts E. Tonically discharging putamen neurons exhibit set-dependent responses. Proceedings of the National Academy of Sciences, USA 1984, 81:4998-5001.
64. Kirkwood A., Rioult M.G., Bear M.F. Experience-dependent modification of synaptic plasticity in visual cortex. Nature 1996, 381:526-528.
65. Koch, C. (1999). Biophysics of computation. New York, Oxford.
66. Kreitzer A.C., Malenka R.C. Striatal plasticity and basal ganglia circuit function. neuron 2008, 60:543-554.
67. Lapicque L. Recherches quantitatives sur l'excitation électrique des nerfs traitée comme une polarization. Journal de Physiologie et de Pathologie Générale 1907, 9:620-635.
68. Latham P.E., Richmond B.J., Nelson P.G., Nirenberg S. Intrinsic dynamics in neuronal networks. I. theory. Journal of Neurophysiology 2000, 83:808-827.
69. Lee H.-K., Barbarosie M., Kameyama K., Bear M.F., Huganir R.L. Regulation of distinct AMPA receptor phosphorylation sites during bidirectional synaptic plasticity. Nature 2000, 405:955-959.
70. Lerner T.N., Kreitzer A.C. Neuromodulatory control of striatal plasticity and behavior. Current Opinion in Neurobiology 2011, 21:1-6.
71. Leveille J., Versace M., Grossberg S. Running as fast as it can: how spiking dynamics form object groupings in the laminar circuits of visual cortex. Journal of Computational Neuroscience 2010, 28:323-346.
72. Lisman J., Schulman H., Cline H. The molecular basis of CaMKII function in synaptic and behavioural memory. Nature Reviews Neuroscience 2002, 3:175-190.
73. Logothetis N.K. The underpinnings of the BOLD functional magnetic resonance imaging signal. The Journal of Neuroscience 2003, 23:3963-3971.
74. Logothetis N.K., Pauls J., Augath M., Trinath T., Oeltermann A. Neurophysiological investigation of the basis of the fMRI signal. Nature 2001, 412:150-157.
75. Maddox W.T., Ashby F.G. Comparing decision bound and exemplar models of categorization. Perception & Psychophysics 1993, 53:49-70.
76. Maddox W.T., Ashby F.G., Bohil C.J. Delayed feedback effects on rule-based and information-integration category learning. Journal of Experimental Psychology: Learning, Memory, and Cognition 2003, 29:650-662.
77. Maddox W.T., Ing A.D. Delayed feedback disrupts the procedural-learning system but not the hypothesis-testing system in perceptual category learning. Journal of Experimental Psychology: Learning, Memory, and Cognition 2005, 31:100-107.
78. Malenka R.C., Siegelbaum S.A. Synaptic plasticity. Synapses 2001, 393-453. Johns Hopkins University Press, Baltimore, MD. W.M. Cowan, T.C. Südhof, C.F. Stevens (Eds.).
79. Marr D. Vision: a computational investigation into the human representation and processing of visual information 1982, Freeman, New York.
80. McClelland J.L., McNaughton B.L., O'Reilly R.C. Why there are complementary learning systems in hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory. Psychological Review 1995, 102:419-457.
81. McCoy P.A., Huang H.-S., Philpot B.D. Advances in understanding visual cortex plasticity. Current Opinion in Neurobiology 2009, 19:298-304.
82. McCulloch W.S., Pitts W. A logical calculus of the ideas immanent in nervous activity. Bulletin of Mathematical Biology 1943, 5:115-133.
83. McMillen T., Holmes P. The dynamics of choice among multiple alternatives. Journal of Mathematical Psychology 2006, 50:30-57.
84. Medin D.L., Altom M.W., Edelson S.M., Freko D. Correlated symptoms and simulated medical classification. Journal of Experimental Psychology: Learning, Memory, and Cognition 1982, 8:37-50.
85. Meeter M., Jehee J., Murre J. Neural models that convince: model hierarchies and other strategies to bridge the gap between behavior and the brain. Philosophical Psychology 2007, 20:749-772.
86. Merchant H., Zainos A., Hernandez A., Salinas E., Romo R. Functional properties of primate putamen neurons during the categorization of tactile stimuli. Journal of Neurophysiology 1997, 77:1132-1154.
87. Mirenowicz J., Schultz W. Importance of unpredictability for reward responses in primate dopamine neurons. Journal of Neurophysiology 1994, 72:1024-1027.
88. Monchi O., Taylor J.G., Dagher A. A neural model of working memory processes in normal subjects, Parkinson's disease, and schizophrenia for fMRI design and predictions. Neural Networks 2000, 13:953-973.
89. Nagumo J., Arimoto S., Yoshizawa S. An active pulse transmission line simulating nerve axon. Proceedings of the Institute of Radio Engineers 1962, 50:2061-2070.
90. Nestler E.J., Hyman S.E., Malenka R.C. Molecular neuropharmacology 2001, McGraw-Hill, New York. 2nd ed.
91. Newell A. Précis of unified theories of cognition. Behavioral and Brain Sciences 1992, 15:425-492.
92. Newell A., Shaw J.C., Simon H.A. Elements of a theory of human problem solving. Psychological Review 1958, 65:151-166.
93. O'Dell T.J., Kandel E.R. Low-frequency stimulation erases LTP through an NMDA receptor-mediated activation of protein phosphatases. Learning & Memory 1994, 1:129-139.
94. O'Reilly R.C. Six principles for biologically based computational models of cortical cognition. Trends in Cognitive Sciences 1998, 2:455-462.
95. O'Reilly R.C., Frank M.J. Making working memory work: a computational model of learning in the frontal cortex and basal ganglia. Neural Computation 2006, 18:283-328.
96. O'Reilly R.C., Munakata Y. Computational explorations in cognitive neuroscience 2000, MIT Press, Cambridge, MA.
97. Pakhotin P., Bracci E. Cholinergic interneurons control the excitatory input to the striatum. Journal of Neuroscience 2007, 27:391-400.
98. Pitt M.A., Kim W., Navarro D.J., Myung J.I. Global model analysis by parameter space partitioning. Psychological Review 2006, 113:57-83.
99. Raaijmakers J.G.W., Shiffrin R.M. Models of memory. Memory and co gnitive processes 2004, Vol. 2:43-76. Wiley, New York. 3rd ed. H. Pashler, D. Medin (Eds.).
100. Rall W. Distinguishing theoretical synaptic potentials computed for different soma-dendritic distributions of synaptic input. Journal of Neurophysiology 1967, 30:1138-1168.
101. Rangel A., Hare T. Neural computations associated with goal-directed choice. Current Opinion in Neurobiology 2010, 20:262-270.
102. Rescorla R.A., Wagner A.R. A theory of Pavlovian conditioning: variations in the effectiveness of reinforcement and nonreinforcement. Classical conditioning II: current research and theory 1972, Appleton-Century-Crofts, New York. A.H. Black, W.F. Prokasy (Eds.).
103. Reynolds J.N.J., Hyland B.I., Wickens J.R. Modulation of an afterhyperpolarization by the substantia nigra induces pauses in the tonic firing of striatal cholinergic interneurons. Journal of Neuroscience 2004, 24:9870-9877.
104. Reynolds J.R., O'Reilly R.C. Developing PFC representations using reinforcement learning. Cognition 2009, 113:281-292.
105. Reynolds J.N.J., Wickens J.R. Dopamine-dependent plasticity of corticostriatal synapses. Neural Networks 2002, 15:507-521.
106. Ronesi J., Lovinger D.M. Induction of striatal long-term synaptic depression by moderate frequency activation of cortical afferents in rat. Journal of Physiology 2005, 562:245-256.
107. Rosenblatt F. The perceptron: a probabilistic model for information storage and organization in the brain. Psychological Review 1958, 65:386-406.
108. Rumelhart D.E., McClelland J.L., the PDP research group Parallel distributed processing: explorations in the microstructure of cognition. Volume I 1986, MIT Press, Cambridge, MA.
109. Schultz W. Predictive reward signal of dopamine neurons. Journal of Neurophysiology 1998, 80:1-27.
110. Schultz W., Dayan P., Montague P.R. A neural substrate of prediction and reward. Science 1997, 275:1593-1599.
111. Seamans J.K., Robbins T.W. Dopamine modulation of prefrontal cortex and cognitive function. The dopamine receptors 2010, 373-398. Humana Press, New York. 2nd ed. K.A. Neve (Ed.).
112. Seamans J.K., Yang C.R. The principal features and mechanisms of dopamine modulation in the prefrontal cortex. Progress in Neurobiology 2004, 74:1-57.
113. Segev I., Burke R. Compartmental models of complex neurons. Methods in neuronal modeling 1998, 93-128. MIT Press, Cambridge, MA. C. Koch, I. Segev (Eds.).
114. Shadlen M.N., Newsome W.T. Neural basis of a perceptual decision in the parietal cortex (Area LIP) of the rhesus monkey. Journal of Neurophysiology 2001, 86:1916-1936.
115. Shen W., Flajolet M., Greengard P., Surmeier D.J. Dichotomous dopaminergic control of striatal synaptic plasticity. Science 2008, 321:848-851.
116. Sjöström P.J., Rancz E.A., Roth A., Häusser M. Dendritic excitability and synaptic plasticity. Physiological Reviews 2008, 88:769-840.
117. Smith P.L., Ratcliff R. Psychology and neurobiology of simple decisions. Trends in Neurosciences 2004, 27:161-168.
118. Synaptic plasticity and transsynaptic signaling 2005, Springer, New York. P.K. Stanton, C. Bramham, H.E. Scharfman (Eds.).
119. Sutton R.S., Barto A.G. Reinforcement learning 1998, MIT Press, Cambridge, MA.
120. Suzuki T., Miura M., Nishimura K., Aosaki T. Dopamine-dependent synaptic plasticity in the striatal cholinergic interneurons. Journal of Neuroscience 2001, 21:6492-6501.
121. Tan C.O., Bullock D. A local circuit model of learned striatal and dopamine cell responses under probabilistic schedules of reward. Journal of Neuroscience 2008, 28:10062-10074.
122. Thorndike E.L. Animal intelligence 1911, Macmillan.
123. Tobler P.N., Dickinson A., Schultz W. Coding of predicted reward omission by dopamine neurons in a conditioned inhibition paradigm. Journal of Neuroscience 2003, 23:10402-10410.
124. Townsend J.T., Ashby F.G. Stochastic modeling of elementary psychological processes 1983, Cambridge University Press, New York.
125. Tzschentke T.M. Pharmacology and behavioral pharmacology of the mesocortical dopamine system. Progress in Neurobiology 2001, 63:241-320.
126. Usher M., McClelland J.L. On the time course of perceptual choice: The leaky competing accumulator model. Psychological Review 2001, 108:550-592.
127. Waldschmidt J.G., Ashby F.G. Cortical and striatal contributions to automaticity in information-integration categorization. Neuroimage 2011, 56:1791-1802.
128. Wang X.-J. Decision making in recurrent neuronal circuits. Neuron 2008, 60:215-234.
129. Wang Z., Kai L., Day M., Ronesi J., Yin H.H., Ding J. Dopaminergic control of corticostriatal long-term synaptic depression in medium spiny neurons is mediated by cholinergic interneurons. Neuron 2006, 50:443-452.
130. Willingham D.B., Wells L.A., Farrell J.M., Stemwedel M.E. Implicit motor sequence learning is represented in response locations. Memory & Cognition 2000, 28:366-375.
131. Zhang L.I., Tao H.W., Holt C.E., Harris W.A., Poo M.-M. A critical window for cooperation and competition among developing retinotectal synapses. Nature 1998, 395:37-44.