Controlling working memory with learned instructions

Neural Networks

Volumn 41, Issue , 2013, Pages 23-38

  Sylvester, J C ^a,b   Reggia, J A ^a,b   Weems, S A ^b   Bunting, M F ^b  

^a Institute of Advanced Computer Science   (United States)

^b UNIVERSITY OF MARYLAND   (United States)

Author keywords

Adaptive gating; Cognitive control; Hopfield attractor networks; N back; Temporally asymmetric Hebbian learning; Working memory

Indexed keywords

ADAPTIVE GATING; ATTRACTOR NETWORKS; COGNITIVE CONTROL; N-BACK; TEMPORALLY ASYMMETRIC HEBBIAN; WORKING MEMORY;

ARTIFICIAL INTELLIGENCE; COGNITIVE SYSTEMS;

ADAPTIVE CONTROL SYSTEMS;

ACCURACY; ALGORITHM; ARTICLE; ASSOCIATIVE MEMORY; BRAIN FUNCTION; BRAIN REGION; EXECUTIVE FUNCTION; FRONTAL CORTEX; GATED ATTRACTORS LEARNING INSTRUCTION SEQUENCES MODEL; MATHEMATICAL ANALYSIS; MATHEMATICAL MODEL; MENTAL CAPACITY; PREDICTION; PRIORITY JOURNAL; RECALL; RESPONSE TIME; VISUAL STIMULATION; WORKING MEMORY;

ARTIFICIAL INTELLIGENCE; COGNITION; HUMANS; MEMORY, SHORT-TERM; MODELS, NEUROLOGICAL; NEURAL NETWORKS (COMPUTER);

EID: 84875901690     PISSN: 08936080     EISSN: 18792782     Source Type: Journal    
DOI: 10.1016/j.neunet.2013.01.010     Document Type: Article

References (90)

1. Altmann E.M., Gray W.D. Forgetting to remember: the functional relationship of decay and interference. Psychological Science 2002, 13:27-33.
2. Amos A. A computational model of information processing in the frontal cortex and basal ganglia. Journal of Cognitive Neuroscience 2000, 12:505-519.
3. Baddeley A.D. Working memory, thought, and action. Oxford psychology series 2007, vol. 45. Oxford University Press.
4. Blum K.I., Abbott L.F. A model of spatial map formation in the hippocampus of the rat. Neural Computation 1996, 8:85-93.
5. Botvinick M.M., Plaut D.C. Short-term memory for serial order: a recurrent neural network model. Psychological Review 2006, 113:201-233.
6. Bressler S., Menon V. Large-scale brain networks in cognition. Trends in Cognitive Sciences 2010, 14:277-290.
7. Brown J., Braver T. Learned predictions of error likelihood in the anterior cingulate cortex. Science 2005, 307:1118-1121.
8. Brown G.D., Preece T., Hulme C. Oscillator-based memory for serial order. Psychological Review 2000, 107:127-181.
9. Bunge S. How we use rules to select actions: a review of evidence from cognitive neuroscience. Cognitive, Affective & Behavioral Neuroscience 2004, 4:564-579.
10. Burgess N., Hitch G.J. Memory for serial order: a network model of the phonological loop and its timing. Psychological Review 1999, 106:551-581.
11. Carpenter G.A., Grossberg S. Adaptive resonance theory. The handbook of brain theory and neural networks 2003, 87-90. MIT Press, Cambridge, MA. M.A. Arbib (Ed.).
12. Carter C.S., Braver T.S., Barch D.M., Botvinick M.M., Noll D.C., Cohen J.D. Anterior cingulate cortex, error detection, and the online monitoring of performance. Science 1998, 280:747-749.
13. Charron S., Koechlin E. Divided representation of concurrent goals in the human frontal lobes. Science 2010, 328:360-363.
14. Chatham C.H., Herd S.A., Brant A.M., Hazy T.E., Miyake A., O'Reilly R., Friedman N.P. From an executive network to executive control: a computational model of the n-back task. Journal of Cognitive Neuroscience 2011, 23:3598-3619.
15. Choo, F.-X., & Eliasmith, C. (2010). Spiking neuron model of serial-order recall. In R. Cattrambone, & S. Ohlsson (Eds.), 32nd ann. conf. cognitive science society. Portland, OR.
16. Cowan N. An embedded-processes model of working memory. Models of working memory: mechanisms of active maintenance and executive control 1999, 62-101. Cambridge University Press. A. Miyake, P. Shah (Eds.).
17. Cowan N., Elliott E.M., Scott Saults J., Morey C.C., Mattox S., Hismjatullina A., Conway A.R.a. On the capacity of attention: its estimation and its role in working memory and cognitive aptitudes. Cognitive Psychology 2005, 51:42-100.
18. Dehaene S., Changeux J.-P. A hierarchical neuronal network for planning behavior. Proc. Nat'l Acad. Sci. USA 1997, 94:13293-13298.
19. Durstewitz D., Seamans J.K. The dual-state theory of prefrontal cortex dopamine function with relevance to catechol-o-methyltransferase genotypes and schizophrenia. Biological Psychiatry 2008, 64:739-749.
20. Durstewitz D., Seamans J.K., Sejnowski T.J. Neurocomputational models of working memory. Nature Neuroscience 2000, 3:1184-1191.
21. Engle R.W., Conway A.R.A., Tuholski S.W., Shisler R.J. A resource account of inhibition. Psychological Science 1995, 6:122-125.
22. Farrell S., Lewandowsky S. An endogenous distributed model of ordering in serial recall. Psychonomic Bulletin & Review 2002, 9:59-79.
23. Frank M.J., Loughry B., O'Reilly R.C. Interactions between frontal cortex and basal ganglia in working memory: a computational model. Cognitive, Affective & Behavioral Neuroscience 2001, 1:137-160.
24. Frank M.J., Samanta J., Moustafa A.A., Sherman S.J. Hold your horses: impulsivity, deep brain stimulation, and medication in Parkinsonism. Science 2007, 318:1309-1312.
25. Goldman-Rakic P.S. Circuitry of primate prefrontal cortex and regulation of behavior by representational memory. Handbook of physiology - the nervous system 1987, vol. 5:373-417.
26. Grossberg S. Adaptive resonance theory. Encyclopedia of cognitive science 2000, Wiley. L. Nadel (Ed.).
27. Gurney K., Prescott T.J., Redgrave P. A computational model of action selection in the basal ganglia, I: a new functional anatomy. Biological Cybernetics 2001, 84:401-410.
28. Harbison, J.I., Atkins, S.M., & Dougherty, M.R. (2011). Performance gains in an adaptive n-back working memory training task. In Proc. 50th ann. mtg. psychonomic society (pp. 120-125).
29. Hockey A., Geffen G. The concurrent validity and test-retest reliability of a visuospatial working memory task. Intelligence 2004, 32:591-605.
30. Hopfield J.J. Neural networks and physical systems with emergent collective computational abilities. Proc. Nat'l Acad. Sci. USA 1982, 79:2554-2558.
31. Hopfield J.J., Feinstein D.I., Palmer R.G. 'Unlearning' has a stabilizing effect in collective memories. Nature 1983, 304:158-159.
32. Horn D., Usher M. Oscillatory model of short term memory. Advances in neural infromation and processing systems 4 1992, 125-132. Morgan Kaufmann. J.E. Moody, S.J. Hanson, R.P. Lippmann (Eds.).
33. Hoshino O., Usuba N., Kashimori Y., Kambara T. Role of itinerancy among attractors as dynamical map in distributed coding scheme. Neural Networks 1997, 10:1375-1390.
34. Jaeggi S.M., Buschkuehl M., Jonides J., Perrig W.J. Improving fluid intelligence with training on working memory. Proc. nat'l acad. sci. USA 2008, 105:6829-6833.
35. Jaeggi S.M., Studer-Luethi B., Buschkuehl M., Su Y.-F., Jonides J., Perrig W.J. The relationship between n-back performance and matrix reasoning: implications for training and transfer. Intelligence 2010, 38:625-635.
36. Jones M., Polk T.A. An attractor network model of serial recall. Cognitive Systems Research 2002, 3:45-55.
37. Kaplan G., Sengör N.S., Gürvit H., Genç I., Güzeli C. A composite neural network model for perseveration and distractibility in the Wisconsin card sorting test. Neural Networks 2006, 19:375-387.
38. Katori Y., Sakamoto K., Saito N., Tanji J., Mushiake H., Aihara K. Representational switching by dynamical reorganization of attractor structure in a network model of the prefrontal cortex. PLoS Computational Biology 2011, 7:e1002266.
39. Kesner R.P., Gilbert P.E., Wallenstein G.V. Testing neural network models of memory with behavioral experiments. Current Opinion in Neurobiology 2000, 10:260-265.
40. Koene R., Hasselmo M. First-in-first-out item replacement in a model of short-term memory based on persistent spiking. Cerebral Cortex 2007, 17:1766-1781.
41. Korsten N.J.H., Fragopanagos N., Hartley M., Taylor N., Taylor J.G. Attention as a controller. Neural Networks 2006, 19:1408-1421.
42. Kremer S.C. Spatiotemporal connectionist networks: a taxonomy and review. Neural Computation 2001, 13:249-306.
43. Lewandowsky S. Redintegration and response suppression in serial recall: a dynamic network model. Int'l Jrnl of Psychology 1999, 34:434-446.
44. Lewandowsky S., Farrell S. Computational models of working memory. Encyclopedia of cognitive science 2003, Macmillan Reference. L. Nadel (Ed.).
45. Li S.-C., Lewandowsky S. Intralist distractors and recall: constraints on models of memory for serial order. Journal of Experimental Psychology: Learning, Memory, and Cognition 1993, 19:895-908.
46. Long D.L., Parks R.W., Levine D.S. An introduction to neural network modeling: merits, limitations, and controversies. Fundamentals of neural network modeling 1998, 3-32. MIT Press, Cambridge, MA. R.W. Parks, D.S. Levine, D.L. Long (Eds.).
47. Ma J. The asymptotic memory capacity of the generalized Hopfield network. Neural Networks 1999, 12:1207-1212.
48. MacDonald A., Cohen J., Stenger V., Carter C. Dissociating the role of the dorsolateral prefrontal and anterior cingulate cortex in cognitive control. Science 2000, 288:1835-1838.
49. Marcus G.F. The algebraic mind: integrating connectionism and cognitive science 2001, MIT Press, Cambridge, MA.
50. McEliece R., Posner E., Rodemich E., Venkatesh S. The capacity of the Hopfield associative memory. IEEE Trans. Information Theory 1987, 33:461-482.
51. Monner D., Reggia J.A. A generalized LSTM-like training algorithm for second-order recurrent neural networks. Neural Networks 2012, 25:70-83.
52. Navarro G. A guided tour to approximate string matching. ACM Computing Surveys 2001, 33:31-88.
53. Omlin C.W., Giles L. Symbolic knowledge representation in recurrent neural networks: insights from theoretical models of computation. Knowledge based neurocomputing 2000, 63-115. MIT Press, Cambridge, MA, (chapter 3). I. Cloete, J.M. Zuruda (Eds.).
54. O'Reilly R.C., Frank M.J. Making working memory work: a computational model of learning in the prefrontal cortex and basal ganglia. Neural Computation 2006, 18:283-328.
55. O'Reilly R.C., Noelle D.C., Braver T.S., Cohen J.D. Prefrontal cortex and dynamic categorization tasks: representational organization and neuromodulatory control. Cerebral Cortex 2002, 12:246-257.
56. Owen A.M., McMillan K.M., Laird A.R., Bullmore E. N-back working memory paradigm: a meta-analysis of normative functional neuroimaging studies. Human Brain Mapping 2005, 25:46-59.
57. Page M.P., Norris D. The primacy model: a new model of immediate serial recall. Psychological Review 1998, 105:761-781.
58. Pascanu R., Jaeger H. A neurodynamical model for working memory. Neural Networks 2011, 24:199-207.
59. Ponzi A. Dynamical model of salience gated working memory, action selection and reinforcement based on basal ganglia and dopamine feedback. Neural Networks 2008, 21:322-330.
60. Redgrave P., Prescott T.J., Gurney K.N. The basal ganglia: a vertebrate solution to the selection problem?. Neuroscience 1999, 89:1009-1023.
61. Reggia, J.A., Sylvester, J.C., Weems, S.A., & Bunting, M.F. (2009). A simple oscillatory short-term memory. In Proc. AAAI symposium on biologically inspired cognitive architectures II (pp. 103-108).
62. Rougier N.P., Noelle D.C., Braver T.S., Cohen J.D., O'Reilly R.C. Prefrontal cortex and flexible cognitive control: rules without symbols. Proc. Nat'l Acad. Sci. USA 2005, 102:7338-7343.
63. Roy A. Connectionism, controllers, and a brain theory. IEEE Transactions on Systems, Man and Cybernetics, Part A 2008, 38:1434-1441.
64. Sandberg A., Tegnér J., Lansner A. A working memory model based on fast Hebbian learning. Network: Computation in Neural Systems 2003, 14:789-802.
65. Schmidt H., Jogia J., Fast K., Christodoulou T., Haldane M., Kumari V., Frangou S. No gender differences in brain activation during the n-back task: an fMRI study in healthy individuals. Human Brain Mapping 2009, 30:3609-3615.
66. Schoofs D., Preuß D., Wolf O.T. Psychosocial stress induces working memory impairments in an n-back paradigm. Psychoneuroendocrinology 2008, 33:643-653.
67. Schroll H., Vitay J., Hamker F.H. Working memory and response selection: a computational account of interactions among cortico-basalganglio-thalamic loops. Neural Networks 2012, 26:59-74.
68. Sherman S., Guillery R. Exploring the thalamus and its role in cortical function 2006, MIT Press.
69. Simen P., Polk T.A. A symbolic/subsymbolic interface protocol for cognitive modeling. Logic Journal of the IGPL 2009, 18:705-761.
70. Simen, P., Vugt, M.V., Balci, F., Freestone, D., & Polk, T.A. (2010). Toward an analog neural substrate for production systems. In Proc. of the 10th int'l conf. on cognitive modeling (pp. 223-228).
71. Singer W. Dynamic formation of functional networks by synchronization. Neuron 2011, 69:191-193.
72. Sporns O. Networks of the brain 2011, MIT Press.
73. Stemme A., Deco G., Busch A. The neuronal dynamics underlying cognitive flexibility in set shifting tasks. Journal of computational neuroscience 2007, 23:313-331.
74. Stewart, T.C., Choo, F.-X., & Eliasmith, C. (2010). Symbolic reasoning in spiking neurons: a model of the cortex/basal ganglia/thalamus loop. In Proc. 32nd ann. conf. cognitive science society (pp. 1100-1105).
75. Stewart, T.C., & Eliasmith, C. (2011). Neural cognitive modelling: a biologically constrained spiking neuron model of the tower of hanoi task. In Proc. 33rd ann. conf. cognitive science society (pp. 565-661).
76. Stewart T.C., Tang Y., Eliasmith C. A biologically realistic cleanup memory: autoassociation in spiking neurons. Cognitive Systems Research 2011, 12:84-92.
77. Storkey A. Increasing the capacity of a Hopfield network without sacrificing functionality. Proc. ICANN 1997, 451-456.
78. Storkey A., Valabregue R. The basins of attraction of a new Hopfield learning rule. Neural Networks 1999, 12:869-876.
79. Sun R. The CLARION cognitive architecture: extending cognitive modeling to social simulation. Cognition and multi-agent interaction 2006, 79-99. Cambridge University Press, New York. R. Sun (Ed.).
80. Sylvester J.C., Reggia J.A., Weems S.A. Cognitive control as a gated cortical net. Proc. 2nd int'l conf. biologically inspired cognitive architectures 2011, 371-376. IOS Press.
81. Sylvester, J.C., Reggia, J.A., Weems, S.A., & Bunting, M.F. (2010). A temporally asymmetric hebbian network for sequential working memory. In D.D. Salvucci, & G. Gunzelmann (Eds.), Proc. 10th int'l conf. cognitive modeling (pp. 241-246).
82. Tanji J., Shima K., Mushiake H. Concept-based behavioral planning and the lateral prefrontal cortex. Trends in Cognitive Sciences 2007, 11:528-534.
83. Tsuda I. Toward an interpretation of dynamic neural activity in terms of chaotic dynamical systems. The Behavioral and Brain Sciences 2001, 24:793-810.
84. van Essen D. Corticocortical and thalamocortical information flow in the primate visual system. Progress in Brain Research 2005, 149:173-185.
85. van Essen D., Anderson C., F.D. Information processing in the primate visual systems. Science 1992, 255:419-423.
86. Verduzco-Flores S., Ermentrout B., Bodner M. Modeling neuropathologies as disruption of normal sequence generation in working memory networks. Neural Networks 2012, 27:21-31.
87. Watter S., Geffen G.M., Geffen L.B. The n-back as a dual-task: P300 morphology under divided attention. Psychophysiology 2001, 38:998-1003.
88. Weems S.A., Winder R.K., Bunting M.F., Reggia J.A. Running memory span: a comparison of behavioral capacity limits with those of an attractor neural network. Cognitive Systems Research 2009, 10:161-171.
89. Winder R.K., Reggia J.A., Weems S.A., Bunting M.F. An oscillatory Hebbian network model of short-term memory. Neural Computation 2009, 21:741-761.
90. Womelsdorf T., Fries P. Selective attention through selective neuronal synchronization. The cognitive neurosciences 2009, 289-302. MIT Press. M. Gazzaniga (Ed.).