Recurrent Network Models of Sequence Generation and Memory

Neuron

Volumn 90, Issue 1, 2016, Pages 128-142

  Rajan, Kanaka ^a   Harvey, Christopher D ^b   Tank, David W ^a  

^a PRINCETON UNIVERSITY   (United States)

^b HARVARD MEDICAL SCHOOL   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; ARTIFICIAL NEURAL NETWORK; BEHAVIOR; BRAIN FUNCTION; CONTROLLED STUDY; DECISION MAKING; FORCED CHOICE METHOD; NERVE CELL NETWORK; NEURAL SEQUENCE; POSITIVE FEEDBACK; POSTERIOR PARIETAL CORTEX; PRIORITY JOURNAL; RECURRENT NEURAL NETWORK; SHORT TERM MEMORY; SYNAPSE; WORKING MEMORY; ALGORITHM; ANIMAL; BIOLOGICAL MODEL; MOUSE; NERVE CELL; NERVE TRACT; PARIETAL LOBE; PHYSIOLOGY;

ALGORITHMS; ANIMALS; CHOICE BEHAVIOR; DECISION MAKING; MEMORY, SHORT-TERM; MICE; MODELS, NEUROLOGICAL; NEURAL PATHWAYS; NEURONS; PARIETAL LOBE;

EID: 84959861453     PISSN: 08966273     EISSN: 10974199     Source Type: Journal    
DOI: 10.1016/j.neuron.2016.02.009     Document Type: Article

References (71)

1. Amit, D.J., Modeling Brain Function: The World of Attractor Neural Networks. 1992, Cambridge University Press.
2. Amit, D.J., The Hebbian paradigm reintegrated: local reverberations as internal representations. Behav. Brain Sci., 18, 1995, 617.
3. Amit, D.J., Brunel, N., Learning internal representations in an attractor neural network with analogue neurons. Network 6 (1995), 359–388.
4. Andersen, R.A., Cui, H., Intention, action planning, and decision making in parietal-frontal circuits. Neuron 63 (2009), 568–583.
5. Andersen, R.A., Burdick, J.W., Musallam, S., Pesaran, B., Cham, J.G., Cognitive neural prosthetics. Trends Cogn. Sci. 8 (2004), 486–493.
6. Barak, O., Sussillo, D., Romo, R., Tsodyks, M., Abbott, L.F., From fixed points to chaos: three models of delayed discrimination. Prog. Neurobiol. 103 (2013), 214–222.
7. Barnes, T.D., Kubota, Y., Hu, D., Jin, D.Z., Graybiel, A.M., Activity of striatal neurons reflects dynamic encoding and recoding of procedural memories. Nature 437 (2005), 1158–1161.
8. Ben-Yishai, R., Bar-Or, R.L., Sompolinsky, H., Theory of orientation tuning in visual cortex. Proc. Natl. Acad. Sci. USA 92 (1995), 3844–3848.
9. Bertschinger, N., Natschläger, T., Real-time computation at the edge of chaos in recurrent neural networks. Neural Comput. 16 (2004), 1413–1436.
10. Bisley, J.W., Goldberg, M.E., Neuronal activity in the lateral intraparietal area and spatial attention. Science 299 (2003), 81–86.
11. Brunton, B.W., Botvinick, M.M., Brody, C.D., Rats and humans can optimally accumulate evidence for decision-making. Science 340 (2013), 95–98.
12. Buonomano, D.V., Timing of neural responses in cortical organotypic slices. Proc. Natl. Acad. Sci. USA 100 (2003), 4897–4902.
13. Buonomano, D.V., A learning rule for the emergence of stable dynamics and timing in recurrent networks. J. Neurophysiol. 94 (2005), 2275–2283.
14. Buonomano, D.V., Merzenich, M.M., Temporal information transformed into a spatial code by a neural network with realistic properties. Science 267 (1995), 1028–1030.
15. Calton, J.L., Taube, J.S., Where am I and how will I get there from here? A role for posterior parietal cortex in the integration of spatial information and route planning. Neurobiol. Learn. Mem. 91 (2009), 186–196.
16. Churchland, M.M., Yu, B.M., Cunningham, J.P., Sugrue, L.P., Cohen, M.R., Corrado, G.S., Newsome, W.T., Clark, A.M., Hosseini, P., Scott, B.B., et al. Stimulus onset quenches neural variability: a widespread cortical phenomenon. Nat. Neurosci. 13 (2010), 369–378.
17. Cossell, L., Iacaruso, M.F., Muir, D.R., Houlton, R., Sader, E.N., Ko, H., Hofer, S.B., Mrsic-Flogel, T.D., Functional organization of excitatory synaptic strength in primary visual cortex. Nature 518 (2015), 399–403.
18. Crowe, D.A., Averbeck, B.B., Chafee, M.V., Rapid sequences of population activity patterns dynamically encode task-critical spatial information in parietal cortex. J. Neurosci. 30 (2010), 11640–11653.
19. Davidson, T.J., Kloosterman, F., Wilson, M.A., Hippocampal replay of extended experience. Neuron 63 (2009), 497–507.
20. Fiete, I.R., Senn, W., Wang, C.Z., Hahnloser, R.H.R., Spike-time-dependent plasticity and heterosynaptic competition organize networks to produce long scale-free sequences of neural activity. Neuron 65 (2010), 563–576.
21. Fisher, D., Olasagasti, I., Tank, D.W., Aksay, E.R., Goldman, M.S., A modeling framework for deriving the structural and functional architecture of a short-term memory microcircuit. Neuron 79 (2013), 987–1000.
22. Freedman, D.J., Assad, J.A., A proposed common neural mechanism for categorization and perceptual decisions. Nat. Neurosci. 14 (2011), 143–146.
23. Fujisawa, S., Amarasingham, A., Harrison, M.T., Buzsáki, G., Behavior-dependent short-term assembly dynamics in the medial prefrontal cortex. Nat. Neurosci. 11 (2008), 823–833.
24. Gold, J.I., Shadlen, M.N., The neural basis of decision making. Annu. Rev. Neurosci. 30 (2007), 535–574.
25. Goldman, M.S., Memory without feedback in a neural network. Neuron 61 (2009), 621–634.
26. Hahnloser, R.H.R., Kozhevnikov, A.A., Fee, M.S., An ultra-sparse code underlies the generation of neural sequences in a songbird. Nature 419 (2002), 65–70.
27. Hanks, T.D., Kopec, C.D., Brunton, B.W., Duan, C.A., Erlich, J.C., Brody, C.D., Distinct relationships of parietal and prefrontal cortices to evidence accumulation. Nature 520 (2015), 220–223.
28. Hansel, D., Mato, G., Existence and stability of persistent states in large neuronal networks. Phys. Rev. Lett. 86 (2001), 4175–4178.
29. Harvey, C.D., Coen, P., Tank, D.W., Choice-specific sequences in parietal cortex during a virtual-navigation decision task. Nature 484 (2012), 62–68.
30. Haykin, S., Adaptive Filter Theory. 2002, Prentice Hall.
31. Hermann, M., Hertz, J.A., Prügel-Bennett, A., Analysis of synfire chains. Network 6 (1995), 403–414.
32. Hertz, J., Prügel-Bennett, A., Learning short synfire chains by self-organization. Network 7 (1996), 357–363.
33. Hopfield, J.J., Understanding emergent dynamics: Using a collective activity coordinate of a neural network to recognize time-varying patterns. Neural Comput. 27 (2015), 2011–2038.
34. Hopfield, J.J., Tank, D.W., “Neural” computation of decisions in optimization problems. Biol. Cybern. 52 (1985), 141–152.
35. Ikegaya, Y., Aaron, G., Cossart, R., Aronov, D., Lampl, I., Ferster, D., Yuste, R., Synfire chains and cortical songs: temporal modules of cortical activity. Science 304 (2004), 559–564.
36. Jaeger, H., Adaptive nonlinear system identification with echo state networks. Becker, S., Thrun, S., Obermayer, K., (eds.) Advances in Neural Information Processing Systems 15 (NIPS 2002), 2003, MIT Press, 593–600.
37. Jaeger, H., Haas, H., Harnessing nonlinearity: predicting chaotic systems and saving energy in wireless communication. Science 304 (2004), 78–80.
38. Jin, D.Z., Fujii, N., Graybiel, A.M., Neural representation of time in cortico-basal ganglia circuits. Proc. Natl. Acad. Sci. USA 106 (2009), 19156–19161.
39. Kleinfeld, D., Sompolinsky, H., Associative network models for central pattern generators. Koch, C., Segev, I., (eds.) Methods in Neuronal Modeling, 1989, MIT Press, 195–246.
40. Kozhevnikov, A.A., Fee, M.S., Singing-related activity of identified HVC neurons in the zebra finch. J. Neurophysiol. 97 (2007), 4271–4283.
41. Laje, R., Buonomano, D.V., Robust timing and motor patterns by taming chaos in recurrent neural networks. Nat. Neurosci. 16 (2013), 925–933.
42. Levy, N., Horn, D., Meilijson, I., Ruppin, E., Distributed synchrony in a cell assembly of spiking neurons. Neural Netw. 14 (2001), 815–824.
43. Louie, K., Wilson, M.A., Temporally structured replay of awake hippocampal ensemble activity during rapid eye movement sleep. Neuron 29 (2001), 145–156.
44. Luczak, A., Barthó, P., Marguet, S.L., Buzsáki, G., Harris, K.D., Sequential structure of neocortical spontaneous activity in vivo. Proc. Natl. Acad. Sci. USA 104 (2007), 347–352.
45. Maass, W., Natschläger, T., Markram, H., Real-time computing without stable states: a new framework for neural computation based on perturbations. Neural Comput. 14 (2002), 2531–2560.
46. Maass, W., Joshi, P., Sontag, E.D., Computational aspects of feedback in neural circuits. PLoS Comput. Biol., 3, 2007, e165.
47. Mauk, M.D., Buonomano, D.V., The neural basis of temporal processing. Annu. Rev. Neurosci. 27 (2004), 307–340.
48. McNaughton, B.L., Mizumori, S.J., Barnes, C.A., Leonard, B.J., Marquis, M., Green, E.J., Cortical representation of motion during unrestrained spatial navigation in the rat. Cereb. Cortex 4 (1994), 27–39.
49. Molgedey, L., Schuchhardt, J., Schuster, H.G., Suppressing chaos in neural networks by noise. Phys. Rev. Lett. 69 (1992), 3717–3719.
50. Nádasdy, Z., Hirase, H., Czurkó, A., Csicsvari, J., Buzsáki, G., Replay and time compression of recurring spike sequences in the hippocampus. J. Neurosci. 19 (1999), 9497–9507.
51. Nitz, D.A., Tracking route progression in the posterior parietal cortex. Neuron 49 (2006), 747–756.
52. Pastalkova, E., Itskov, V., Amarasingham, A., Buzsáki, G., Internally generated cell assembly sequences in the rat hippocampus. Science 321 (2008), 1322–1327.
53. Pearlmutter, B.A., Learning state space trajectories in recurrent neural networks. Neural Comput. 1 (1989), 263–269.
54. Pnevmatikakis, E.A., Soudry, D., Gao, Y., Machado, T.A., Merel, J., Pfau, D., Reardon, T., Mu, Y., Lacefield, C., Yang, W., et al. Simultaneous denoising, deconvolution, and demixing of calcium imaging data. Neuron 89 (2016), 285–299.
55. Pulvermüller, F., Shtyrov, Y., Spatiotemporal signatures of large-scale synfire chains for speech processing as revealed by MEG. Cereb. Cortex 19 (2009), 79–88.
56. Rajan, K., Abbott, L.F., Sompolinsky, H., Stimulus-dependent suppression of chaos in recurrent neural networks. Phys. Rev. E Stat. Nonlin. Soft Matter Phys., 82, 2010, 011903.
57. Rajan, K., Abbott, L.F., Sompolinsky, H., Inferring stimulus selectivity from the spatial structure of neural network dynamics. Lafferty, J.D., Williams, C.K.I., Shawe-Taylor, J., Zemel, R.S., Culotta, A., (eds.) Advances in Neural Information Processing Systems 23 (NIPS 2010), 2011, Neural Information Processing Systems Foundation.
58. Schwartz, A.B., Moran, D.W., Motor cortical activity during drawing movements: population representation during lemniscate tracing. J. Neurophysiol. 82 (1999), 2705–2718.
59. Seidemann, E., Meilijson, I., Abeles, M., Bergman, H., Vaadia, E., Simultaneously recorded single units in the frontal cortex go through sequences of discrete and stable states in monkeys performing a delayed localization task. J. Neurosci. 16 (1996), 752–768.
60. Shadlen, M.N., Newsome, W.T., Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey. J. Neurophysiol. 86 (2001), 1916–1936.
61. Snyder, L.H., Batista, A.P., Andersen, R.A., Coding of intention in the posterior parietal cortex. Nature 386 (1997), 167–170.
62. Sompolinsky, H., Crisanti, A., Sommers, H.J., Chaos in random neural networks. Phys. Rev. Lett. 61 (1988), 259–262.
63. Song, S., Sjöström, P.J., Reigl, M., Nelson, S., Chklovskii, D.B., Highly nonrandom features of synaptic connectivity in local cortical circuits. PLoS Biol., 3, 2005, e68.
64. Sussillo, D., Neural circuits as computational dynamical systems. Curr. Opin. Neurobiol. 25 (2014), 156–163.
65. Sussillo, D., Abbott, L.F., Generating coherent patterns of activity from chaotic neural networks. Neuron 63 (2009), 544–557.
66. Tang, A., Jackson, D., Hobbs, J., Chen, W., Smith, J.L., Patel, H., Prieto, A., Petrusca, D., Grivich, M.I., Sher, A., et al. A maximum entropy model applied to spatial and temporal correlations from cortical networks in vitro. J. Neurosci. 28 (2008), 505–518.
67. Vogelstein, J.T., Packer, A.M., Machado, T.A., Sippy, T., Babadi, B., Yuste, R., Paninski, L., Fast nonnegative deconvolution for spike train inference from population calcium imaging. J. Neurophysiol. 104 (2010), 3691–3704.
68. White, B., Abbott, L.F., Fiser, J., Suppression of cortical neural variability is stimulus- and state-dependent. J. Neurophysiol. 108 (2012), 2383–2392.
69. Whitlock, J.R., Sutherland, R.J., Witter, M.P., Moser, M.B., Moser, E.I., Navigating from hippocampus to parietal cortex. Proc. Natl. Acad. Sci. USA 105 (2008), 14755–14762.
70. Williams, R.J., Zipser, D., A learning algorithm for continuously running fully recurrent neural networks. Neural Comput. 1 (1989), 270–280.
71. Zhang, K., Representation of spatial orientation by the intrinsic dynamics of the head-direction cell ensemble: a theory. J. Neurosci. 16 (1996), 2112–2126.