Stochastic Computations in Cortical Microcircuit Models

PLoS Computational Biology

Volumn 9, Issue 11, 2013, Pages

  Habenschuss, Stefan ^a   Jonke, Zeno ^a   Maass, Wolfgang ^a  

^a GRAZ UNIVERSITY OF TECHNOLOGY   (Austria)

Author keywords

[No Author keywords available]

Indexed keywords

CONSTRAINT SATISFACTION PROBLEMS; NEURONS; PROBABILITY DISTRIBUTIONS; STOCHASTIC MODELS; STOCHASTIC SYSTEMS;

CORTICAL MICROCIRCUITS; DETAILED MODELS; NETWORK STATE; NON-LINEAR NEURONS; NONLINEAR SYNAPSIS; PROBABILITY: DISTRIBUTIONS; STATIONARY DISTRIBUTION; STOCHASTIC COMPUTATIONS; STOCHASTIC DYNAMICS; THEORETICAL FOUNDATIONS;

PROBLEM SOLVING;

ARTICLE; BRAIN ELECTROPHYSIOLOGY; BRAIN FUNCTION; CONCEPTUAL FRAMEWORK; HIDDEN MARKOV MODEL; IMAGINATION; LEARNING; MATHEMATICAL COMPUTING; MATHEMATICAL MODEL; NERVE CELL NETWORK; NERVE CELL PLASTICITY; OSCILLATION; PREDICTION; PROBABILITY; PROBLEM SOLVING; RECALL; SPIKE; STOCHASTIC MODEL; SYNAPSE;

COMPUTATIONAL BIOLOGY; HUMANS; MARKOV CHAINS; MODELS, NEUROLOGICAL; MODELS, STATISTICAL; NERVE NET; NEURONS; PROBLEM SOLVING; STOCHASTIC PROCESSES;

EID: 84888268117     PISSN: 1553734X     EISSN: 15537358     Source Type: Journal    
DOI: 10.1371/journal.pcbi.1003311     Document Type: Article

References (126)

1. Allen C, Stevens CF, (1994) An evaluation of causes for unreliability of synaptic transmission. PNAS 91: 10380-10383.
2. Faisal AA, Selen LPJ, Wolpert DM, (2008) Noise in the nervous system. Nature Reviews Neuroscience 9: 292-303.
3. Borst JG, (2010) The low synaptic release probability in vivo. Trends in Neurosciences 33: 259-266.
4. Yarom Y, Hounsgaard J, (2011) Voltage fluctuations in neurons: signal or noise? Physiol Rev 91: 917-929.
5. Clarke PG, (2012) The limits of brain determinacy. Proc Biol Sci 279: 1665-1674.
6. Tsodyks M, Kenet T, Grinvald A, Arieli A, (1999) Linking spontaneous activity of single cortical neurons and the underlying functional architecture. Science 286: 1943-1946.
7. Kenet T, Bibitchkov D, Tsodyks M, Grinvald A, Arieli A, (2003) Spontaneously emerging cortical representations of visual attributes. Nature 425: 954-956.
8. Luczak A, Barth P, Harris KD, (2009) Spontaneous events outline the realm of possible sensory responses in neocortical populations. Neuron 62: 413-425.
9. Raichle ME, (2010) Two views of brain function. Trends in Cognitive Sciences 14: 180-190.
10. Lewis CM, Baldassarre A, Committeri G, Romani GL, Corbetta M, (2009) Learning sculpts the spontaneous activity of the resting human brain. PNAS 106: 17558-17563.
11. Fox MD, Snyder AZ, Vincent JL, Raichle M, (2007) Intrinsic fluctuations within cortical systems account for intertrial variability in human behavior. Neuron 56: 171-184.
12. Kelemen E, Fenton AA, (2010) Dynamic grouping of hippocampal neural activity during cognitive control of two spatial frames. BLoS Biology 8: e1000403.
13. Leopold DA, Logothetis NK, (1996) Activity changes in early visual cortex reflect monkeys' percepts during binocular rivalry. Nature 379: 549-553.
14. Leopold DA, Logothetis NK, (1999) Multistable phenomena: changing views in perception. Trends in Cognitive Sciences 3: 254-264.
15. Kim CY, Blake R, (2005) Psychophysical magic: rendering the visible invisible. Trends in Cognitive Sciences 9: 381-388.
16. Karlsson M, Tervo DG, Karpova AY, (2012) Network resets in medial prefrontal cortex mark the onset of behavioral uncertainty. Science 338: 135-139.
17. Brémaud P, Massoulié L, (1996) Stability of nonlinear Hawkes processes. The Annals of Probability 24: 1563-1588.
18. Borovkov K, Decrouez G, Gilson M, (2012) On stationary distributions of stochastic neural networks. arXiv pp. 1206.4489.
19. Hoyer PO, Hyvärinen A, (2003) Interpreting neural response variability as Monte Carlo sampling of the posterior. Advances in Neural Information Processing Systems 15: 293-300.
20. Berkes P, Orban G, Lengyel M, Fiser J, (2011) Spontaneous cortical activity reveals hallmarks of an optimal internal model of the environment. Science 331: 83-87.
21. Buesing L, Bill J, Nessler B, Maass W, (2011) Neural dynamics as sampling: a model for stochastic computation in recurrent networks of spiking neurons. PLoS Computational Biology 7: e1002211.
22. Pecevski D, Buesing L, Maass W, (2011) Probabilistic inference in general graphical models through sampling in stochastic networks of spiking neurons. PLoS Computational Biology 7: e1002294.
23. Friston K, (2010) The free-energy principle: a unified brain theory? Nature Reviews Neuroscience 11: 127-138.
24. Vilares I, Kording K, (2011) Bayesian models: the structure of the world, uncertainty, behavior, and the brain. Annals of the New York Academy of Sciences 1224: 22-39.
25. Fiser J, Berkes P, Orban G, Lengyel M, (2010) Statistically optimal perception and learning: from behavior to neural representation. Trends in Cognitive Sciences 14: 119-130.
26. Doya K, Ishii S, Pouget A, Rao RPN (2007) Bayesian brain: Probabilistic approaches to neural coding. Cambridge, MA: MIT Press.
27. Huk A, Shadlen M, (2005) Neural activity in macaque parietal cortex reflects temporal integration of visual motion signals during perceptual decision making. The Journal of Neuroscience 25: 10420-10436.
28. Mountcastle VB (1998) Perceptual neuroscience: The cerebral cortex. Cambridge, MA: Harvard University Press, 362-381 pp.
29. Douglas R, Martin K, (2004) Neuronal circuits of the neocortex. Annual Reviews of Neuroscience 27: 419-451.
30. Haeusler S, Maass W, (2007) A statistical analysis of information-processing properties of lamina-specific cortical microcircuit models. Cerebral Cortex 17: 149-162.
31. Haeusler S, Schuch K, Maass W, (2009) Motif distribution, dynamical properties, and computational performance of two data-based cortical microcircuit templates. Journal of Physiology, Paris 103: 73-87.
32. Rasch MJ, Schuch K, Logothetis NK, Maass W, (2011) Statistical comparision of spike responses to natural stimuli in monkey area V1 with simulated responses of a detailed laminar network model for a patch of V1. J Neurophysiol 105: 757-778.
33. Potjans TC, Diesmann M, (2012) The cell-type specific cortical microcircuit: relating structure and activity in a full-scale spiking network model. Cerebral Cortex doi:10.1093/cerror/bhs358.
34. Bastos AM, Usrey WM, Adams RA, Mangun GR, Fries P, et al. (2012) Canonical microcircuits for predictive coding. Neuron 76: 695-711.
35. Dragoi G, Buzsaki G, (2006) Temporal encoding of place sequences by hippocampal cell assemblies. Neuron 50: 145-157.
36. Gupta A, der Meer MAA, Touretzky DS, Redish AD, (2012) Segmentation of spatial experience by hippocampal theta sequences. Nature Neuroscience 15: 1032-1039.
37. Jezek K, Henriksen E, Treves A, Moser E, Moser M, (2011) Theta-paced flickering between place-cell maps in the hippocampus. Nature 478: 246-249.
38. Hinton GE, Sejnowski TJ, Ackley DH (1984) Boltzmann machines: constraint satisfaction networks that learn. Technical Report CMS-CS-84-119, CMU Computer Science Department.
39. Davenport A, Tsang E, Wang CJ, Zhu K (1994) GENET: a connectionist architecture for solving constraint satisfaction problems by iterative improvement. In: Proceedings of the National Conference on Artificial Intelligence. John Wiley & Sons Ltd, pp. 325-325.
40. Abeles M, Bergman H, Gat I, Meilijson I, Seidemann E, et al. (1995) Cortical activity flips among quasi-stationary states. PNAS 92: 8616-8620.
41. Luczak A, Barth P, Marguet SL, Buzski G, Harris KD, (2007) Sequential structure of neocortical spontaneous activity in vivo. PNAS 104: 347-352.
42. Buzsáki G, (2010) Neural syntax: cell assemblies, synapsembles, and readers. Neuron 68: 362-385.
43. Luczak A, MacLean JN, (2012) Default activity patterns at the neocortical microcircuit level. Frontiers in Integrative Neuroscience 6doi: 10.3389/fnint.2012.00030.
44. Koller D, Friedman N (2009) Probabilistic graphical models: Principles and techniques. Cambridge, MA: MIT Press.
45. Thomson AM, West DC, Wang Y, Bannister AP, (2002) Synaptic connections and small circuits involving excitatory and inhibitory neurons in layers 2-5 of adult rat and cat neocortex: triple intracellular recordings and biocytin labelling in vitro. Cerebral Cortex 12: 936-953.
46. Gupta A, Wang Y, Markram H, (2000) Organizing principles for a diversity of gabaergic interneurons and synapses in the neocortex. Science 287: 273-278.
47. Markram M, Wang Y, Tsodyks M, (1998) Differential signaling via the same axon of neocortical pyramidal neurons. PNAS 95: 5323-5328.
48. Jolivet R, Rauch A, Lüscher H, Gerstner W, (2006) Predicting spike timing of neocortical pyramidal neurons by simple threshold models. Journal of Computational Neuroscience 21: 35-49.
49. Mazor O, Laurent G, (2005) Transient dynamics versus fixed points in odor representations by locust antennal lobe projection neurons. Neuron 48: 661-673.
50. Harvey CD, Coen P, Tank DW, (2012) Choice-specific sequencis in parietal cortex during a virtual-navigation decision task. Nature 484: 62-68.
51. Wainwright MJ, Jordan MI, (2008) Graphical models, exponential families, and variational inference. Foundations and Trends in Machine Learning 1: 1-305.
52. Zhang Y, Meyers EM, Bichot NP, Serre T, Poggio TA, et al. (2011) Object decoding with attention in inferior temporal cortex. Proceedings of the National Academy of Sciences 108: 8850-8855.
53. Shadlen MN, Newsome WT, (2001) Neural basis of a perceptual decision in the parietal cortex (area lip) of the rhesus monkey. Journal of Neurophysiology 86: 1916-1936.
54. Arieli A, Sterkin A, Grinvald A, Aertsen A, (1996) Dynamics of ongoing activity: explanation of the large variability in evoked cortical responses. Science 273: 1868-1871.
55. Gelman A, Rubin DB, (1992) Inference from iterative simulation using multiple sequences. Statistical Science 7: 457-472.
56. Cowles MK, Carlin BP, (1996) Markov chain Monte Carlo convergence diagnostics: A comparative review. Journal of the American Statistical Association 91: 883-904.
57. Brooks S, Gelman A, Jones G, Meng XL (2010) Handbook of Markov Chain Monte Carlo: Methods and Applications. Chapman & Hall, 163-174 pp.
58. Gjoka M, Kurant M, Butts CT, Markopoulou A (2010) Walking in facebook: A case study of unbiased sampling of osns. In: INFOCOM, 2010 Proceedings IEEE. IEEE, pp. 1-9.
59. Kass RE, Carlin BP, Gelman A, Neal RM, (1998) Markov Chain Conte Carlo in practice: A roundtable discussion. The American Statistician 52: 93-100.
60. Gelman A, Carlin JB, Stern HS, Rubin DB (2004) Bayesian Data Analysis, Second Edition (Chapman & Hall/CRC Texts in Statistical Science). Chapman and Hall/CRC, 2 edition, 294-297 pp.
61. Engel AK, Fries P, Singer W, (2001) Dynamic predictions: oscillations and synchrony in top-down processing. Nat Rev Neurosci 2: 704-16.
62. Buzsaki G (2009) Rhythms of the brain. Oxford: Oxford University Press.
63. Wang XJ, (2010) Neurophysiological and computational principles of cortical rhythms in cognition. Physiological Reviews 90: 1195-1268.
64. Siegel M, Warden MR, Miller EK, (2009) Phase-dependent neuronal coding of objects in short-term memory. PNAS 106: 21341-21346.
65. Pipa G, Staedtler ES, Rodriguez EF, Waltz JA, Muckli L, et al. (2009) Performance- and stimulus-dependent oscillations in monkey prefrontal cortex during short-term memory. Frontiers in Integrative Neuroscience 3.
66. Turesson HK, Logothetis NK, Hoffman KL, (2012) Category-selective phase coding in the superior temporal sulcus. PNAS 109: 19438-19443.
67. Blake R, Logothetis NK, (2002) Visual competition. Nature Reviews Neuroscience 3: 13-21.
68. Sterzer P, Kleinschmidt A, Rees G, (2009) The neural bases of multistable perception. Trends in cognitive sciences 13: 310-318.
69. Gershman S, Vul E, Tenenbaum J, (2012) Multistability and perceptual inference. Neural Computation 24: 1-24.
70. Siapas AG, Lubenov EV, Wilson MA, (2005) Prefrontal phase locking to hippocampal theta oscillations. Neuron 46: 141-151.
71. Haider B, Husser M, Carandini M, (2013) Inhibition dominates sensory responses in the awake cortex. Nature 493: 97-100.
72. Kumar V, (1992) Algorithms for constraint-satisfaction problems: A survey. AI magazine 13: 32.
73. Craenen B, Eiben A, van Hemert JI, (2003) Comparing evolutionary algorithms on binary constraint satisfaction problems. Evolutionary Computation, IEEE Transactions on 7: 424-444.
74. Durstewitz D, (2006) A few important points about dopamine's role in neural network dynamics. Pharmacopsychiatry 39: 572-575.
75. Durstewitz D, (2009) Implications of synaptic biophysics for recurrent network dynamics and active memory. Neural Networks 22: 1189-1200.
76. Arnsten AFT, Wang MJ, Paspalas CD, (2012) Neuromodulation of thought: flexibilities and vulnerabilities in prefrontal cortical network synapses. Neuron 76: 223-239.
77. Maass W, Natschlaeger T, Markram H, (2002) Real-time computing without stable states: a new framework for neural computation based on perturbations. Neural Computation 14: 2531-2560.
78. Nikolic D, Haeusler S, Singer W, Maass W, (2009) Distributed fading memory for stimulus properties in the primary visual cortex. PLoS Biology 7: 1-19.
79. Klampfl S, David SV, Yin P, Shamma SA, Maass W, (2012) A quantitative analysis of information about past and present stimuli encoded by spikes of A1 neurons. Journal of Neurophysiology 108: 1366-1380.
80. Vul E, Goodman ND, Griffiths TL, Tenenbaum JB (2009) One and done? optimal decisions from very few samples. In: Proceedings of the 31st Annual Conference of the Cognitive Science Society. volume 1, pp. 66-72.
81. Lieder F, Griffiths T, Goodman N (2013) Burn-in, bias, and the rationality of anchoring. In: Proc. of NIPS 2012. MIT Press, volume 25, pp. 2690-2698.
82. Hopfield JJ, (1982) Neural networks and physical systems with emergent collective computational abilities. PNAS 79: 2554-2558.
83. Hopfield J, Tank D, (1986) Computing with neural circuits: a model. Science 233: 625-633.
84. Rolls ET, Deco G (2010) The noisy brain: Stochastic dynamics as a principle of brain function. Oxford: Oxford University Press, 73-77 pp.
85. Durstewitz D, Deco G, (2008) Computational significance of transient dynamics in cortical networks. European Journal of Neuroscience 27: 217-227.
86. Rabinovich M, Huerta R, Laurent G, (2008) Transient dynamics for neural processing. Science 321: 48-50.
87. Sporns O, (2011) The human connectome: a complex network. Annals of the New York Academy of Sciences 1224: 109-125.
88. Garey M, Johnson D (1979) Computers and Intractability: A Guide to the Theory of NPCompleteness. Mathematical Sciences. New York, NY: Freeman.
89. Qin Y, Xiang J, Wang R, Zhou H, Li K, et al. (2012) Neural bases for basic processes in heuristic problem solving: take solving sudoku puzzles as an example. PsyCh Journal 1: 101-117.
90. Boykov Y, Veksler O, Zabih R, (2001) Fast approximate energy minimization via graph cuts. IEEE Transactions on Pattern Analysis and Machine Intelligence 23: 1222-1239.
91. Griffiths TL, Tenenbaum JB, (2006) Optimal predictions in everyday cognition. Psychological Science 17: 767-773.
92. Vul E, Pashler H, (2008) Measuring the crowd within: probabilistic representations within individuals. Psychological Science 19: 645-647.
93. Denison S, Bonawitz E, Gopnik A, Griffiths TL (2009) Preschoolers sample from probability distributions. In: Proceedings of the 32nd Annual Conference of the Cognitive Science Society. volume 29, pp. 1-10.
94. Tenenbaum J, Kemp C, Griffiths T, Goodman N, (2011) How to grow a mind: statistics, structure, and abstraction. Science 331: 1279-1285.
95. Churchland MM, Abbott L, (2012) Two layers of neural variability. Nature neuroscience 15: 1472-1474.
96. Litwin-Kumar A, Doiron B, (2012) Slow dynamics and high variability in balanced cortical networks with clustered connections. Nature neuroscience 15: 1498-1505.
97. Okun M, Yger P, Marguet SL, Gerard-Mercier F, Benucci A, et al. (2012) Population rate dynamics and multineuron firing patterns in sensory cortex. Journal of Neuroscience 32: 17108-17119.
98. Zhang QF, Wen Y, Zhang D, She L, Wu JY, et al. (2012) Priming with real motion biases visual cortical response to bistable apparent motion. PNAS 109: 20691-20696.
99. Xu S, Jiang W, Poo M, Dan Y, (2012) Activity recall in a visual cortical ensemble. Nature Neuroscience 15: 449-456.
100. Harris K, Csicsvari J, Hirase H, Dragoi G, Buzsáki G, (2003) Organization of cell assemblies in the hippocampus. Nature 424: 552-556.
101. Jones LM, Fontanini A, Sadacca BF, Miller P, Katz DB, (2007) Natural stimuli evoke dynamic sequences of states in sensory cortical ensembles. PNAS 104: 18772-18777.
102. Lisman JE, Raghavachari S, Tsien RW, (2007) The sequence of events that underlie quantal transmission at central glutamatergic synapses. Nature Reviews Neuroscience 8: 597-609.
103. Branco T, Staras K, (2009) The probability of neurotransmitter release: variability and feedback control at single synapes. Nature Reviews Neuroscience 10: 373-383.
104. Doeblin W, (1937) Sur le propriétés asymtotiques de mouvement régis par certain types de chaînes simples. Bull Math Soc Roumaine Sci 39 (1) (): 115-61 (2) -.
105. Maass W, Sontag E, (1999) Analog neural nets with Gaussian or other common noise distributions cannot recognize arbitrary regular languages. Neural Computation 11: 771-782.
106. Borovkov AA (1998) Ergodicity and stability of stochastic processes. Hoboken, NJ:Wiley, 225-230 pp.
107. Down D, Meyn S, Tweedie R, (1995) Exponential and uniform ergodicity of Markov processes. The Annals of Probability 23: 1671-1691.
108. Meyn SP, Tweedie RL, (1993) Stability of markovian processes ii: Continuous-time processes and sampled chains. Advances in Applied Probability pp. 487-517.
109. Massoulié L, (1998) Stability results for a general class of interacting point processes dynamics, and applications. Stochastic processes and their applications 75: 1-30.
110. Gray RM (2009) Probability, random processes, and ergodic properties. New York: Springer. 42.
111. Pecevski D, Natschlaeger T, Schuch K, (2009) PCSIM: a parallel simulation environment for neural circuits fully integrated with python. Frontiers in Neuroinformatics 3: 11.
112. van Rossum G, Drake FL (2001). Python reference manual. Pythonlabs, Virginia, USA, 2001. Available at http://www.python.org.
113. Gerstner W, Kistler WM (2002) Spiking Neuron Models. Cambridge: Cambridge University Press.
114. Larkum ME, (2013) The yin and yang of cortical layer 1. Nature Neuroscience 16: 114-115.
115. Jiang X, Wang G, Lee AJ, Stornetta RL, Zhu JJ, (2013) The organization of two new cortical interneuronal circuits. Nature Neuroscience 16: 210-218.
116. Larkum M, (2012) A cellular mechanism for cortical associations: an organizing principle for the cerebral cortex. Trends in Neurosciences 951: 1-11.
117. Maass W, Markram H, (2002) Synapses as dynamic memory buffers. Neural Networks 15: 155-161.
118. Destexhe A, Rudolph M, Fellous JM, Sejnowski TJ, (2001) Fluctuating synaptic conductances recreate in vivo-like activity in neocortical neurons. Neuroscience 107: 13-24.
119. Brooks SP, Roberts GO, (1998) Assessing convergence of Markov chain Monte Carlo algorithms. Statistics and Computing 8: 319-335.
120. El Adlouni S, Favre AC, Bobée B, (2006) Comparison of methodologies to assess the convergence of Markov chain Monte Carlo methods. Computational Statistics & Data Analysis 50: 2685-2701.
121. Raftery AE, Lewis S, et al. (1992) How many iterations in the Gibbs sampler. Bayesian Statistics 4: 763-773.
122. Geweke J (1991) Evaluating the accuracy of sampling-based approaches to the calculation of posterior moments. Staff Report 148, Federal Reserve Bank of Minneapolis.
123. Brooks SP, Gelman A, (1998) General methods for monitoring convergence of iterative simulations. Journal of Computational and Graphical Statistics 7: 434-455.
124. Ercsey-Ravasz M, Toroczkai Z (2012) The chaos within Sudoku. Scientific Reports 2.
125. Pecevski D. NEVESIM - an event based simulator for networks of spiking neurons. http://sim.igi.tugraz.at/.
126. Aire Technologies. Sudoku solutions. http://www.sudoku-solutions.com. Accessed February 27, 2013.