Co-emergence of multi-scale cortical activities of irregular firing, oscillations and avalanches achieves cost-efficient information capacity

PLoS Computational Biology

Volumn 13, Issue 2, 2017, Pages

  Yang, Dong Ping ^a,b,c   Zhou, Hai Jun ^d   Zhou, Changsong ^a,b,e  

^a HONG KONG BAPTIST UNIVERSITY   (Hong Kong)

^b Beijing Hong Kong Singapore Joint Center for Nonlinear and Complex Systems (Singapore)   (Singapore)

^c UNIVERSITY OF SYDNEY   (Australia)

^d INSTITUTE OF THEORETICAL PHYSICS   (China)

^e BEIJING COMPUTATIONAL SCIENCE RESEARCH CENTER   (China)

Author keywords

[No Author keywords available]

Indexed keywords

BRAIN; COST EFFECTIVENESS; NEURONS;

CORTICAL ACTIVITY; COST-EFFICIENCY; COST-EFFICIENT; DESIGN PRINCIPLES; ENERGY; MULTI-SCALES; NEURONAL AVALANCHES; PROPERTY; SCALE PROPERTIES; SELECTIVE PRESSURE;

ENERGY EFFICIENCY;

AVALANCHE; BRAIN CORTEX; CONDUCTANCE; ENERGY COST; EXCITATION; INFORMATION PROCESSING; MODEL; OSCILLATION; SPIKE; SYNAPSE; ACTION POTENTIAL; ANIMAL; BIOLOGICAL MODEL; BIOLOGICAL RHYTHM; BRAIN; COGNITION; COMPUTER SIMULATION; ENERGY METABOLISM; HUMAN; INFORMATION RETRIEVAL; NERVE CELL NETWORK; PHYSIOLOGY; PROCEDURES; STATISTICAL MODEL;

ACTION POTENTIALS; ANIMALS; BIOLOGICAL CLOCKS; BRAIN; COGNITION; COMPUTER SIMULATION; ENERGY METABOLISM; HUMANS; INFORMATION STORAGE AND RETRIEVAL; MODELS, NEUROLOGICAL; MODELS, STATISTICAL; NERVE NET;

EID: 85014168606     PISSN: 1553734X     EISSN: 15537358     Source Type: Journal    
DOI: 10.1371/journal.pcbi.1005384     Document Type: Article

References (85)

1. Softky WR, Koch C, The highly irregular firing of cortical cells is inconsistent with temporal integration of random EPSPs. J Neurosci. 1993;13(1):334–350. 8423479
2. van Vreeswijk C, Sompolinsky H, Chaos in neuronal networks with balanced excitatory and inhibitory activity. Science. 1996;274(5293):1724–1726. doi: 10.1126/science.274.5293.17248939866
3. Shadlen MN, Newsome WT, The variable discharge of cortical neurons: implications for connectivity, computation, and information coding. J Neurosci. 1998;18(10):3870–3896. 9570816
4. Buzsaki G, Rhythms of the Brain. Oxford University Press; 2006.
5. Fries P, Neuronal gamma-band synchronization as a fundamental process in cortical computation. Annu Rev Neurosci. 2009;32:209–224. doi: 10.1146/annurev.neuro.051508.13560319400723
6. Wang XJ, Neurophysiological and computational principles of cortical rhythms in cognition. Physiol Rev. 2010;90(3):1195–1268. doi: 10.1152/physrev.00035.200820664082
7. Beggs JM, Plenz D, Neuronal avalanches in neocortical circuits. J Neurosci. 2003;23(35):11167–11177. 14657176
8. Gireesh ED, Plenz D, Neuronal avalanches organize as nested theta-and beta/gamma-oscillations during development of cortical layer 2/3. Proc Natl Acad Sci USA. 2008;105(21):7576–7581. doi: 10.1073/pnas.080053710518499802
9. Petermann T, Thiagarajan TC, Lebedev MA, Nicolelis MA, Chialvo DR, Plenz D, Spontaneous cortical activity in awake monkeys composed of neuronal avalanches. Proc Natl Acad Sci USA. 2009;106(37):15921–15926. doi: 10.1073/pnas.090408910619717463
10. Bellay T, Klaus A, Seshadri S, Plenz D, Irregular spiking of pyramidal neurons organizes as scale-invariant neuronal avalanches in the awake state. Elife. 2015;4:e07224. doi: 10.7554/eLife.0722426151674
11. Chialvo DR, Emergent complex neural dynamics. Nat Phys. 2010;6(10):744–750. doi: 10.1038/nphys1803
12. Poil SS, Hardstone R, Mansvelder HD, Linkenkaer-Hansen K, Critical-state dynamics of avalanches and oscillations jointly emerge from balanced excitation/inhibition in neuronal networks. J Neurosci. 2012;32(29):9817–9823. doi: 10.1523/JNEUROSCI.5990-11.201222815496
13. Levina A, Herrmann JM, Geisel T, Dynamical synapses causing self-organized criticality in neural networks. Nat Phys. 2007;3(12):857–860. doi: 10.1038/nphys758
14. Millman D, Mihalas S, Kirkwood A, Niebur E, Self-organized criticality occurs in non-conservative neuronal networks during’up’ states. Nat Phys. 2010;6(10):801–805. doi: 10.1038/nphys175721804861
15. Shew WL, Clawson WP, Pobst J, Karimipanah Y, Wright NC, Wessel R, Adaptation to sensory input tunes visual cortex to criticality. Nat Phys. 2015;11(8):659–663. doi: 10.1038/nphys3370
16. Steriade M, Neuronal substrates of sleep and epilepsy. Cambridge University Press; 2003.
17. Bolam JP, Ingham CA, Magill PJ, The basal ganglia VIII. Springer Science & Business Media; 2006.
18. Uhlhaas PJ, Singer W, Abnormal neural oscillations and synchrony in schizophrenia. Nat Rev Neurosci. 2010;11(2):100–113. doi: 10.1038/nrn277420087360
19. Yizhar O, Fenno LE, Prigge M, Schneider F, Davidson TJ, O’Shea DJ, et al. Neocortical excitation/inhibition balance in information processing and social dysfunction. Nature. 2011;477(7363):171–178. doi: 10.1038/nature1036021796121
20. Kinouchi O, Copelli M, Optimal dynamical range of excitable networks at criticality. Nat Phys. 2006;2(5):348–351. doi: 10.1038/nphys289
21. Shew WL, Yang H, Petermann T, Roy R, Plenz D, Neuronal avalanches imply maximum dynamic range in cortical networks at criticality. J Neurosci. 2009;29(49):15595–15600. doi: 10.1523/JNEUROSCI.3864-09.200920007483
22. Shew WL, Yang H, Yu S, Roy R, Plenz D, Information capacity and transmission are maximized in balanced cortical networks with neuronal avalanches. J Neurosci. 2011;31(1):55–63. doi: 10.1523/JNEUROSCI.4637-10.201121209189
23. Yang H, Shew WL, Roy R, Plenz D, Maximal variability of phase synchrony in cortical networks with neuronal avalanches. J Neurosci. 2012;32(3):1061–1072. doi: 10.1523/JNEUROSCI.2771-11.201222262904
24. Shriki O, Yellin D, Optimal Information Representation and Criticality in an Adaptive Sensory Recurrent Neuronal Network. PLoS Comput Biol. 2016;12(2):1–19. doi: 10.1371/journal.pcbi.1004698
25. Merolla PA, Arthur JV, Alvarez-Icaza R, Cassidy AS, Sawada J, Akopyan F, et al. A million spiking-neuron integrated circuit with a scalable communication network and interface. Science. 2014;345(6197):668–673. doi: 10.1126/science.125464225104385
26. Laughlin SB, Sejnowski TJ, Communication in neuronal networks. Science. 2003;301(5641):1870–1874. doi: 10.1126/science.108966214512617
27. Zhang K, Sejnowski TJ, A universal scaling law between gray matter and white matter of cerebral cortex. Proc Natl Acad Sci USA. 2000;97(10):5621–5626. doi: 10.1073/pnas.09050419710792049
28. Cherniak C, Mokhtarzada Z, Rodriguez-Esteban R, Changizi K, Global optimization of cerebral cortex layout. Proc Natl Acad Sci USA. 2004;101(4):1081–1086. doi: 10.1073/pnas.030521210114722353
29. Chen BL, Hall DH, Chklovskii DB, Wiring optimization can relate neuronal structure and function. Proc Natl Acad Sci USA. 2006;103(12):4723–4728. doi: 10.1073/pnas.050680610316537428
30. Bullmore E, Sporns O, The economy of brain network organization. Nat Rev Neurosci. 2012;13(5):336–349. 22498897
31. Chen Y, Wang S, Hilgetag CC, Zhou C, Trade-off between multiple constraints enables simultaneous formation of modules and hubs in neural systems. PLoS Comput Biol. 2013;. doi: 10.1371/journal.pcbi.1002937
32. Daffertshofer A, Huys R, Beek PJ, Dynamical coupling between locomotion and respiration. Biol Cybern. 2004;90(3):157–164. doi: 10.1007/s00422-004-0462-x15052479
33. Shannon CE, A mathematical theory of communication. SIGMOBILE Mob Comput Commun Rev. 2001;5(1):3–55. doi: 10.1145/584091.584093
34. Dayan P, Abbott LF, Theoretical neuroscience. Cambridge, MA: MIT Press; 2001.
35. Levy WB, Baxter RA, Energy efficient neural codes. Neural Comput. 1996;8(3):531–543. doi: 10.1162/neco.1996.8.3.5318868566
36. Brunel N, Wang XJ, What determines the frequency of fast network oscillations with irregular neural discharges? I. Synaptic dynamics and excitation-inhibition balance. J Neurophysiol. 2003;90(1):415–430. doi: 10.1152/jn.01095.200212611969
37. Renart A, de la Rocha J, Bartho P, Hollender L, Parga N, Reyes A, et al. The asynchronous state in cortical circuits. Science. 2010;327(5965):587–590. doi: 10.1126/science.117985020110507
38. Okun M, Lampl I, Instantaneous correlation of excitation and inhibition during ongoing and sensory-evoked activities. Nat Neurosci. 2008;11(5):535–537. doi: 10.1038/nn.210518376400
39. Wilson HR, Cowan JD, Excitatory and inhibitory interactions in localized populations of model neurons. Biophys J. 1972;12(1):1. doi: 10.1016/S0006-3495(72)86068-54332108
40. Wang SJ, Ouyang G, Guang J, Zhang M, Wong KM, Zhou C, Stochastic Oscillation in Self-Organized Critical States of Small Systems: Sensitive Resting State in Neural Systems. Phys Rev Lett. 2016;116(1):018101. doi: 10.1103/PhysRevLett.116.01810126799044
41. Shinomoto S, Shima K, Tanji J, Differences in spiking patterns among cortical neurons. Neural Comput. 2003;15(12):2823–2842. doi: 10.1162/08997660332251875914629869
42. Shinomoto S, Kim H, Shimokawa T, Matsuno N, Funahashi S, Shima K, et al. Relating neuronal firing patterns to functional differentiation of cerebral cortex. PLoS Comput Biol. 2009;5(7):e1000433. doi: 10.1371/journal.pcbi.100043319593378
43. Shelley M, McLaughlin D, Shapley R, Wielaard J, States of high conductance in a large-scale model of the visual cortex. J Comput Neurosci. 2002;13(2):93–109. doi: 10.1023/A:102015810660312215724
44. Moreno-Bote R, Parga N, Membrane potential and response properties of populations of cortical neurons in the high conductance state. Phys Rev Lett. 2005;94(8):088103. doi: 10.1103/PhysRevLett.94.08810315783940
45. Brunel N, Sergi S, Firing frequency of leaky intergrate-and-fire neurons with synaptic current dynamics. J Theor Biol. 1998;195(1):87–95. doi: 10.1006/jtbi.1998.07829802952
46. Moreno-Bote R, Parga N, Role of synaptic filtering on the firing response of simple model neurons. Phys Rev Lett. 2004;92(2):028102. doi: 10.1103/PhysRevLett.92.02810214753971
47. Jaynes ET, Information theory and statistical mechanics. Phys Rev. 1957;106(4):620. doi: 10.1103/PhysRev.106.620
48. Schneidman E, Berry MJ, Segev R, Bialek W, Weak pairwise correlations imply strongly correlated network states in a neural population. Nature. 2006;440(7087):1007–1012. doi: 10.1038/nature0470116625187
49. Bi Gq, Poo Mm, Synaptic modifications in cultured hippocampal neurons: dependence on spike timing, synaptic strength, and postsynaptic cell type. J Neurosci. 1998;18(24):10464–10472. 9852584
50. Yarowsky P, Kadekaro M, Sokoloff L, Frequency-dependent activation of glucose utilization in the superior cervical ganglion by electrical stimulation of cervical sympathetic trunk. Proc Natl Acad Sci USA. 1983;80(13):4179–4183. doi: 10.1073/pnas.80.13.41796575402
51. Yarowsky P, Crane A, Sokoloff L, Metabolic activation of specific postsynaptic elements in superior cervical ganglion by antidromic stimulation of external carotid nerve. Brain Res. 1985;334(2):330–334. doi: 10.1016/0006-8993(85)90226-43995323
52. Laughlin SB, Energy as a constraint on the coding and processing of sensory information. Curr Opin Neurol. 2001;11(4):475–480. doi: 10.1016/S0959-4388(00)00237-3
53. Fisahn A, Pike FG, Buhl EH, Paulsen O, Cholinergic induction of network oscillations at 40 Hz in the hippocampus in vitro. Nature. 1998;394(6689):186–189. doi: 10.1038/281799671302
54. Olshausen BA, Field DJ, Sparse coding of sensory inputs. Curr Opin Neurobiol. 2004;14(4):481–487. doi: 10.1016/j.conb.2004.07.00715321069
55. Ohiorhenuan IE, Mechler F, Purpura KP, Schmid AM, Hu Q, Victor JD, Sparse coding and high-order correlations in fine-scale cortical networks. Nature. 2010;466(7306):617–621. doi: 10.1038/nature0917820601940
56. Benayoun M, Cowan JD, van Drongelen W, Wallace E, Avalanches in a stochastic model of spiking neurons. PLoS Comput Biol. 2010;6(7):e1000846. doi: 10.1371/journal.pcbi.100084620628615
57. Brunel N, Hakim V, Fast global oscillations in networks of integrate-and-fire neurons with low firing rates. Neural Comput. 1999;11(7):1621–1671. doi: 10.1162/08997669930001617910490941
58. Teramae Jn, Tsubo Y, Fukai T, Optimal spike-based communication in excitable networks with strong-sparse and weak-dense links. Sci Rep. 2012;2:485 EP. doi: 10.1038/srep0048522761993
59. Brunel N, Dynamics of sparsely connected networks of excitatory and inhibitory spiking neurons. J Comput Neurosci. 2000;8(3):183–208. doi: 10.1023/A:100892530902710809012
60. Chan HK, Yang DP, Zhou C, Nowotny T, Burst Firing Enhances Neural Output Correlation. Front Comput Neurosci. 2016;10. doi: 10.3389/fncom.2016.0004227242499
61. Haldeman C, Beggs JM, Critical branching captures activity in living neural networks and maximizes the number of metastable states. Phys Rev Lett. 2005;94(5):058101. doi: 10.1103/PhysRevLett.94.05810115783702
62. Ostojic S, Two types of asynchronous activity in networks of excitatory and inhibitory spiking neurons. Nat Neurosci. 2014;17(4):594–600. doi: 10.1038/nn.365824561997
63. Hansel D, van Vreeswijk C, The mechanism of orientation selectivity in primary visual cortex without a functional map. J Neurosci. 2012;32(12):4049–4064. doi: 10.1523/JNEUROSCI.6284-11.201222442071
64. Kumar A, Rotter S, Aertsen A, Conditions for propagating synchronous spiking and asynchronous firing rates in a cortical network model. J Neurosci. 2008;28(20):5268–5280. doi: 10.1523/JNEUROSCI.2542-07.200818480283
65. Kumar A, Rotter S, Aertsen A, Spiking activity propagation in neuronal networks: reconciling different perspectives on neural coding. Nat Rev Neurosci. 2010;11(9):615–627. doi: 10.1038/nrn288620725095
66. Engel AK, Fries P, Singer W, Dynamic predictions: oscillations and synchrony in top—down processing. Nat Rev Neurosci. 2001;2(10):704–716. doi: 10.1038/3509456511584308
67. Sirota A, Montgomery S, Fujisawa S, Isomura Y, Zugaro M, Buzsáki G, Entrainment of neocortical neurons and gamma oscillations by the hippocampal theta rhythm. Neuron. 2008;60(4):683–697. doi: 10.1016/j.neuron.2008.09.01419038224
68. Womelsdorf T, Schoffelen JM, Oostenveld R, Singer W, Desimone R, Engel AK, et al. Modulation of neuronal interactions through neuronal synchronization. Science. 2007;316(5831):1609–1612. doi: 10.1126/science.113959717569862
69. Kremkow J, Aertsen A, Kumar A, Gating of signal propagation in spiking neural networks by balanced and correlated excitation and inhibition. J Neurosci. 2010;30(47):15760–15768. doi: 10.1523/JNEUROSCI.3874-10.201021106815
70. Atallah BV, Scanziani M, Instantaneous modulation of gamma oscillation frequency by balancing excitation with inhibition. Neuron. 2009;62(4):566–577. doi: 10.1016/j.neuron.2009.04.02719477157
71. Dan Y, Poo MM, Spike timing-dependent plasticity: from synapse to perception. Physiol Rev. 2006;86(3):1033–1048. doi: 10.1152/physrev.00030.200516816145
72. Lubenov EV, Siapas AG, Decoupling through synchrony in neuronal circuits with propagation delays. Neuron. 2008;58(1):118–131. doi: 10.1016/j.neuron.2008.01.03618400168
73. Wang SJ, Hilgetag CC, Zhou C, Sustained activity in hierarchical modular neural networks: self-organized criticality and oscillations. Front Comput Neurosci. 2011;5.
74. Wang SJ, Zhou C, Hierarchical modular structure enhances the robustness of self-organized criticality in neural networks. New J Phys. 2012;14(2):023005.
75. Amit DJ, Brunel N, Model of global spontaneous activity and local structured activity during delay periods in the cerebral cortex. Cerebral cortex. 1997;7(3):237–252. doi: 10.1093/cercor/7.3.2379143444
76. Amit DJ, Brunel N, Dynamics of a recurrent network of spiking neurons before and following learning. Network. 1997;8(4):373–404. doi: 10.1088/0954-898X_8_4_003
77. van Vreeswijk C, Sompolinsky H, Chaotic balanced state in a model of cortical circuits. Neural Comput. 1998;10(6):1321–1371. doi: 10.1162/0899766983000172149698348
78. Zhou FM, Hablitz JJ, AMPA receptor-mediated EPSCs in rat neocortical layer II/III interneurons have rapid kinetics. Brain Res. 1998;780(1):166–169. doi: 10.1016/S0006-8993(97)01311-59497094
79. Angulo MC, Rossier J, Audinat E, Postsynaptic glutamate receptors and integrative properties of fast-spiking interneurons in the rat neocortex. J Neurophysiol. 1999;82(3):1295–1302. 10482748
80. Xiang Z, Huguenard JR, Prince DA, GABAA receptor-mediated currents in interneurons and pyramidal cells of rat visual cortex. J Physiol. 1998;506(3):715–730. doi: 10.1111/j.1469-7793.1998.715bv.x9503333
81. Gupta A, Wang Y, Markram H, Organizing principles for a diversity of GABAergic interneurons and synapses in the neocortex. Science. 2000;287(5451):273–278. doi: 10.1126/science.287.5451.27310634775
82. Hansel D, Mato G, Meunier C, Neltner L, On numerical simulations of integrate-and-fire neural networks. Neural Comput. 1998;10(2):467–483. doi: 10.1162/0899766983000178459472491
83. Shelley MJ, Tao L, Efficient and Accurate Time-Stepping Schemes for Integrate-and-Fire Neuronal Networks. J Comput Neurosci. 2001;11(2):111–119. doi: 10.1023/A:101288531418711717528
84. Markram H, Wang Y, Tsodyks M, Differential signaling via the same axon of neocortical pyramidal neurons. Proc Natl Acad Sci USA. 1998;95(9):5323–5328. doi: 10.1073/pnas.95.9.53239560274
85. Tsodyks M, Pawelzik K, Markram H, Neural networks with dynamic synapses. Neural Comput. 1998;10(4):821–835. doi: 10.1162/0899766983000175029573407