Critical branching neural networks

Psychological Review

Volumn 120, Issue 1, 2013, Pages 230-254

  Kello, Christopher T ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

1 F Noise; Criticality; Fractal spike train; Neuronal avalanche; Power Law

Indexed keywords

ARTICLE; ARTIFICIAL NEURAL NETWORK; BEHAVIOR; BRAIN; COGNITION; HUMAN; PHYSIOLOGY;

BEHAVIOR; BRAIN; COGNITION; HUMANS; NEURAL NETWORKS (COMPUTER);

EID: 84877992658     PISSN: 0033295X     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0030970     Document Type: Article

References (162)

1. Abraham, W. C. (2008). Metaplasticity: Tuning synapses and networks for plasticity. Nature Reviews Neuroscience, 9, 387. doi:10.1038/nrn2356
2. Ackley, D. H., Hinton, G. E., & Sejnowski, T. J. (1985). A learning algorithm for Boltzmann machines. Cognitive Science, 9, 147-169. doi:10.1207/s15516709cog0901_7
3. Aisa, B., Mingus, B., & O'Reilly, R. (2008). The Emergent neural modeling system. Neural Networks, 21, 1146-1152. doi:10.1016/j.neunet.2008.06.016
4. Anderson, C. M. (2000). From molecules to mindfulness: How vertically convergent fractal time fluctuations unify cognition and emotion. Consciousness & Emotion, 1, 193-226.
5. Antonelo, E. A., Schrauwen, B., & Stroobandt, D. (2008). Event detection and localization for small mobile robots using reservoir computing. Neural Networks, 21, 862-871. doi:10.1016/j.neunet.2008.06.010
6. Arieli, A., Sterkin, A., Grinvald, A., & Aertsen, A. (1996, September 27). Dynamics of ongoing activity: Explanation of the large variability in evoked cortical responses. Science, 273, 1868-1871. doi:10.1126/science.273.5283.1868
7. Baddeley, R., Abbott, L. F., Booth, M. C. A., Sengpiel, F., Freeman, T., Wakeman, E. A., & Rolls, E. T. (1997). Responses of neurons in primary and inferior temporal visual cortices to natural scenes. Proceedings of the Royal Society B: Biological Sciences, 264, 1775-1783. doi:10.1098/rspb.1997.0246
8. Bak, P., & Paczuski, M. (1995). Complexity, contingency, and criticality. Proceedings of the National Academy of Sciences, USA, 92, 6689-6696. doi:10.1073/pnas.92.15.6689
9. Bak, P., Tang, C., & Wiesenfeld, K. (1987). Self-organized criticality: An explanation of 1/f noise. Physical Review Letters, 59, 381-384. doi: 10.1103/PhysRevLett.59.381
10. Baptista, M. S., Grebogi, C., & Köberle, R. (2006). Dynamically multilayered visual system of the multifractal fly. Physical Review Letters, 97(17), 178102. doi:10.1103/PhysRevLett.97.178102
11. Bédard, C., & Destexhe, A. (2009). Macroscopic models of local field potentials and the apparent 1/f noise in brain activity. Biophysical Journal, 96, 2589-2603. doi:10.1016/j.bpj.2008.12.3951
12. Beggs, J. M. (2008). The criticality hypothesis: How local cortical networks might optimize information processing. Philosophical Transactions of the Royal Society A: Mathematical, Physical & Engineering Sciences, 366, 329-343. doi:10.1098/rsta.2007.2092
13. Beggs, J. M., & Plenz, D. (2003). Neuronal avalanches in neocortical circuits. The Journal of Neuroscience, 23, 11167-11177.
14. Beltz, B. C., & Kello, C. T. (2006). On the intrinsic fluctuations of human behavior. In M. Vanchevsky (Ed.), Focus on cognitive psychology research (pp. 25-41). Hauppauge, NY: Nova Science.
15. Benayoun, M., Cowan, J. D., van Drongelen, W., & Wallace, E. (2010). Avalanches in a stochastic model of spiking neurons. PLoS Computational Biology, 6(7), e1000846. doi:10.1371/journal.pcbi.1000846
16. Bershadskii, A., Dremencov, E., Fukayama, D., & Yadid, G. (2001). Multifractal statistics and underlying kinetics of neuron spiking timeseries. Physics Letters A, 289, 337-342. doi:10.1016/S0375-9601(01)00624-7
17. Bertschinger, N., & Natschlager, T. (2004). Real-time computation at the edge of chaos in recurrent neural networks. Neural Computation, 16, 1413-1436. doi:10.1162/089976604323057443
18. Bhattacharya, J., Edwards, J., Mamelak, A. N., & Schuman, E. M. (2005). Long-range temporal correlations in the spontaneous spiking of neurons in the hippocampal-amygdala complex of humans. Neuroscience, 131, 547-555. doi:10.1016/j.neuroscience.2004.11.013
19. Bressler, S. L., & Kelso, J. A. S. (2001). Cortical coordination dynamics and cognition. Trends in Cognitive Sciences, 5, 26-36. doi:10.1016/S1364-6613(00)01564-3
20. Brooks, V. B. (1986). The neural basis of motor control. New York, NY: Oxford University Press.
21. Brunel, N. (2000). Dynamics of sparsely connected networks of excitatory and inhibitory spiking neurons. Journal of Computational Neuroscience, 8, 183-208. doi:10.1023/A:1008925309027
22. Buesing, L., Bill, J., Nessler, B., & Maass, W. (2011). Neural dynamics as sampling: A model for stochastic computation in recurrent networks of spiking neurons. PLoS Computational Biology, 7(11), e1002211. doi: 10.1371/journal.pcbi.1002211
23. Burgsteiner, H., Kröll, M., Leopold, A., & Steinbauer, G. (2007). Movement prediction from real-world images using a liquid state machine. Applied Intelligence, 26, 99-109. doi:10.1007/s10489-006-0007-1
24. Cao, J., & Wang, L. (2000). Periodic oscillatory solution of bidirectional associative memory networks with delays. Physical Review E, 61, 1825-1828. doi:10.1103/PhysRevE.61.1825
25. Carpenter, G. A., & Grossberg, S. G. (1987). A massively parallel architecture for a self-organizing neural pattern recognition machine. Computer Vision, Graphics, and Image Processing, 37, 54-115. doi: 10.1016/S0734-189X(87)80014-2
26. Chklovskii, D. B., Schikorski, T., & Stevens, C. F. (2002). Wiring optimization in cortical circuits. Neuron, 34, 341-347. doi:10.1016/S0896-6273(02)00679-7
27. Cluff, T., & Balasubramaniam, R. (2009). Motor learning characterized by changing Lévy distributions. PLoS ONE, 4(6), e5998. doi:10.1371/journal.pone.0005998
28. Crutchfield, J. P., & Young, K. (1990). Computation at the edge of chaos. In W. Zurek (Ed.), Entropy, complexity, and the physics of information (pp. 223-269). Reading, MA: Addison-Wesley.
29. Dan, Y., & Poo, M.-m. (2004). Spike timing-dependent plasticity of neural circuits. Neuron, 44, 23-30. doi:10.1016/j.neuron.2004.09.007
30. Davidsen, J., & Paczuski, M. (2002). 1/f noise from correlations between avalanches in self-organized criticality. Physical Review E, 66, 050101(R). doi:10.1103/PhysRevE.66.050101
31. Davidsen, J., & Schuster, H. G. (2002). Simple model for 1/f noise. Physical Review E, 65(2), 026120. doi:10.1103/PhysRevE.65.026120
32. de Arcangelis, L., & Herrmann, H. J. (2010). Learning as a phenomenon occurring in a critical state. Proceedings of the National Academy of Sciences, USA, 107, 3977-3981. doi:10.1073/pnas.0912289107
33. de Arcangelis, L., Perrone-Capano, C., & Herrmann, H. J. (2006). Selforganized criticality model for brain plasticity. Physical Review Letters, 96(2), 028107. doi:10.1103/PhysRevLett.96.028107
34. Ding, M., Chen, Y., & Kelso, J. (2002). Statistical analysis of timing errors. Brain and Cognition, 48, 98-106. doi:10.1006/brcg.2001.1306
35. Duarte, M., & Zatsiorsky, V. M. (2001). Long-range correlations in human standing. Physics Letters A, 283(1-2), 124-128. doi:10.1016/S0375-9601(01)00188-8
36. Elman, J. L. (1990). Finding structure in time. Cognitive Science, 14, 179-211. doi:10.1207/s15516709cog1402_1
37. Ermentrout, G. B. (2001, April 19). Oscillatory neural networks. Available from eLS-Wiley Online Library. doi:10.1038/npg.els.0000276
38. Farrell, S., Wagenmakers, E. J., & Ratcliff, R. (2006). 1/f noise in human cognition: Is it ubiquitous, and what does it mean? Psychonomic Bulletin & Review, 13, 737-741. doi:10.3758/BF03193989
39. Friedman, N., Ito, S., Brinkman, B. A. W., Shimono, M., DeVille, R. E. L., Dahmen, K. A.,... Butler, T. C. (2012). Universal critical dynamics in high resolution neuronal avalanche data. Physical Review Letters, 108(20), 208102. doi:10.1103/PhysRevLett.108.208102
40. Friston, K. (2010). The free-energy principle: A unified brain theory? Nature Reviews Neuroscience, 11, 127-138. doi:10.1038/nrn2787
41. Ganguli, S., Huh, D., & Sompolinsky, H. (2008). Memory traces in dynamical systems. Proceedings of the National Academy of Sciences, USA, 105, 18970-18975. doi:10.1073/pnas.0804451105
42. Ganguli, S., & Sompolinsky, H. (2010). Statistical mechanics of compressed sensing. Physical Review Letters, 104(18), 188701. doi:10.1103/PhysRevLett.104.188701
43. Gerstein, G. L., & Mandelbrot, B. (1964). Random walk models for the spike activity of a single neuron. Biophysical Journal, 4(1), 41-68. doi:10.1016/S0006-3495(64)86768-0
44. Gilden, D. L. (2001). Cognitive emissions of 1/f noise. Psychological Review, 108, 33-56. doi:10.1037/0033-295X.108.1.33
45. Gilden, D. L. (2009). Global model analysis of cognitive variability. Cognitive Science, 33, 1441-1467. doi:10.1111/j.1551-6709.2009.01060.x
46. Gilden, D. L., & Hancock, H. (2007). Response variability in attentiondeficit disorders. Psychological Science, 18, 796-802. doi:10.1111/j.1467-9280.2007.01982.x
47. Gilden, D. L., Thornton, T., & Mallon, M. W. (1995, March 24). 1/f noise in human cognition. Science, 267, 1837-1839. doi:10.1126/science.7892611
48. Granger, C. W. J. (1980). Long memory relationships and the aggregation of dynamic models. Journal of Econometrics, 14, 227-238. doi:10.1016/0304-4076(80)90092-5
49. Granger, C. W. J., & Joyeux, R. (1980). An introduction to long-memory models and fractional differencing. Journal of Time Series Analysis, 1, 15-29. doi:10.1111/j.1467-9892.1980.tb00297.x
50. Hahn, G., Petermann, T., Havenith, M. N., Yu, S., Singer, W., Plenz, D., & Nikolic, D. (2010). Neuronal avalanches in spontaneous activity in vivo. Journal of Neurophysiology, 104, 3312-3322. doi:10.1152/jn.00953.2009
51. Haldeman, C., & Beggs, J. M. (2005). Critical branching captures activity in living neural networks and maximizes the number of metastable states. Physical Review Letters, 94(5), 058101. doi:10.1103/PhysRevLett.94.058101
52. Harm, M. W., & Seidenberg, M. S. (1999). Phonology, reading acquisition, and dyslexia: Insights from connectionist models. Psychological Review, 106, 491-528. doi:10.1037/0033-295X.106.3.491
53. Harris, T. E. (1989). The theory of branching processes. New York, NY: Dover.
54. Hayer, A., & Bhalla, U. S. (2005). Molecular switches at the synapse emerge from receptor and kinase traffic. PLoS Computational Biology, 1(2), e20. doi:10.1371/journal.pcbi.0010020
55. He, B. J., Zempel, J. M., Snyder, A. Z., & Raichle, M. E. (2010). The temporal structures and functional significance of scale-free brain activity. Neuron, 66, 353-369. doi:10.1016/j.neuron.2010.04.020
56. Higley, M. J., & Contreras, D. (2006). Balanced excitation and inhibition determine spike timing during frequency adaptation. The Journal of Neuroscience, 26, 448-457. doi:10.1523/JNEUROSCI.3506-05.2006
57. Hinton, G. E. (1989). Connectionist learning procedures. Artificial Intelligence, 40(1-3), 185-234. doi:10.1016/0004-3702(89)90049-0
58. Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006). A fast learning algorithm for deep belief nets. Neural Computation, 18, 1527-1554. doi: 10.1162/neco.2006.18.7.1527
59. Hobbs, J. P., Smith, J. L., & Beggs, J. M. (2010). Aberrant neuronal avalanches in cortical tissue removed from juvenile epilepsy patients. Journal of Clinical Neurophysiology, 27, 380-386.
60. Holden, J. G., Choi, I., Amazeen, P. G., & Van Orden, G. (2011). Fractal 1/f dynamics suggest entanglement of measurement and human performance. Journal of Experimental Psychology: Human Perception and Performance, 37, 935-948. doi:10.1037/a0020991
61. Holden, J. G., Van Orden, G. C., & Turvey, M. T. (2009). Dispersion of response times reveals cognitive dynamics. Psychological Review, 116, 318-342. doi:10.1037/a0014849
62. Holmgren, C. D., & Zilberter, Y. (2001). Coincident spiking activity induces long-term changes in inhibition of neocortical pyramidal cells. The Journal of Neuroscience, 21, 8270-8277.
63. Hopfield, J. J. (1982). Neural networks and physical systems with emergent collective computational abilities. Proceedings of the National Academy of Sciences, USA, 79, 2554-2558. doi:10.1073/pnas.79.8.2554
64. Hotton, S., & Yoshimi, J. (2011). Extending dynamical systems theory to model embodied cognition. Cognitive Science, 35, 444-479. doi: 10.1111/j.1551-6709.2010.01151.x
65. Hsu, D., & Beggs, J. M. (2006). Neuronal avalanches and criticality: A dynamical model for homeostasis. Neurocomputing, 69, 1134-1136. doi:10.1016/j.neucom.2005.12.060
66. Hu, K., Ivanov, P. C., Chen, Z., Hilton, M. F., Stanley, H. E., & Shea, S. A. (2004). Non-random fluctuations and multi-scale dynamics regulation of human activity. Physica A: Statistical Mechanics and its Applications, 337(1-2), 307-318.
67. Ibata, K., Sun, Q., & Turrigiano, G. G. (2008). Rapid synaptic scaling induced by changes in postsynaptic firing. Neuron, 57, 819-826. doi: 10.1016/j.neuron.2008.02.031
68. Ihlen, E. A., & Vereijken, B. (2010). Interaction-dominant dynamics in human cognition: Beyond 1/f fluctuation. Journal of Experimental Psychology: General, 139, 436-463. doi:10.1037/a0019098
69. Iyengar, S., & Liao, Q. (1997). Modeling neural activity using the generalized inverse Gaussian distribution. Biological Cybernetics, 77, 289-295. doi:10.1007/s004220050390
70. Jackson, B. S. (2004). Including long-range dependence in integrate-andfire models of the high interspike-interval variability of cortical neurons. Neural Computation, 16, 2125-2195. doi:10.1162/0899766041732413
71. Jaeger, H., Maass, W., & Principe, J. (2007). Editorial: Special issue on echo state networks and liquid state machines. Neural Networks, 20, 287-289. doi:10.1016/j.neunet.2007.04.001
72. Jensen, H. J. (1998). Self-organized criticality. Cambridge, England: Cambridge University Press.
73. Joshi, P., & Maass, W. (2005). Movement generation with circuits of spiking neurons. Neural Computation, 17, 1715-1738. doi:10.1162/0899766054026684
74. Katchalsky, A., & Kedemo, O. (1962). Thermodynamics of flow processes in biological systems. Biophysical Journal, 2(2), 53-78. doi:10.1016/S0006-3495(62)86948-3
75. Kello, C. (2011). Intrinsic fluctuations yield pervasive 1/f scaling: Comment on Moscoso del Prado Martín (2011). Cognitive Science, 35, 838-841. doi:10.1111/j.1551-6709.2011.01185.x
76. Kello, C. T., Anderson, G. G., Holden, J. G., & Van Orden, G. C. (2008). The pervasiveness of 1/f scaling in speech reflects the metastable basis of cognition. Cognitive Science, 32, 1217-1231. doi:10.1080/03640210801944898
77. Kello, C. T., Beltz, B. C., Holden, J. G., & Van Orden, G. C. (2007). The emergent coordination of cognitive function. Journal of Experimental Psychology: General, 136, 551-568. doi:10.1037/0096-3445.136.4.551
78. Kello, C. T., Brown, G. D. A., Ferrer-i-Cancho, R., Holden, J. G., Linkenkaer-Hansen, K., Rhodes, T., & Van Orden, G. C. (2010). Scaling laws in cognitive sciences. Trends in Cognitive Sciences, 14, 223-232. doi:10.1016/j.tics.2010.02.005
79. Kello, C. T., & Kawamoto, A. H. (1998). Runword: An IBM-PC software package for the collection and acoustic analysis of speeded naming responses. Behavior Research Methods, Instruments, & Computers, 30, 371-383. doi:10.3758/BF03200668
80. Kello, C., & Kerster, B. (2011, April 11). Power laws, memory capacity, and self-tuned critical branching in an LIF model with binary synapses. In Proceedings of Computational and Systems Neuroscience 2011. Available from Nature Precedings. doi:10.1038/npre.2011.5893.1
81. Kello, C. T., Kerster, B., & Johnson, E. (2011). Critical branching neural computation, neural avalanches, and 1/f scaling. In L. Carlson, C. Hoelscher, & T. F. Shipley (Eds.), Proceedings of the 33rd Annual Meeting of the Cognitive Science Society (pp. 1685-1690). Boston, MA: Cognitive Science Society.
82. Kello, C. T., & Mayberry, M. R. (2010). Critical branching neural computation. In International Joint Conference on Neural Networks (pp. 1475-1481). Barcelona, Spain: IEEE.
83. Kello, C. T., & Van Orden, G. C. (2009). Soft-assembly of sensorimotor function. Nonlinear Dynamics, Psychology, and Life Sciences, 13, 57-78.
84. Kelso, J. A. S. (1995). Dynamic patterns: The self-organization of brain and behavior. Cambridge, MA: MIT Press.
85. Kinouchi, O., & Copelli, M. (2006). Optimal dynamical range of excitable networks at criticality. Nature Physics, 2, 348-351. doi:10.1038/nphys289
86. Kwok, T., & Smith, K. A. (2005). Optimization via intermittency with a self-organizing neural network. Neural Computation, 17, 2454-2481. doi:10.1162/0899766054796860
87. Langton, C. G. (1990). Computation at the edge of chaos: Phase transitions and emergent computation. Physica D: Nonlinear Phenomena, 42(1-3), 12-37. doi:10.1016/0167-2789(90)90064-V
88. Large, E. W., & Kolen, J. F. (1994). Resonance and the perception of musical meter. Connection Science, 6, 177-208. doi:10.1080/09540099408915723
89. Laufs, H., Krakow, K., Sterzer, P., Eger, E., Beyerle, A., Salek-Haddadi, A., & Kleinschmidt, A. (2003). Electroencephalographic signatures of attentional and cognitive default modes in spontaneous brain activity fluctuations at rest. Proceedings of the National Academy of Sciences, USA, 100, 11053-11058. doi:10.1073/pnas.1831638100
90. Linkenkaer-Hansen, K., Monto, S., Rytsala, H., Suominen, K., Isometsa, E., & Kahkonen, S. (2005). Breakdown of long-range temporal correlations in theta oscillations in patients with major depressive disorder. The Journal of Neuroscience, 25, 10131-10137. doi:10.1523/JNEUROSCI.3244-05.2005
91. Linkenkaer-Hansen, K., Nikouline, V. V., Palva, J. M., & Ilmoniemi, R. J. (2001). Long-range temporal correlations and scaling behavior in human brain oscillations. The Journal of Neuroscience, 21, 1370-1377.
92. Linkenkaer-Hansen, K., Nikulin, V. V., Palva, J. M., Kaila, K., & Ilmoniemi, R. J. (2004). Stimulus-induced change in long-range temporal correlations and scaling behaviour of sensorimotor oscillations. European Journal of Neuroscience, 19, 203-218. doi:10.1111/j.1460-9568.2004.03116.x
93. Lisman, J. E., & McIntyre, C. C. (2001). Synaptic plasticity: A molecular memory switch. Current Biology, 11, R788-R791. doi:10.1016/S0960-9822(01)00472-9
94. Liu, Q. (2000). On generalized multiplicative cascades. Stochastic Processes and Their Applications, 86, 263-286. doi:10.1016/S0304-4149(99)00097-6
95. Liu, Z., Fukunaga, M., de Zwart, J. A., & Duyn, J. H. (2010). Large-scale spontaneous fluctuations and correlations in brain electrical activity observed with magnetoencephalography. NeuroImage, 51, 102-111. doi:10.1016/j.neuroimage.2010.01.092
96. Lübeck, S. (2004). Universal scaling behavior of non-equilibrium phase transitions. International Journal of Modern Physics B, 18(31, No. 32), 3977. doi:10.1142/S0217979204027748
97. Maass, W. (1997). Networks of spiking neurons: The third generation of neural network models. Neural Networks, 10, 1659-1671. doi:10.1016/S0893-6080(97)00011-7
98. Maass, W., Joshi, P., & Sontag, E. D. (2007). Computational aspects of feedback in neural circuits. PLoS Computational Biology, 3(1), e165. doi:10.1371/journal.pcbi.0020165
99. Maass, W., Natschlager, T., & Markram, H. (2002). Real-time computing without stable states: A new framework for neural computation based on perturbations. Neural Computation, 14, 2531-2560. doi:10.1162/089976602760407955
100. Marder, E., & Goaillard, J.-M. (2006). Variability, compensation and homeostasis in neuron and network function. Nature Reviews Neuroscience, 7, 563-574. doi:10.1038/nrn1949
101. Markram, H., Lübke, J., Frotscher, M., & Sakmann, B. (1997, January 10). Regulation of synaptic efficacy by coincidence of postsynaptic APs and EPSPs. Science, 275, 213-215. doi:10.1126/science.275.5297.213
102. Marr, D. (1982). Vision: A computational investigation into the human representation and processing of visual information. San Francisco, CA: Freeman.
103. Mattia, M., & Del Giudice, P. (2000). Efficient event-driven simulation of large networks of spiking neurons and dynamical synapses. Neural Computation, 12, 2305-2329. doi:10.1162/089976600300014953
104. Mazzoni, A., Broccard, F. D., Garcia-Perez, E., Bonifazi, P., Ruaro, M. E., & Torre, V. (2007). On the dynamics of the spontaneous activity in neuronal networks. PLoS ONE, 2(5), e439. doi:10.1371/journal.pone.0000439
105. McClung, C. A., Ulery, P. G., Perrotti, L. I., Zachariou, V., Berton, O., & Nestler, E. J. (2004). FosB: A molecular switch for long-term adaptation in the brain. Molecular Brain Research, 132, 146-154. doi:10.1016/j.molbrainres.2004.05.014
106. Micheva, K. D., Busse, B., Weiler, N. C., O'Rourke, N., & Smith, S. J. (2010). Single-synapse analysis of a diverse synapse population: Proteomic imaging methods and markers. Neuron, 68, 639-653. doi: 10.1016/j.neuron.2010.09.024
107. Mitchell, M., Hraber, P. T., & Crutchfield, J. P. (1999). Dynamic computation, and the "edge of chaos": A re-examination. In G. Cowan, D.
108. Pines, & D. Melzner (Eds.), Complexity: Metaphors, models, and reality (pp. 497-513). Reading, MA: Addison-Wesley.
109. Montez, T., Poil, S.-S., Jones, B. F., Manshanden, I., Verbunt, J. P. A., van Dijk, B. W., Linkenkaer-Hansen, K. (2009). Altered temporal correlations in parietal alpha and prefrontal theta oscillations in earlystage Alzheimer disease. Proceedings of the National Academy of Sciences, USA, 106, 1614-1619. doi:10.1073/pnas.0811699106
110. Moscoso del Prado Martín, F. (2011). Causality, criticality, and reading words: Distinct sources of fractal scaling in behavioral sequences. Cognitive Science, 35, 785-837. doi:10.1111/j.1551-6709.2011.01184.x
111. O'Connor, D. H., Wittenberg, G. M., & Wang, S. S.-H. (2005). Graded bidirectional synaptic plasticity is composed of switch-like unitary events. Proceedings of the National Academy of Sciences, USA, 102, 9679-9684. doi:10.1073/pnas.0502332102
112. Packard, N. (1988). Adaptation towards the edge of chaos. In J. A. S. Kelso, A. J. Mandell, & M. F. Shlesinger (Eds.), Dynamic patterns in complex systems (pp. 293-301). Singapore: World Scientific. Pearlmutter, B. A. (1995). Gradient calculations for dynamic recurrent neural networks: A survey. IEEE Transactions on Neural Networks, 6, 1212-1228. doi:10.1109/72.410363
113. Petermann, T., Thiagarajan, T. C., Lebedev, M. A., Nicolelis, M. A. L., Chialvo, D. R., & Plenz, D. (2009). Spontaneous cortical activity in awake monkeys composed of neuronal avalanches. Proceedings of the National Academy of Sciences, USA, 106, 15921-15926. doi:10.1073/pnas.0904089106
114. Petersen, C. C. H., Malenka, R. C., Nicoll, R. A., & Hopfield, J. J. (1998). All-or-none potentiation at CA3-CA1 synapses. Proceedings of the National Academy of Sciences, USA, 95, 4732-4737. doi:10.1073/pnas.95.8.4732
115. Poil, S.-S., van Ooyen, A., & Linkenkaer-Hansen, K. (2008). Avalanche dynamics of human brain oscillations: Relation to critical branching processes and temporal correlations. Human Brain Mapping, 29, 770-777. doi:10.1002/hbm.20590
116. Rabinovich, M. I., Huerta, R., Varona, P., & Afraimovich, V. S. (2008). Transient cognitive dynamics, metastability, and decision making. PLoS Computational Biology, 4(5), e1000072. doi:10.1371/journal.pcbi.1000072
117. Raichle, M. E., & Gusnard, D. A. (2005). Intrinsic brain activity sets the stage for expression of motivated behavior. The Journal of Comparative Neurology, 493, 167-176. doi:10.1002/cne.20752
118. Raichle, M. E., MacLeod, A. M., Snyder, A. Z., Powers, W. J., Gusnard, D. A., & Shulman, G. L. (2001). A default mode of brain function. Proceedings of the National Academy of Sciences, USA, 98, 676-682. doi:10.1073/pnas.98.2.676
119. Rangarajan, G., & Ding, M. (2000). Integrated approach to the assessment of long range correlation in time series data. Physical Review E, 61, 4991-5001. doi:10.1103/PhysRevE.61.4991
120. Rasouli, G., Rasouli, M., Lenz, F. A., Verhagen, L., Borrett, D. S., & Kwan, H. C. (2006). Fractal characteristics of human Parkinsonian neuronal spike trains. Neuroscience, 139, 1153-1158. doi:10.1016/j.neuroscience.2006.01.012
121. Rieke, F., Warland, D., van Steveninck, R. d. R., & Bialek, W. (1996). Spikes: Exploring the neural code. Cambridge, MA: MIT Press.
122. Riley, M. A., & Turvey, M. (2002). Variability and determinism in motor behavior. Journal of Motor Behavior, 34, 99-125. doi:10.1080/00222890209601934
123. Robin, K., Maurice, N., Degos, B., Deniau, J.-M., Martinerie, J., & Pezard, L. (2009). Assessment of bursting activity and interspike intervals variability: A case study for methodological comparison. Journal of Neuroscience Methods, 179, 142-149. doi:10.1016/j.jneumeth.2009.01.020
124. Rowat, P. (2007). Interspike interval statistics in the stochastic Hodgkin- Huxley model: Coexistence of gamma frequency bursts and highly irregular firing. Neural Computation, 19, 1215-1250. doi:10.1162/neco.2007.19.5.1215
125. Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986, October 9). Learning representations by back-propagating errors. Nature, 323, 533-536. doi:10.1038/323533a0
126. Shadlen, M. N., & Newsome, W. T. (1998). The variable discharge of cortical neurons: Implications for connectivity, computation, and information coding. The Journal of Neuroscience, 18, 3870-3896.
127. Shew, W. L., Yang, H., Petermann, T., Roy, R., & Plenz, D. (2009). Neuronal avalanches imply maximum dynamic range in cortical networks at criticality. The Journal of Neuroscience, 29, 15595-15600. doi:10.1523/JNEUROSCI.3864-09.2009
128. Shin, C. W., & Kim, S. (2006). Self-organized criticality and scale-free properties in emergent functional neural networks. Physical Review E, 74(4), 045101. doi:10.1103/PhysRevE.74.045101
129. Shockley, K., Santana, M. V., & Fowler, C. A. (2003). Mutual interpersonal postural constraints are involved in cooperative conversation. Journal of Experimental Psychology: Human Perception and Performance, 29, 326-332. doi:10.1037/0096-1523.29.2.326
130. Shu, Y., Hasenstaub, A., & McCormick, D. A. (2003, May 15). Turning on and offrecurrent balanced cortical activity. Nature, 423, 288-293. doi:10.1038/nature01616
131. Simon, H. A. (1973). The organization of complex systems. In H. H. Pattee (Ed.), Hierarchy theory: The challenge of complex systems (pp. 1-27). New York, NY: George Braziller.
132. Smith, P. L., & Ratcliff, R. (2004). Psychology and neurobiology of simple decisions. Trends in Neurosciences, 27, 161-168. doi:10.1016/j.tins.2004.01.006
133. Softky, W. R., & Koch, C. (1993). The highly irregular firing of cortical cells is inconsistent with temporal integration of random EPSPs. The Journal of Neuroscience, 13, 334-350.
134. Song, S., Miller, K. D., & Abbott, L. F. (2000). Competitive Hebbian learning through spike-timing-dependent synaptic plasticity. Nature Neuroscience, 3, 919-926. doi:10.1038/78829
135. Sornette, D. (2004). Critical phenomena in natural sciences: Chaos, fractals, self-organization, and disorder: Concepts and tools (2nd ed.). New York, NY: Springer.
136. Spivey, M. J. (2007). The continuity of mind. New York, NY: Oxford University Press.
137. Stanley, H. E. (1987). Introduction to phase transitions and critical phenomena. New York, NY: Oxford University Press.
138. Stein, R. B., Gossen, E. R., & Jones, K. E. (2005). Neuronal variability: Noise or part of the signal? Nature Reviews Neuroscience, 6, 389-397. doi:10.1038/nrn1668
139. Stellwagen, D., & Malenka, R. C. (2006, April 20). Synaptic scaling mediated by glial TNF-. Nature, 440, 1054-1059. doi:10.1038/nature04671
140. Stephen, D. G., & Dixon, J. A. (2011). Strong anticipation: Multifractal cascade dynamics modulate scaling in synchronization behaviors.
141. Chaos, Solitons & Fractals, 44(1-3), 160-168. doi:10.1016/j.chaos.2011.01.005
142. Swenson, R., & Turvey, M. (1991). Thermodynamic reasons for perception-action cycles. Ecological Psychology, 3, 317-348. doi: 10.1207/s15326969eco0304_2
143. Szary, J., & Kello, C. T. (2011). Visual motion perception using critical branching neural computation. Paper presented at the 34th Annual Meeting of the Cognitive Science Society, Boston, MA.
144. Teich, M. C., Heneghan, C., Lowen, S. B., Ozaki, T., & Kaplan, E. (1997). Fractal character of the neural spike train in the visual system of the cat. Journal of the Optical Society of America A, 14, 529-546. doi:10.1364/JOSAA.14.000529
145. Teich, M. C., & Lowen, S. B. (1994, April-May). Fractal patterns in auditory nerve-spike trains. Engineering in Medicine and Biology Magazine, IEEE, 13(2), 197-202. doi:10.1109/51.281678
146. Thornton, T. L., & Gilden, D. L. (2005). Provenance of correlations in psychological data. Psychonomic Bulletin & Review, 12, 409-441. doi:10.3758/BF03193785
147. Tong, M. H., Bickett, A. D., Christiansen, E. M., & Cottrell, G. W. (2007). Learning grammatical structure with Echo State Networks. Neural Networks, 20, 424-432. doi:10.1016/j.neunet.2007.04.013
148. Torre, K., & Wagenmakers, E.-J. (2009). Theories and models for 1/f noise in human movement science. Human Movement Science, 28, 297-318. doi:10.1016/j.humov.2009.01.001
149. Touboul, J., & Destexhe, A. (2010). Can power-law scaling and neuronal avalanches arise from stochastic dynamics? PLoS ONE, 5(2), e8982. doi:10.1371/journal.pone.0008982
150. Troyer, T. W., & Miller, K. D. (1997). Physiological gain leads to high ISI variability in a simple model of a cortical regular spiking cell. Neural Computation, 9, 971-983. doi:10.1162/neco.1997.9.5.971
151. Turcotte, D. L., Malamud, B. D., Guzzetti, F., & Reichenbach, P. (2002). Self-organization, the cascade model, and natural hazards. Proceedings of the National Academy of Sciences, USA, 99(Suppl. 1), 2530-2537. doi:10.1073/pnas.012582199
152. Turrigiano, G. G., & Nelson, S. B. (2004). Homeostatic plasticity in the developing nervous system. Nature Reviews Neuroscience, 5, 97-107. doi:10.1038/nrn1327
153. Usher, M., Stemmler, M., Koch, C., & Olami, Z. (1994). Network amplification of local fluctuations causes high spike rate variability, fractal firing patterns and oscillatory local field potentials. Neural Computation, 6, 795-836. doi:10.1162/neco.1994.6.5.795
154. Usher, M., Stemmler, M., & Olami, Z. (1995). Dynamic pattern-formation leads to 1/f noise in neural populations. Physical Review Letters, 74, 326-329. doi:10.1103/PhysRevLett.74.326
155. Van Orden, G. C., Holden, J. G., & Turvey, M. T. (2003). Selforganization of cognitive performance. Journal of Experimental Psychology: General, 132, 331-350. doi:10.1037/0096-3445.132.3.331
156. Van Orden, G. C., Kello, C. T., & Holden, J. G. (2010). Situated behavior and the place of measurement in psychological theory. Ecological Psychology, 22, 24-43. doi:10.1080/10407410903493145
157. van Vreeswijk, C., & Sompolinsky, H. (1996, December 6). Chaos in neuronal networks with balanced excitatory and inhibitory activity. Science, 274, 1724-1726. doi:10.1126/science.274.5293.1724
158. Verstraeten, D., Schrauwen, B., Stroobandt, D., & Van Campenhout, J. (2005). Isolated word recognition with the Liquid State Machine: A case study. Information Processing Letters, 95, 521-528. doi:10.1016/j.ipl.2005.05.019
159. Wagenmakers, E.-J., Farrell, S., & Ratcliff, R. (2004). Estimation and interpretation of l/f alpha noise in human cognition. Psychonomic Bulletin & Review, 11, 579-615. doi:10.3758/BF03196615
160. Welling, M., & Chen, Y. (2010). Statistical inference using weak chaos and infinite memory. Journal of Physics: Conference Series, 233(1), 012005. doi:10.1088/1742-6596/233/1/012005
161. Wolpert, D. H., & Macready, W. G. (1997). No free lunch theorems for optimization. IEEE Transactions on Evolutionary Computation, 1, 67-82. Zapperi, S., Lauritsen, K. B., & Stanley, H. E. (1995). Self-organized branching processes: Mean-field theory for avalanches. Physical Review Letters, 75, 4071-4074. doi:10.1103/PhysRevLett.75.4071
162. Zheng, Y., Gao, J., Sanchez, J. C., Principe, J. C., & Okun, M. S. (2005). Multiplicative multifractal modeling and discrimination of human neuronal activity. Physics Letters A, 344(2-4), 253-264. doi:10.1016/j.physleta.2005.06.092