Nonequilibrium landscape theory of neural networks

Proceedings of the National Academy of Sciences of the United States of America

Volumn 110, Issue 45, 2013, Pages

  Yan, Han ^a,b   Zhao, Lei ^a,c   Hu, Liang ^c   Wang, Xidi ^d   Wang, Erkang ^a   Wang, Jin ^a,b,e  

^a CHANGCHUN INSTITUTE OF APPLIED CHEMISTRY   (China)

^b State Key Laboratory of Superhard Materials   (United States)

^c JILIN UNIVERSITY   (China)

^d Quantum Strategics   (United States)

^e STONY BROOK UNIVERSITY   (United States)

Author keywords

Entropy production; Free energy; Neural circuits; Nonequilibrium thermodynamics

Indexed keywords

ARTICLE; BRAIN FUNCTION; COGNITION; HUMAN; LEARNING; MEMORY; NERVE CELL; NERVE CELL NETWORK; OSCILLATION; PRIORITY JOURNAL; PROBABILITY; REM SLEEP; SENSITIVITY ANALYSIS; SLEEP PATTERN; THERMODYNAMICS; TOPOGRAPHY;

ENTROPY PRODUCTION; FREE ENERGY; NEURAL CIRCUITS; NONEQUILIBRIUM THERMODYNAMICS;

BRAIN MAPPING; COGNITION; ENTROPY; HUMANS; MODELS, NEUROLOGICAL; NERVE NET; NEURAL PATHWAYS; SLEEP; THERMODYNAMICS;

EID: 84887283476     PISSN: 00278424     EISSN: 10916490     Source Type: Journal    
DOI: 10.1073/pnas.1310692110     Document Type: Article

References (65)

1. Abbott LF, Regehr WG (2004) Synaptic computation. Nature 431(7010):796-803.
2. Abbott LF (2008) Theoretical neuroscience rising. Neuron 60(3):489-495.
3. Vogels TP, Rajan K, Abbott LF (2005) Neural network dynamics. Annu Rev Neurosci 28:357-376.
4. Hodgkin AL, Huxley AF (1952) A quantitative description of membrane current and its application to conduction and excitation in nerve. J Physiol 117(4):500-544.
5. Hopfield JJ (1982) Neural networks and physical systems with emergent collective computational abilities. Proc Natl Acad Sci USA 79(8):2554-2558.
6. Hopfield JJ, Tank DW (1986) Computing with neural circuits: A model. Science 233(4764):625-633.
7. Wang M, et al. (2011) Neuronal basis of age-related working memory decline. Nature 476(7359):210-213.
8. Buzsáki G, Draguhn A (2004) Neuronal oscillations in cortical networks. Science 304(5679):1926-1929.
9. Wang XJ, Tegnér J, Constantinidis C, Goldman-Rakic PS (2004) Division of labor among distinct subtypes of inhibitory neurons in a cortical microcircuit of working memory. Proc Natl Acad Sci USA 101(5):1368-1373.
10. Friedrichs MS, Wolynes PG (1989) Toward protein tertiary structure recognition by means of associative memory hamiltonians. Science 246(4928):371-373.
11. Goldstein RA, Luthey-Schulten ZA, Wolynes PG (1992) Optimal protein-folding codes from spin-glass theory. Proc Natl Acad Sci USA 89(11):4918-4922.
12. Wang J, Xu L, Wang EK (2008) Potential landscape and flux framework of nonequilibrium networks: Robustness, dissipation, and coherence of biochemical oscillations. Proc Natl Acad Sci USA 105(34):12271-12276.
13. Wang J, Li CH, Wang EK (2010) Potential and flux landscapes quantify the stability and robustness of budding yeast cell cycle network. Proc Natl Acad Sci USA 107(18):8195-8200.
14. Wang J, Xu L, Wang EK, Huang S (2010) The potential landscape of genetic circuits imposes the arrow of time in stem cell differentiation. Biophys J 99(1):29-39.
15. Wang J, Zhang K, XuL, Wang EK(2011) QuantifyingtheWaddingtonlandscapeandbiological paths for development and differentiation. Proc Natl Acad Sci USA 108(20):8257-8262.
16. Friston K, Ao P (2012) Free energy, value, and attractors. Comput Math Methods Med 2012:937860.
17. Ao P (2009) Global view of bionetwork dynamics: Adaptive landscape. J Genet Genomics 36(2):63-73.
18. Sasai M, Wolynes PG (2003) Stochastic gene expression as a many-body problem. Proc Natl Acad Sci USA 100(5):2374-2379.
19. Lapidus S, Han B, Wang J (2008) Intrinsic noise, dissipation cost, and robustness of cellular networks: The underlying energy landscape of MAPK signal transduction. Proc Natl Acad Sci USA 105(16):6039-6044.
20. Wang XJ (2010) Neurophysiological and computational principles of cortical rhythms in cognition. Physiol Rev 90(3):1195-1268.
21. Raghavachari S, et al. (2001) Gating of human theta oscillations by a working memory task. J Neurosci 21(9):3175-3183.
22. Fries P, Reynolds JH, Rorie AE, Desimone R (2001) Modulation of oscillatory neuronal synchronization by selective visual attention. Science 291(5508):1560-1563.
23. Fries P (2009) Neuronal gamma-band synchronization as a fundamental process in cortical computation. Annu Rev Neurosci 32:209-224.
24. McCarley RW, Massaquoi SG (1986) A limit cycle mathematical model of the REM sleep oscillator system. Am J Physiol 251(6):R1011-R1029.
25. Massaquoi SG, McCarley RW (1992) Extension of the limit cycle reciprocal interaction model of REMcycle control. An integrated sleep control model. J Sleep Res 1(2):138-143.
26. Kauffman SA (1993) The Origins of Order: Self Organization and Selection in Evolution (Oxford Univ Press, Oxford).
27. Schnakenberg J (1976) Network theory of microscopic and macroscopic behavior of master equation systems. Rev Mod Phys 48:571-585.
28. Haken H (1987) Advanced Synergetics: Instability Hierarchies of Self-Organizing Systems and Devices (Springer, Berlin).
29. Graham R (1989) Noise in Nonlinear Dynamical Systems, eds Moss F, McClintock PVE (Cambridge Univ Press, Cambridge, UK), Vol 1, pp 225-278.
30. Wang J, Huang B, Xia XF, Sun ZR (2006) Funneled landscape leads to robustness of cell networks: Yeast cell cycle. PLoS Comput Biol 2(11):e147.
31. Kim KY, Wang J (2007) Potential energy landscape and robustness of a gene regulatory network: Toggle switch. PLoS Comput Biol 3(3):e60.
32. Ao P (2008) Emerging of stochastic dynamical equalities and steady state thermodynamics from Darwinian dynamics. Commun Theor Phys 49(5):1073-1090.
33. Qian H (2009) Entropy demystified the thermo-dynamics of stochastically fluctuating systems. Methods Enzymol 467:111-134.
34. Zhang F, Xu L, Zhang K, Wang EK, Wang J (2012) The potential and flux landscape theory of evolution. J Chem Phys 137(6):065102.
35. Ge H, Qian H (2010) Physical origins of entropy production, free energy dissipation, and their mathematical representations. Phys Rev E Stat Nonlin Soft Matter Phys 81(5):051133.
36. Hu G (1986) Lyapunov function and stationary probability distributions. Z Phys B Condens Matter 65:103-106.
37. Prigogine I, Nicolis G (1977) Self Organization in Non-Equilibrium Systems (Wiley, New York).
38. Van den Broeck C, Esposito M (2010) Three faces of the second law II Fokker-Planck formulation. Phys Rev E Stat Nonlin Soft Matter Phys 82(1):011144.
39. Zhaoping L, Herzog MH, Dayan P (2003) Nonlinear ideal observation and recurrent preprocessing in perceptual learning. Network 14(2):233-247.
40. Schultz W, Dayan P, Montague PR (1997) A neural substrate of prediction and reward. Science 275(5306):1593-1599.
41. Gardner E, Derrida B (1988) Optimal storage properties of neural network models. J Phys Math Gen 21:271-284.
42. Gardner E, Gutfreund H, Yekutieli I (1989) The phase-space of interactions in neural networks with definite symmetry. J Phys Math Gen 22:1995-2008.
43. Krauth W, Nadal JP, Mezard M (1988) The roles of stability and symmetry in the dynamics of neural networks. J Phys Math Gen 21:2995-3011.
44. Crisanti A, Sompolinsky H (1987) Dynamics of spin systems with randomly asymmetric bonds: Langevin dynamics and a spherical model. Phys Rev A 36(10):4922-4939.
45. Buhmann J, Divko R, Schulten K (1989) Associative memory with high information content. Phys Rev A 39(5):2689-2692.
46. Brody CD, Hopfield JJ (2003) Simple networks for spike-timing-based computation, with application to olfactory processing. Neuron 37(5):843-852.
47. Hopfield JJ (1991) Olfactory computation and object perception. Proc Natl Acad Sci USA 88(15):6462-6466.
48. Grillner S, Wallén P (1985) Central pattern generators for locomotion, with special reference to vertebrates. Annu Rev Neurosci 8:233-261.
49. Düzel E, Penny WD, Burgess N (2010) Brain oscillations and memory. Curr Opin Neurobiol 20(2):143-149.
50. Seung HS (1996) How the brain keeps the eyes still. Proc Natl Acad Sci USA 93(23): 13339-13344.
51. Seung HS (1998) Continuous attractors and oculomotor control. Neural Netw 11(7): 1253-1258.
52. Amit DJ (1992) Modeling Brain Function: The World of Attractor Neural Networks (Cambridge Univ Press, Cambridge, UK).
53. Lewandowsky S, Murdock BB (1989) Memory for serial order. Psychol Rev 96:25-57.
54. Brown GDA, Preece T, Hulme C (2000) Oscillator-based memory for serial order. Psychol Rev 107(1):127-181.
55. Sompolinsky H, Kanter I (1986) Temporal association in asymmetric neural networks. Phys Rev Lett 57(22):2861-2864.
56. Kleinfeld D, Sompolinsky H (1988) Associative neural network model for the generation of temporal patterns. Theory and application to central pattern generators. Biophys J 54(6):1039-1051.
57. Fell J, Axmacher N (2011) The role of phase synchronization in memory processes. Nat Rev Neurosci 12(2):105-118.
58. Fries P (2005) A mechanism for cognitive dynamics: Neuronal communication through neuronal coherence. Trends Cogn Sci 9(10):474-480.
59. McCarley RW, Massaquoi SG (1992) Neurobiological structure of the revised limit cycle reciprocal interaction model of REM cycle control. J Sleep Res 1(2):132-137.
60. Lotka AJ (1925) Elements of Physical Biology (Williams and Wilkins, Baltimore).
61. Volterra V (1931) Lecons sur la Theorie Mathematique de la Lutte pour la Vie (Gauthier-Villars, Paris), French.
62. Leonard TO, Lydic R (1997) Pontine nitric oxide modulates acetylcholine release, rapid eye movement sleep generation, and respiratory rate. J Neurosci 17(2):774-785.
63. Mallick BN, et al. (2002) Role of norepinephrine in the regulation of rapid eye movement sleep. J Biosci 27(5):539-551.
64. Sitaram N, Moore AM, Gillin JC (1978) Experimental acceleration and slowing of REM sleep ultradian rhythm by cholinergic agonist and antagonist. Nature 274(5670):490-492.
65. Bartos M, Vida I, Jonas P (2007) Synaptic mechanisms of synchronized gamma oscillations in inhibitory interneuron networks. Nat Rev Neurosci 8(1):45-56.