Information and Efficiency in the Nervous System-A Synthesis

PLoS Computational Biology

Volumn 9, Issue 7, 2013, Pages

  Sengupta, Biswa ^a,b   Stemmler, Martin B ^c   Friston, Karl J ^a  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

^b INDIAN INSTITUTE OF SCIENCE   (India)

^c UNIVERSITY OF MUNICH   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL EFFICIENCY; ECONOMIC AND SOCIAL EFFECTS; ELECTROPHYSIOLOGY; FREE ENERGY; INFORMATION THEORY; METABOLISM;

ACTION-POTENTIALS; ADAPTIVE BEHAVIOUR; BIOLOGICAL COMPUTATIONS; BIOPHYSICAL STATE; CELLULARS; GENETIC CIRCUITS; ION CHANNEL; SYNAPTIC TRANSMISSION; SYSTEMS BIOLOGY; TOTAL ENERGY;

NEURONS;

ADENOSINE TRIPHOSPHATASE (POTASSIUM SODIUM); ADENOSINE TRIPHOSPHATE; POTASSIUM ION; SODIUM ION;

BAYES THEOREM; BRAIN METABOLISM; ELECTROENCEPHALOGRAM; ENERGY EXPENDITURE; ENTROPY; FUNCTIONAL ANATOMY; ISOTHERM; MATHEMATICAL MODEL; MOLECULAR EVOLUTION; NERVE CELL MEMBRANE STEADY POTENTIAL; NERVE CELL NETWORK; NERVOUS SYSTEM FUNCTION; NEUROPHYSIOLOGY; NONHUMAN; POTASSIUM CURRENT; REVIEW; SENSORY STIMULATION; SIGNAL PROCESSING; SODIUM CURRENT; STEADY STATE; SYNAPTIC TRANSMISSION; SYSTEMATIC ERROR; SYSTEMS BIOLOGY;

EID: 84880796856     PISSN: 1553734X     EISSN: 15537358     Source Type: Journal    
DOI: 10.1371/journal.pcbi.1003157     Document Type: Review

References (104)

1. Sutherland WJ, (2005) The best solution. Nature 435: 569.
2. Alexander RM (1996) Optima for animals. Princeton/Chichester: Princeton University Press.
3. Niven JE, Laughlin SB, (2008) Energy limitation as a selective pressure on the evolution of sensory systems. J Exp Biol 211: 1792-1804.
4. Feynman RP, Hey AJG, Allen RW (1996) Feynman lectures on computation. Reading (Massachusetts): Addison-Wesley.
5. Landauer R, (1961) Irreversibility and heat generation in the computing process. IBM Journal of Research and Development 5: 183-191.
6. Landauer R, (1996) Minimal energy requirements in communciation. Science 272: 1914-1918.
7. Stemmler M, Sengupta B, Laughlin SB, Niven JE (2011) Energetically optimal action potentials. In: Shawe-Taylor J, Zemel RS, Bartlett P, Pereira F, Weinberger KQ, editors. Advances in neural information processing systems 24. pp. 1566-1574.
8. Jarzynski C, (1997) Nonequilibrium equality for free energy differences. Phys Rev Lett 78: 2690-2693.
9. Ashby WR, (1947) Principles of the self-organising dynamic system. J Gen Psychol 37: 125-128.
10. Nicolis G, Prigogine I (1977) Self-organisation in non-equilibrium systems. New York: Wiley.
11. Birkhoff GD, Koopman BO, (1932) Recent contributions to the ergodic theory. Proc Natl Acad Sci U S A 18: 279-282.
12. Friston K, Ao P, (2012) Free energy, value, and attractors. Comput Math Methods Med 2012: 937860.
13. Friston K, (2009) The free-energy principle: a rough guide to the brain? TICS 13: 293-301.
14. Friston K, (2010) The free-energy principle: a unified brain theory? Nat Rev Neurosci 11: 127-138.
15. Feynman RP (1998) Statistical mechanics: a set of lectures. Boulder (Colorado): Westview Press.
16. Beal M (2003) Variational algorithms for approximate bayesian inference [PhD thesis]. London: University College London.
17. Hinton GE, Sejnowski TJ (1983) Analyzing cooperative computation. In: Proceedings of the 5th Annual Congress of the Cognitive Science Society; 1983; Rochester, New York, United States.
18. Hinton GE, Sejnowski TJ (1983) Optimal perceptual inference. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition; 1983; Washington, D.C., United States. pp. 448-453.
19. Hofstadter DR (1984) The copycat project: an experiment in nondeterminism and creative analogies. Boston: MIT Artificial Intelligence Laboratory.
20. Hopfield JJ, (1982) Neural networks and physical systems with emergent collective computational abilities. Proc Natl Acad Sci U S A 79: 2554-2558.
21. Friston K, Kilner J, Harrison L, (2006) A free energy principle for the brain. J Physiol Paris 100: 70-87.
22. Friston K, Mattout J, Trujillo-Barreto N, Ashburner J, Penny W, (2007) Variational free energy and the Laplace approximation. Neuroimage 34: 220-234.
23. Harrison LM, Stephan KE, Rees G, Friston KJ, (2007) Extra-classical receptive field effects measured in striate cortex with fMRI. Neuroimage 34: 1199-1208.
24. Garrido MI, Kilner JM, Kiebel SJ, Friston KJ, (2007) Evoked brain responses are generated by feedback loops. Proc Natl Acad Sci U S A 104: 20961-20966.
25. Zeki S, Shipp S, (1988) The functional logic of cortical connections. Nature 335: 311-317.
26. Felleman DJ, Essen DCV, (1991) Distributed hierarchical processing in the primate cerebral cortex. Cereb Cortex 1: 1-47.
27. Kawato M, Hayakawa H, Inui T, (1993) A forward-inverse optics model of reciprocal connections between visual cortical areas. Network 4: 415-422.
28. Srinivasan MV, Laughlin SB, Dubs A, (1982) Predictive coding: a fresh view of inhibition in the retina. Proc R Soc Lond B Biol Sci 216: 427-459.
29. Mumford D, (1992) On the computational architecture of the neocortex. II. The role of cortico-cortical loops. Biol Cybern 66: 241-251.
30. Crick F, Koch C, (1998) Constraints on cortical and thalamic projections: the no-strong-loops hypothesis. Nature 391: 245-250.
31. Rao RP, Ballard DH, (1999) Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. Nat Neurosci 2: 79-87.
32. Yu AJ, Dayan P, (2005) Uncertainty, neuromodulation, and attention. Neuron 46: 681-692.
33. Friston K, (2008) Hierarchical models in the brain. PLoS Comput Biol 4: e1000211 doi:10.1371/journal.pcbi.1000211.
34. Abbott LF, Varela JA, Sen K, Nelson SB, (1997) Synaptic depression and cortical gain control. Science 275: 220-224.
35. Prigogine L, Nicolis G, Babloyantz A, (1972) Thermodynamics of evolution. Physics Today 25: 38-44.
36. Elias P, (1955) Predictive coding-I. IRE Transactions on Information Theory 1: 16-24.
37. Elias P, (1955) Predictive coding-II. IRE Transactions on Information Theory 1: 24-33.
38. Stemmler M, Koch C, (1999) How voltage-dependent conductances can adapt to maximize the information encoded by neuronal firing rate. Nat Neurosci 2: 521-527.
39. Bell AJ, Sejnowski TJ, (1995) An information-maximization approach to blind separation and blind deconvolution. Neural Comput 7: 1129-1159.
40. Friston K, (2011) What is optimal about motor control? Neuron 72: 488-498.
41. Peleg Y, Efraim H, Shental O, Kanter I, (2010) Mutual information via thermodynamics: three different approaches. Journal of Statistical Mechanics: Theory and Experiments Jan: P01014.
42. Jaynes ET, (1957) Information theory and statistical mechanics. Phys Rev 106: 620-630.
43. Shannon C, (1948) A mathematical theory of communication. Bell System Technical Journal 27: 379-423.
44. Jaynes ET (2003) Probability theory: the logic of science. Cambridge (United Kingdom): Cambridge University Press.
45. Atick JJ, (1992) Could information theory provide an ecological theory of sensory processing? Network 3: 213-251.
46. Barlow HB, Kaushal TP, Mitchison GJ, (1989) Finding minimum entropy codes. Neural Computation 1: 412-423.
47. Barlow HB, Kaushal TP, Hawken M, Parker AJ, (1987) Human contrast discrimination and the threshold of cortical neurons. J Opt Soc Am A 4: 2366-2371.
48. Barlow HB (1959) Sensory mechanisms, the reduction of redundancy, and intelligence. National Physical Laboratory Symposium. Teddington (United Kingdom): H.M. Stationery Office.
49. Laughlin S, (1981) A simple coding procedure enhances a neuron's information capacity. Z Naturforsch C 36: 910-912.
50. Johnson D (2002) Four top reasons mutual information does not quantify neural information processing. In: Proceedings of the Annual Computational Neuroscience Meeting; 2002; Chicago, Illinois, United States.
51. Papoulis A (1984) Probability, random variables, and stochastic processes. New York: McGraw-Hill.
52. Benda J, Gollisch T, Machens CK, Herz AV, (2007) From response to stimulus: adaptive sampling in sensory physiology. Curr Opin Neurobiol 17: 430-436.
53. Treves A, Panzeri S, (1995) The upward bias in measures of information derived from limited data samples. Neural Comput 7: 399-407.
54. Paninski L, (2005) Asymptotic theory of information-theoretic experimental design. Neural Comput 17: 1480-1507.
55. Paninski L, (2003) Estimation of entropy and mutual information. Neural Computation 15: 1191-1253.
56. Ames A, (2000) CNS energy metabolism as related to function. Brain Res Brain Res Rev 34: 42-68.
57. Rolfe DF, Brown GC, (1997) Cellular energy utilization and molecular origin of standard metabolic rate in mammals. Physiol Rev 77: 731-758.
58. Clarke D, Sokoloff L (1999) Circulation and energy metabolism of the brain. In: Siegel GJ, Agranoff BW, Albers RW, Fisher SK, Uhler MD, editors. Basic neurochemistry: molecular, cellular and medical aspects. Philadelphia: Lippincott-Raven. pp. 637-669.
59. Attwell D, Laughlin SB, (2001) An energy budget for signaling in the grey matter of the brain. J Cereb Blood Flow Metab 21: 1133-1145.
60. Skou JC, (1989) The identification of the sodium-pump as the membrane-bound Na+/K+-ATPase: a commentary on 'The Influence of Some Cations on an Adenosine Triphosphatase from Peripheral Nerves'. Biochim Biophys Acta 1000: 435-438.
61. Skou JC, (1957) The influence of some cations on an adenosine triphosphatase from peripheral nerves. Biochim Biophys Acta 23: 394-401.
62. Post RL, Hegyvary C, Kume S, (1972) Activation by adenosine triphosphate in the phosphorylation kinetics of sodium and potassium ion transport adenosine triphosphatase. J Biol Chem 247: 6530-6540.
63. Sen AK, Post RL, (1964) Stoichiometry and localization of adenosine triphosphate-dependent sodium and potassium transport in the erythrocyte. J Biol Chem 239: 345-352.
64. Pangrsic T, Stusek P, Belusic G, Zupancic G, (2005) Light dependence of oxygen consumption by blowfly eyes recorded with a magnetic diver balance. J Comp Physiol A Neuroethol Sens Neural Behav Physiol 191: 75-84.
65. Niven JE, Anderson JC, Laughlin SB, (2007) Fly photoreceptors demonstrate energy-information trade-offs in neural coding. PLoS Biol 5: e116 doi:10.1371/journal.pbio.0050116.
66. Laughlin SB, (2001) Energy as a constraint on the coding and processing of sensory information. Curr Opin Neurobiol 11: 475-480.
67. Laughlin SB, Sejnowski TJ, (2003) Communication in neuronal networks. Science 301: 1870-1874.
68. Levy WB, Baxter RA, (1996) Energy efficient neural codes. Neural Comput 8: 531-543.
69. von der Malsburg C, Willshaw DJ, (1977) How to label nerve cells so that they can interconnect in an ordered fashion. Proc Natl Acad Sci U S A 74: 5176-5178.
70. Bullmore E, Sporns O, (2012) The economy of brain network organization. Nat Rev Neurosci 13: 336-349.
71. Bullmore E, Sporns O, (2009) Complex brain networks: graph theoretical analysis of structural and functional systems. Nat Rev Neurosci 10: 186-198.
72. Sarpeshkar R, (1998) Analog versus digital: extrapolating from electronics to neurobiology. Neural Comp 10: 1601-1638.
73. Sarpeshkar R (2010) Ultra low power bioelectronics: fundamentals, biomedical applications, and bio-inspired systems. Cambridge (United Kingdom): Cambridge University Press.
74. Laughlin SB, de Ruyter van Steveninck RR, Anderson JC, (1998) The metabolic cost of neural information. Nat Neurosci 1: 36-41.
75. Niven JE, Vähäsöyrinki M, Kauranen M, Hardie RC, Juusola M, et al. (2003) The contribution of Shaker K+ channels to the information capacity of Drosophila photoreceptors. Nature 421: 630-634.
76. Niven JE, Vähäsöyrinki M, Juusola M, (2003) Shaker K+ channels are predicted to reduce the metabolic cost of neural information in Drosophila photoreceptors. Proc Biol Sci 270 Suppl 1: S58-S61.
77. Attwell D, Gibb A, (2005) Neuroenergetics and the kinetic design of excitatory synapses. Nat Rev Neurosci 6: 841-849.
78. Carter BC, Bean BP, (2009) Sodium entry during action potentials of mammalian neurons: incomplete inactivation and reduced metabolic efficiency in fast-spiking neurons. Neuron 64: 898-909.
79. Hasenstaub A, Otte S, Callaway E, Sejnowski TJ, (2010) Metabolic cost as a unifying principle governing neuronal biophysics. Proc Natl Acad Sci U S A 107: 12329-12334.
80. Sengupta B, Stemmler M, Laughlin SB, Niven JE, (2010) Action potential energy efficiency varies among neuron types in vertebrates and invertebrates. PLoS Comput Biol 6: e1000840 doi:10.1371/journal.pcbi.1000840.
81. Alle H, Roth A, Geiger JR, (2009) Energy-efficient action potentials in hippocampal mossy fibers. Science 325: 1405-1408.
82. Lennie P, (2003) The cost of cortical computation. Curr Biol 13: 493-497.
83. Nawroth JC, Greer CA, Chen WR, Laughlin SB, Shepherd GM, (2007) An energy budget for the olfactory glomerulus. J Neurosci 27: 9790-9800.
84. Okawa H, Sampath AP, Laughlin SB, Fain GL, (2008) ATP consumption by mammalian rod photoreceptors in darkness and in light. Curr Biol 18: 1917-1921.
85. Howarth C, Peppiatt-Wildman CM, Attwell D, (2010) The energy use associated with neural computation in the cerebellum. J Cereb Blood Flow Metab 30: 403-414.
86. Harris JJ, Attwell D, (2012) The energetics of CNS white matter. J Neurosci 32: 356-371.
87. Attneave F, (1954) Some informational aspects of visual perception. Psychol Rev 61: 183-193.
88. Chklovskii DB, Koulakov AA, (2004) Maps in the brain: what can we learn from them? Annu Rev Neurosci 27: 369-392.
89. Wen Q, Chklovskii DB, (2008) A cost-benefit analysis of neuronal morphology. J Neurophysiol 99: 2320-2328.
90. Wen Q, Stepanyants A, Elston GN, Grosberg AY, Chklovskii DB, (2009) Maximization of the connectivity repertoire as a statistical principle governing the shapes of dendritic arbors. Proc Natl Acad Sci U S A 106: 12536-12541.
91. Chen BL, Hall DH, Chklovskii DB, (2006) Wiring optimization can relate neuronal structure and function. Proc Natl Acad Sci U S A 103: 4723-4728.
92. Crotty P, Sangrey T, Levy WB, (2006) Metabolic energy cost of action potential velocity. J Neurophysiol 96: 1237-1246.
93. Ortega PA, Brau DA, (2012) Thermodynamics as a theory of decision-making with information processing costs. ArXiv pp. 1204.6481v1.
94. Ortega PA, Braun DA, (2010) A minimum relative entropy principle for learning and acting. J Artif Int Res 38: 475-511.
95. Still S, Sivak DA, Bell AJ, Crooks GE, (2012) Thermodynamics of prediction. Phys Rev Lett 109: 120604.
96. Birkhoff GD, (1931) Proof of the ergodic theorem. Proc Natl Acad Sci U S A 17: 656-660.
97. Linsker R, (1990) Perceptual neural organization: some approaches based on network models and information theory. Annu Rev Neurosci 13: 257-281.
98. Tipping ME, (2001) Sparse bayesian learning and the relevance vector machine. J Mach Learn Res 1: 211-244.
99. Paus T, Keshavan M, Giedd JN, (2008) Why do many psychiatric disorders emerge during adolescence? Nat Rev Neurosci 9: 947-957.
100. Gilestro GF, Tononi G, Cirelli C, (2009) Widespread changes in synaptic markers as a function of sleep and wakefulness in Drosophila. Science 324: 109-112.
101. Sengupta B, Faisal AA, Laughlin SB, Niven JE, (2013) The effect of cell size and channel density on neuronal information encoding and energy efficiency. J Cereb Blood Flow Metab In press.
102. Christie P, Stroobandt D, (2000) The interpretation and application of Rent's rule. IEEE Journal of VLSI 8: 639-648.
103. Bassett DS, Greenfield DL, Meyer-Lindenberg A, Weinberger DR, Moore SW, et al. (2010) Efficient physical embedding of topologically complex information processing networks in brains and computer circuits. PLoS Comput Biol 6: e1000748 doi:10.1371/journal.pcbi.1000748.
104. Sengupta B (2011) Information encoding and energy consumption in single neuron models [PhD thesis]. Cambridge (United Kingdom): University of Cambridge.