Power consumption during neuronal computation

Proceedings of the IEEE

Volumn 102, Issue 5, 2014, Pages 738-750

  Sengupta, Biswa ^a   Stemmler, Martin B ^b  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

^b UNIVERSITY OF MUNICH   (Germany)

Author keywords

Biological information theory; biological neural networks; biological optimization; cellular biophysics; energy consumption; Energy efficiency

Indexed keywords

BRAIN COMPUTER INTERFACE; CELL SIGNALING; CELLULAR NEURAL NETWORKS; COMPUTATION THEORY; ELECTRIC POWER UTILIZATION; ENERGY EFFICIENCY; ENERGY UTILIZATION; INFORMATION THEORY; MEDICAL COMPUTING; NEURONS;

ARTIFICIAL COCHLEAS; BIOLOGICAL INFORMATION THEORIES; BIOLOGICAL NEURAL NETWORKS; BRAIN COMPUTER INTERFACES (BCIS); CELLULAR BIOPHYSICS; ENERGY CONSTRAINT; HUMAN NERVOUS SYSTEM; NEURONAL SIGNALING;

GREEN COMPUTING;

EID: 84900511114     PISSN: 00189219     EISSN: None     Source Type: Journal    
DOI: 10.1109/JPROC.2014.2307755     Document Type: Article

References (85)

1. C. Darwin The Origin of Species. Hertfordshire U.K.: Wordsworth Editions 1998.
2. N. Salthe Development and Evolution: Complexity and Change in Biology. Cambridge MA USA: MIT Press 2010.
3. H. Spencer Principles of Biology. London U.K.: Williams and Norgate 1864.
4. B. Sengupta M. B. Stemmler and K. J. Friston "Information and efficiency in the nervous system-A synthesis," PLoS Comput. Biol. vol. 9 no. 7 Jul. 2013 e1003157.
5. W. B. Levy and R. A. Baxter "Energy-efficient neuronal computation via quantal synaptic failures," J. Neurosci. vol. 22 no. 11 pp. 4746-4755 Jun. 2002.
6. C. S. Chan J. N. Guzman E. Ilijic J. N. Mercer C. Rick T. Tkatch G. E. Meredith and D. J. Surmeier "Rejuvenation protects neurons in mouse models of Parkinson's disease," Nature vol. 447 no. 7148 pp. 1081-1086 2007.
7. J. N. Guzman J. Sanchez-Padilla D. Wokosin J. Kondapalli E. Ilijic P. T. Schumacker and D. J. Surmeier "Oxidant stress evoked by pacemaking in dopaminergic neurons is attenuated by dj-1," Nature vol. 468 no. 7324 pp. 696-700 2010.
8. C. Mead and M. Ismail Analog VLSI Implementation of Neural Systems. New York NY USA: Springer-Verlag 1989.
9. R. Sarpeshkar Ultra Low Power Bioelectronics: Fundamentals Biomedical Applications Bio-Inspired Systems. Cambridge U.K.: Cambridge Univ. Press 2010.
10. B. Sengupta A. A. Faisal S. B. Laughlin and J. E. Niven "The effect of cell size and channel density on neuronal information encoding and energy efficiency," J. Cereb. Blood Flow Metab. vol. 33 no. 9 pp. 1465-1473 Sep. 2013.
11. H. Alle and J. R. P. Geiger "Combined analog and action potential coding in hippocampal mossy fibers," Science vol. 311 no. 5765 pp. 1290-1293 2006.
12. Y. Shu A. Hasenstaub A. Duque Y. Yu and D. A. McCormick "Modulation of intracortical synaptic potentials by presynaptic somatic membrane potential," Nature vol. 441 no. 7094 pp. 761-765 2006.
13. M. T. Wong-Riley "Cytochrome oxidase: An endogenous metabolic marker for neuronal activity," Trends Neurosci. vol. 12 no. 3 pp. 94-101 1989.
14. R. Sarpeshkar "Analog versus digital: Extrapolating from electronics to neurobiology," Neural Comput. vol. 10 no. 7 pp. 1601-1638 1998.
15. B. J. Hosticka "Performance comparison of analog and digital circuits," Proc. IEEE vol. 73 no. 1 pp. 25-29 Jan. 1985.
16. R. H. Walden "Analog-to-digital converter survey and analysis," IEEE J. Sel. Areas Commun. vol. 17 no. 4 pp. 539-550 Apr. 1999.
17. J. M. Bekkers G. B. Richerson and C. F. Stevens "Origin of variability in quantal size in cultured hippocampal neurons and hippocampal slices," Proc. Nat. Acad. Sci. USA vol. 87 no. 14 pp. 5359-5362 1990.
18. H. Korn and D. Faber "Quantal analysis and synaptic efficacy in the CNS," Trends Neurosci. vol. 14 pp. 439-445 1991.
19. P. G. Lillywhite and S. B. Laughlin "Transducer noise in a photoreceptor," Nature vol. 277 no. 5697 pp. 569-572 1979.
20. W. B. Levy and R. A. Baxter "Energy efficient neural codes," Neural Comput. vol. 8 no. 3 pp. 531-543 1996.
21. S. B. Laughlin "Energy as a constraint on the coding and processing of sensory information," Current Opinion Neurobiol. vol. 11 no. 4 pp. 475-480 2001.
22. J. E. Niven and S. B. Laughlin "Energy limitation as a selective pressure on the evolution of sensory systems," J. Exp. Biol. vol. 211 no. 11 pp. 1792-1804 2008.
23. H. Meuer E. Strohmaier J. Dongarra and H. Simon "Top500 Project," Nov. 2013. [Online]. Available: http://www.top500.org.
24. B. Sengupta S. B. Laughlin and J. E. Niven "Comparison of Langevin and Markov channel noise models for neuronal signal generation," Phys. Rev. E. Stat. Nonlinear Soft Matter Phys. vol. 81 2010 011918.
25. D. C. Gadsby and M. Nakao "Steady-state current-voltage relationship of the Na+-Ka pump in guinea pig ventricular myocytes," J. Gen. Physiol. vol. 94 pp. 511-537 1989.
26. D. Attwell and S. B. Laughlin "An energy budget for signaling in the grey matter of the brain," J. Cereb. Blood Flow Metab. vol. 21 no. 10 pp. 1133-1145 2001.
27. D. Clarke and L. Sokoloff Circulation and Energy Metabolism of the Brain. Philadelphia PA USA: Lippincott-Raven 1999 pp. 637-669.
28. A. L. Hodgkin and A. F. Huxley "A quantitative description of membrane current and its application to conduction and excitation in nerve," J. Physiol. vol. 117 no. 4 pp. 500-544 1952.
29. J. C. Skou "The identification of the sodium-pump as the membrane-bound Na+K+-ATPase: A commentary on 'the influence of some cations on an adenosine triphosphatase from peripheral nerves'," Biochim. Biophys. Acta vol. 1000 pp. 435-438 1989.
30. X. J. Wang and G. Buzsáki "Gamma oscillation by synaptic inhibition in a hippocampal interneuronal network model," J. Neurosci. vol. 16 no. 20 pp. 6402-6413 1996.
31. H. Alle A. Roth and J. R. Geiger "Energy-efficient action potentials in hippocampal mossy fibers," Science vol. 325 no. 5946 pp. 1405-1408 2009.
32. B. C. Carter and B. P. Bean "Sodium entry during action potentials of mammalian neurons: Incomplete inactivation and reduced metabolic efficiency in fast-spiking neurons," Neuron vol. 64 no. 6 pp. 898-909 2009.
33. A. Hasenstaub S. Otte E. Callaway and T. J. Sejnowski "Metabolic cost as a unifying principle governing neuronal biophysics," Proc. Nat. Acad. Sci. USA vol. 107 no. 27 pp. 12 329-12 334 2010.
34. M. Stemmler B. Sengupta S. B. Laughlin and J. E. Niven "Energetically optimal action potentials," in Advances in Neural Information Processing Systems. Cambridge MA USA: MIT Press 2012 pp. 1566-1574.
35. B. Naundorf F. Wolf and M. Volgushev "Unique features of action potential initiation in cortical neurons," Nature vol. 440 no. 7087 pp. 1060-1063 2006.
36. B. P. Bean "The action potential in mammalian central neurons," Nature Rev. Neurosci. vol. 8 no. 6 pp. 451-465 2007.
37. A. L. Hodgkin "The optimum density of sodium channels in an unmyelinated nerve," Philos. Trans. Roy. Soc. Lond. B vol. 270 pp. 297-300 1975.
38. B. Trattner C. M. Gravot B. Grothe and L. Kunz "Metabolic maturation of auditory neurones in the superior olivary complex," PloS One vol. 8 no. 6 2013 DOI: 10.1371/journal.pone.0067351.
39. P. L. Pedersen and E. Carafoli "Ion motive ATPases. II. Energy coupling and work output," Trends Biochem. Sci. vol. 12 pp. 186-189 1987.
40. R. C. Thomas. (2009). The plasma membrane calcium ATPase (PMCA) of neurones is electroneutral and exchanges 2 H+ for each Ca2+ or Ba2+ ion extruded. J. Physiol. [Online]. 587(2) pp. 315-327. Available: http://jp.physoc.org/content/587/2/315. abstract
41. G. Gamba. (2005). Molecular physiology and pathophysiology of electroneutral cation-chloride cotransporters. Physiol. Rev. [Online]. 85(2) pp. 423-493. Available: http://physrev.physiology.org/content/85/2/423.abstract
42. D. Attwell and A. Gibb "Neuroenergetics and the kinetic design of excitatory synapses," Nature Rev. Neurosci. vol. 6 no. 11 pp. 841-849 2005.
43. C. Howarth C. M. Peppiatt-Wildman and D. Attwell "The energy use associated with neural computation in the cerebellum," J. Cereb. Blood Flow Metab. vol. 30 no. 2 pp. 403-414 2009.
44. B. A. Olshausen and D. J. Field "Sparse coding with an overcomplete basis set: A strategy employed by v1" Vis. Res. vol. 37 no. 23 pp. 3311-3325 1997.
45. S. B. Laughlin and T. J. Sejnowski "Communication in neuronal networks," Science vol. 301 no. 5641 pp. 1870-1874 2003.
46. A. Mathis A. V. Herz and M. B. Stemmler "Resolution of nested neuronal representations can be exponential in the number of neurons," Phys. Rev. Lett. vol. 109 no. 1 2012 018103.
47. Z. F. Mainen and T. J. Sejnowski "Reliability of spike encoding in neocortical neurons," Science vol. 268 no. 5216 pp. 1503-1506 1995.
48. J. W. Pillow L. Paninski V. J. Uzzell E. P. Simoncelli and E. J. Chichilnisky. (2005). Prediction and decoding of retinal ganglion cell responses with a probabilistic spiking model. J. Neurosci. [Online]. 25(47) pp. 11003-11013. Available: http://www. jneurosci.org/content/25/47/11003.abstract
49. M. H. A. Davis "Capacity and cutoff rate for Poisson-type channels," IEEE Trans. Inf. Theory vol. IT-26 no. 6 pp. 710-715 Nov. 1980.
50. M. Bethge D. Rotermund and K. Pawelzik "Second order phase transition in neural rate coding: Binary encoding is optimal for rapid signal transmission," Phys. Rev. Lett. vol. 90 no. 8 2003 088104.
51. L. Kostal P. Lansky and M. D. McDonnell "Metabolic cost of neuronal information in an empirical stimulus-response model," Biol. Cybern. vol. 107 no. 3 pp. 355-365 2013.
52. F. Hoppensteadt and E. M. Izhikevich Weakly Connected Neural Networks. New York NY USA: Springer-Verlag 1997 ser. Applied Mathematical Sciences.
53. J.-H. Schleimer and M. Stemmler "Coding of information in limit cycle oscillators," Phys. Rev. Lett. vol. 103 no. 24 2009 248105.
54. M. Juusola and A. S. French "The efficiency of sensory information coding by mechanoreceptor neurons," Neuron vol. 18 no. 6 pp. 959-968 1997.
55. S. B. Laughlin R. R. de Ruyter van Steveninck and J. C. Anderson "The metabolic cost of neural information," Nature Neurosci. vol. 1 no. 1 pp. 36-41 1998.
56. E. R. Gamble and R. A. DiCaprio "Nonspiking and spiking proprioceptors in the crab: White noise analysis of spiking cb-chordotonal organ afferents," J. Neurophysiol. vol. 89 no. 4 pp. 1815-1825 2003.
57. E. Schneidman B. Freedman and I. Segev "Ion channel stochasticity may be critical in determining the reliability and precision of spike timing," Neural Comput. vol. 10 no. 7 pp. 1679-1703 1998.
58. P. Steinmetz A. Manwani and M. Koch "Sub-threshold voltage noise due to channel fluctuations in active neuronal membranes," J. Comput. Neurosci. vol. 9 no. 2 pp. 133-148 1999.
59. S. Laughlin "Neural integration in first optic neuropil of dragonflies. I. Signal amplification in dark-adapted second-order neurons," J. Compar. Physiol. vol. 84 no. 4 pp. 335-355 1973.
60. A. Roberts and B. M. H. Bush Neurons Without Impulses: Their Significance for Vertebrate and Invertebrate Nervous Systems. New York NY USA: Cambridge Univ. Press 1981.
61. S. Curti L. Gómez R. Budelli and A. E. Pereda "Subthreshold sodium current underlies essential functional specializations at primary auditory afferents," J. Neurophysiol. vol. 99 no. 4 pp. 1683-1699 2008.
62. G. Gonzalez-Burgos and G. Barrionuevo "Voltage-gated sodium channels shape subthreshold EPSPs in layer 5 pyramidal neurons from rat prefrontal cortex," J. Neurophysiol. vol. 86 no. 4 pp. 1671-1684 2001.
63. B. Sengupta S. B. Laughlin and J. E. Niven "Consequences of converting graded to action potentials upon neural information coding and energy efficiency," PLoS Comput. Biol. vol. 10 no. 1 Jan. 2014 e1003439.
64. A. A. Lazar and L. T. Tóth "Perfect recovery and sensitivity analysis of time encoded bandlimited signals," IEEE Trans. Circuits Systems I Reg. Papers vol. 51 no. 10 pp. 2060-2073 Oct. 2004.
65. A. J. Kim and A. A. Lazar "Recovery of stimuli encoded with a Hodgkin-Huxley neuron using conditional PRCS," in Phase Response Curves in Neuroscience. New York NY USA: Springer-Verlag 2012 pp. 257-277.
66. T. Weiss Cellular Biophysics Vol. 2: Electrical Properties. Cambridge MA USA: Bradford Books 1996.
67. C. Koch Biophysics of Computation: Information Processing in Single Neurons. Oxford U.K.: Oxford Univ. Press Nov. 1998.
68. S. Jezernik and M. Morari "Energy-optimal electrical excitation of nerve fibers," IEEE Trans. Biomed. Eng. vol. 52 no. 4 pp. 740-743 Apr. 2005.
69. D. B. Forger D. Paydarfar and J. R. Clay "Optimal stimulus shapes for neuronal excitation," PLoS Comput. Biol. vol. 7 no. 7 Jul. 2011 e1002089.
70. J. R. Clay D. B. Forger and D. Paydarfar. (2012). Ionic mechanism underlying optimal stimuli for neuronal excitation: Role of Na+ channel inactivation. PLoS ONE [Online]. 7(9). Available: http://dx.doi.org/10. 1371e45983
71. B. W. Mel and J. Schiller "On the fight between excitation and inhibition: Location is everything," Sci. STKE vol. 2004 no. 250 2004 PE44.
72. M. N. Shadlen and W. T. Newsome "The variable discharge of cortical neurons: Implications for connectivity computation information coding," J. Neurosci. vol. 18 no. 10 pp. 3870-3896 1998.
73. R. W. Berg A. Alaburda and J. Hounsgaard "Balanced inhibition and excitation drive spike activity in spinal half-centers," Science vol. 315 no. 5810 pp. 390-393 2007.
74. J. A. Adell A. Lekuona and Y. Yu "Sharp bounds on the entropy of the Poisson law and related quantities," IEEE Trans. Inf. Theory vol. 56 no. 5 pp. 2299-2306 May 2010.
75. B. Sengupta S. B. Laughlin and J. E. Niven "Balanced excitatory and inhibitory synaptic currents promote efficient coding and metabolic efficiency," PLoS Comput. Biol. vol. 9 no. 10 Oct. 2013 e1003263.
76. M. N. Shadlen and W. T. Newsome "Noise neural codes and cortical organization," Current Opinion Neurobiol. vol. 4 no. 4 pp. 569-579 1994.
77. M. Carandini and D. Ferster "A tonic hyperpolarization underlying contrast adaptation in cat visual cortex," Science vol. 276 no. 5314 pp. 949-952 1997.
78. W. W. Lytton and T. J. Sejnowski "Simulations of cortical pyramidal neurons synchronized by inhibitory interneurons," J. Neurophysiol. vol. 66 no. 3 pp. 1059-1079 1991.
79. B. K. Murphy and K. D. Miller "Balanced amplification: A new mechanism of selective amplification of neural activity patterns," Neuron vol. 61 no. 4 pp. 635-648 2009.
80. B. Sengupta M. Stemmler S. B. Laughlin and J. E. Niven "Action potential energy efficiency varies among neuron types in vertebrates and invertebrates," PLoS Comput. Biol. vol. 6 2010 e1000840.
81. H. Barlow "Redundancy reduction revisited," Network Comput. Neural Syst. vol. 12 pp. 241-253 2001.
82. B. A. Olshausen and D. J. Field "Sparse coding of sensory inputs," Current Opinion Neurobiol. vol. 14 pp. 481-487 2004.
83. J. E. Lewis K. M. Gilmour M. J. Moorhead S. F. Perry and M. R. Markham. (2014). Action potential energetics at the organismal level reveal a trade-off in efficiency at high firing rates. J. Neurosci. [Online]. 34(1) pp. 197-201. Available: http://www. jneurosci.org/content/34/1/197.abstract
84. J. Moehlis E. Shea-Brown and H. Rabitz "Optimal inputs for phase models of spiking neurons," J. Comput. Nonlinear Dyn. vol. 1 no. 4 pp. 358-367 2006.
85. J. P. Lasalle "Time optimal control systems," Proc. Nat. Acad. Sci. USA vol. 45 no. 4 pp. 573-577 1959.