A mathematical theory of energy efficient neural computation and communication

IEEE Transactions on Information Theory

Volumn 56, Issue 2, 2010, Pages 852-874

  Berger, Toby ^a   Levy, William B ^b  

^a University of Virginia   (United States)

^b UNIVERSITY OF VIRGINIA   (United States)

Author keywords

Beta distribution; Bits per joule (bpj); Bits per second (bps); Energy efficiency; Gamma distribution; Information rate; Integrate and fire neuron; Interspike interval; Poisson random measure; Timing code

Indexed keywords

BETA DISTRIBUTION; BETA DISTRIBUTIONS; GAMMA DISTRIBUTION; INFORMATION RATES; INTEGRATE-AND-FIRE NEURON; INTEGRATE-AND-FIRE NEURONS; INTER-SPIKE INTERVAL; POISSON RANDOM MEASURE;

COMPUTER SIMULATION; ENERGY EFFICIENCY; LIGHT MEASUREMENT; MATHEMATICAL MODELS; NEURAL NETWORKS; POISSON EQUATION; PROBABILITY DENSITY FUNCTION; TIME MEASUREMENT;

POISSON DISTRIBUTION;

EID: 77649307368     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIT.2009.2037089     Document Type: Article

References (26)

1. M. Abramowitz and I. A. Segun, Handbook of Mathematical Functions. New York: Dover Publications, 1965.
2. D. Attwell and S. B. Laughlin, "An energy budget for signaling in the grey matter of the brain," J. Cerebr. Blood Flow & Metabolism, vol. 21, pp. 1133-1145, 2001.
3. S. N. Baker and R. N. Lemon, "Precise spatiotemporal repeating patterns in monkey primary and supplementary motor areas occur at chance levels," J. Neurophysiol., vol. 84, pp. 1770-1780, 2000.
4. A. D. Barbour, L. Holst, and S. Janson, Poisson Approximiation. Oxford Studies in Probability. Oxford, U.K.: Oxford University Press, 1992.
5. W. Bialek, F. Rieke, R. de Ruyter van Steveninck, and D. Warland, "Reading a neural code," Science, vol. 252, no. 5014, pp. 1854-1857, Jun. 1991.
6. R. E. Blahut, Principles and Practice of Information Theory, Problem 5.15. Reading, MA: Addison Wesley, 1987, p. 198.
7. T. Cover and J. Thomas, Elements of Information Theory, 2nd ed. Hoboken, NJ: Wiley, 2006.
8. R. G. Gallager, Information Theory and Reliable Communication. New York: Wiley, 1968.
9. W. Gerstner and W. M. Kistler, Spiking Neuron Models: Single Neurons, Populations, Plasticity. Cambridge, U.K.: Cambridge University Press, 2002.
10. J. A. Gubner, Probability and Random Processes for Electrical and Computer Engineers. Cambridge, U.K.: Cambridge University Press, 2006, p. 557.
11. A. L. Hodgkin and A. F. Huxley, "A quantitative description of membrane current and its application to conduction and excitation in nerve," J. Physiol., vol. 117, no. 4, pp. 500-544, Aug. 1952.
12. K. Ikeda, "Information geometry of interspike intervals in spiking neurons," Neural Computat., vol. 17, pp. 2719-2735.
13. S. Ikeda and J. H. Manton, "Capacity of a single spiking neuron channel," Neural Computat., vol. 21, pp. 74-1748, Jun. 2009.
14. M. Jimbo and K. Kunisawa, "An iteration method for calculating the relative capacity," Inf. Contr., vol. 43, pp. 216-223, 1979.
15. W. B Levy and R. A. Baxter, "Energy efficient neural codes," Neural Computat., vol. 8, pp. 531-543, 1996.
16. W. S. McCulloch and W. Pitts, "A logical calculus of the ideas immanent in nervous activity," Bull. Math. Biophys., vol. 5, pp. 115-133, 1943.
17. J. E. Niven and S. B. Laughlin, "Energy limitation as a selective pressure on the evolution of sensory systems," J. Exper. Biol., vol. 211, pp. 1792-1804, May 2008.
18. E. Parzen, Stochastic Processes. San Francisco, CA: Holden-Day, 1962.
19. M. S. Pinsker, Information and Information Stability of Randcom Variables and Processes. Moscow, Russia: Izd. Akad. Nauk SSSR, 1960.
20. K. Sato, Levy Processes and Infinitely Divisible Distributions. Cambridge, U.K.: Cambridge University Press, 1999.
21. C. E. Shannon, "An Algebra for Theoretical Genetics," Ph.D. dissertation, Department of Mathematics, Massachusetts Institute of Technology, Cambridge, MA, 1940.
22. C. E. Shannon, "A mathematical theory of communication," Bell Syst. Tech. J., vol. 27, pt. I, pp. 623-656, Jul. 1948.
23. S. Shinomoto, K. Shima, and J. Tanji, "Differences in spiking patterns among cortical neurons," Neural Computat., vol. 15, pp. 2832-2842, 2003.
24. S. Shinomoto, Y. Miyazaki, H. Tamura, and I. Fujita, "Regional and laminar differences in in vivo firing patterns of primate cortical neurons," J. Neurophysiol., vol. 94, pp. 567-575, 2005.
25. P. Suksompong and T. Berger, "Capacity analysis for integrate-and-fire neurons with descending action potential thresholds," IEEE Inf. Theory, vol. 56, no. 2, pp. 839-852, Feb. 2010.
26. R. W. Yeung, Information Theory and Network Coding. New York, NY: Springer, 2008.