Capacity and energy cost of information in biological and silicon photoreceptors

Proceedings of the IEEE

Volumn 89, Issue 7, 2001, Pages 1052-1064

  Abshire, Pamela ^a   Andreou, Andreas G ^a  

^a Johns Hopkins University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0003195216     PISSN: 00189219     EISSN: None     Source Type: Journal    
DOI: 10.1109/5.939817     Document Type: Article

References (62)

1. W. Bialek, "Physical limits to sensation aod perception," Ann. Rev. Biophys. Biophys. Chem., vol. 16. pp. 455-478. 1987.
2. D. Hubel. Eve, Brain and Vision. New York: Scientific American Library, 1988.
3. P. Churchldnd and T. Sejnowski, The Computational Brain. Cambridge, MA: MIT Press, 1991.
4. L. Aiello and P. Wheeler, "The expensive-tissue hypothesis," Curr. Anthropol, vol. 36, pp. i99-20I, Apr. 1995.
5. [5" A. Hakeem, G. Sandovai, M. Jones, and J. Allman, Brain and Life Span in Primates, 4th ed. Xew York: Academic, 1996, ch. 5.
6. [61 B. Hille, Ionic Channels of Excisable Membranes, 2nd ed. Sunderland, MA: Sinaaer, 1992.
7. [71 C. A. Mead, Analog VLSI and Xeural Systems. Reading, MA: Ad- d:son-Wesley: 1989.
8. C. Koch. "Seeing chips: Analog VLSI circuits for computer vision," Neural Comput., vol. 1, pp. 184-200, 1989.
9. C. A. Mead, "Neuromorphic electronic systems," Proc. IEEE, vol. 78, pp. 1629-1635, Oct 1990.
10. R. Sharpeshkar, J. Kramer, G. Indiveri, and C. Koch, "Analog VLSI architectures for motion processing: From fundamental limits to system applications," Proc. IEEE. vol. 84, pp. 969-987, July 1996.
11. E. Possum, "CMOS image sensors: Electronic camera-on-a-chip," IEEE Trans. Electron Devices, ml. 44, no. 10, pp. 1689-1698, 1997.
12. T. Delbrtick and C. A. Mead, "Analog VLSI photutransduction by continuous-time, adaptive, logarithmic photoreceptor circuits,", Called! CNS Mem. 30, 1996.
13. B. Vittoz, "Present and future industrial applications of bio-inspired VLSI systems," in Proc. 1999 Microneuron Conf., Los Alamitos, C A, 1999. pp. 2-11.
14. [141 A. C. Andreou and P. Abshire, "Sensory communication microsystems: analysis and synthesis framework," Dept. of Elect, and Comput. Eng., Johns Hopkins Univ., Baltimore, MD, JHU-ECE-01/01,2001.
15. C. Shannon, "A mathematical theory of communication," Bell Syst. Tech. J., vol. 27, pp. 379-23, Oct. 1948.
16. J. Atick and N. Redlich, "What does the retina know about natural scenes," Neural Comput., vol. 4, no. 2, pp. 196-210, 1992.
17. J. H. van Hateren, "A theory of maximizing sensory information," biol. Cybern., vol. 68, pp. 23-29, 1992.
18. K. Boahen, "Retinomorphic vision systems: Reverse engineering the vertebrate retina," Ph.D. dissertation. California Inst, Technology, 1997.
19. P. Furth and A. Andreou, "A design framework for low power analog filter banks," IEEE Trans. Circuits Syst. I, vol. 42. pp. 966-971, Nov. 1995.
20. F. Huck, C. Fales, and Z. Rahman, "An information theory of visual communication," Philos. Trans. R. Soc. London A, vol. 354, pp. 2193-2248, 1996.
21. [2 i ] C. Fales, F. Huek, R. Alter-Gartenberg, and Z. Rahman, "Image gathering and digital restoration," Philos. Trans. R. Soc. London A, vol. 354, pp. 2249-2287, 1996.
22. T. M. Cover and J. A. Thomas, Elements of Information Theory. New York: Wiley, 1991.
23. C. E. Shannon, "Communication in the presence of noise," Proc. IRE, vol. 37, pp. 10-21, Jan 1949.
24. [24; M. Juusola, R. O. Uusitalo, and M. Weckström, "Transfer of graded potentials at the photoreceptor-interneurun synapse," J. Gen. Physioi, vol. 105, pp. 117-148, 1995.
25. R. R. de Ruyter van Steveninck and S. B. Laughlin, "The rate of information transfer atgraded-potentia! synapses," Nature, vol. 379, pp. 642-645, Feb. 1996.
26. [26j S. Chyb, P. Raghu, and R. C. Hardie, "Polyunsaturated fatty acids activate the Drosophila light-sensitive channels TRP and TRPL," Mature, vol. 397, pp. 255-259, Jan. 1999.
27. F. Wong and B. W. Knight, "Adapting-bump model for eccentric cells of LiH'Mlus.;' J. Gen. Physioi, vol. 76, pp. 539-557, Nov. 1980.
28. F. Wong, B. W. Knight, and F. A. Dodge, "Dispersion of latencies in pnotoreeeplors of Limuliis and the adapting-bump model," J. Gen. Physiot., vol. 76, pp. 517-537, Nov. 1980.
29. Adapting-bump model for ventral photoreceptors of L/m.'î/ns," J. Gen Physio!., vol. 79, pp. 1089-1113, June 1982.
30. [301 J. H. van Hateren, "Electrical coupling of neuro-ommatidial photoreceptor cells in the blowfly," / Cotnp. Physiot. A, vol. 158. pp. 795-S'll, 1986.
31. [31 ] P. Abshire and A. G. Andreou, "Relating information capacity to a biophysical model of the biowfly retina," Dept. of Elect, aac Comput. Eng., Johns Hopkins Lniv., Baltimore, MD, JHU/ECE-9S-13, 1998.
32. "Relating information capacity to a biophysical model for biofly retina," in Proc, 1999 "in!. Joint Conf. .\'euml Nerv.'orks, Washington, DC, July 1999.
33. "Information capacity of the blowfly retina," in Proc. 33rd Conf. Information Sciences und Systems, vol. 2. Baltimore, MD, Mar. 1999.
34. "A communication channel model for information transmission in the blowfly photoreceptor." Biosyst. J.. to be published.
35. M. Juusola, E. Kouvalainen, M. Järvitehto, and M. Wecksiröm, "Contrast gain, signal-to-noise ratio, and linearity in light-adapted blowfly photoreceptors," J. Get:. Physic!., vol. 104. pp. 593-621, Sept. 1994.
36. VI. .(uusola and M. Weckström, "Band-pass filtering by vollage-dependent membrane in an insect photoreceptor," Neurose:. Lett., vol. 'l54, pp. 84-88, 1993.
37. S. B. Laughlin, "A simple coding procedure enhances a neurone's information capacity," Zeitschrift für Naturforschung, vol. 36c. pp. 910-912, 1981.
38. S. Laughlin, R. de Ruyter van Steveninck, and .1. Anderson, "The metabolic cost of neural information," future Neurose!., vol. 1, pp. 36-41, May 1998.
39. A. G. Andreou and P. Furth, "An information theoretic framework for comparing the bit-energy of signal representations at the circuit level," in Low-Voltage/Low-Power Integrated Circuits and Systems, E. Sanchez-Sinencio and A. G. Andreou, Eds. Piscataway, NJ: IEEE Press, 1998, ch 8.
40. H. B. Barlow. "Unsupervised learning," Neural Comput., vol. 1, no. 3, pp. 295-511, 1989.
41. F. Attneave, "Some informational aspects of visual perception," Psych. Rev., vol. 61, no. 3, pp. 183-193, 1954.
42. H. B. Barlow, "Possible principles underlying the transformation of sensor}' messages," in Sensory Communication, W. A. Rosenblith, Ed. Cambridge, MA: MIT Press, 1961, pp. 217-234.
43. J. J. Atick, "Could information theory provide an ecological theory of sensory processing?," Network 3, pp. 213-251, 1992.
44. R. Linsker, "From basic network principles to neural architecture: Emergence of spatial-opponent cells, Emergence of orientation-selective cells, and Emergence of orientation columns," Proc. Mat. Acad. Sei. USA, vol. 83, 1986.
45. S. B. Laughlin, "Matching coding, circuits, cells, and molecules to signals: General principles of retina design in the fly's eye," Progr. Retinal Eye Res., vol. 13, pp. 165-196, 1994.
46. D. M. MacKay and W. S. McCulloch, "The limiting information capacity of a neuronal link," Bull. Math. Phvs.. vol. 14, pp. 127-135, 1952.
47. R. B. Stein, "The information capacity of nerve cells using a frequency code," Biophys. J.. vol. 1. pp. 797-826, 1967.
48. W. B. Levy and R. A. Baxter, "Energy efficient neural codes," Neural Comput., vol. 8, pp. 531-543, 1996.
49. [491 R. EckJiorn and B. Pope!, "Rigorous and extended application of information theory to the afferent visual system of the cat. I. Basic concepts, and II. Experimental results,'' Kybernetik, vol. 16 and 17, 1974.
50. [501 F. E. Theunissen and J. P. Miller, "Representation of sensory information in the cricket cereal sensory system. II. Information theoretic calculation of system accuracy and optimal tuning-curve widths of four primär)- intemeurons," J. Neurophysiol, vol. 66, pp. 1690-1703, Nov. 1991.
51. F. Rieke, D. Wanand, R. de Ruyter van Steveninck, and W. Bialek, Spikes: Exploring the Neural Code. Cambridge, MA: MIT Press,1997.
52. G. T. Buracas, A. M. Zador, M. R. DeWeese, andT. D. Albright, "Efficient discrimination of temporal patterns by motion-sensitive neurons in primate visual cortex," .\mtron, vol. 20, pp. 959-969, May 1998.
53. (53] A. Manwani and C, Koch. "Detecting and estimating signals in noisy cable structures: !. Neuronal noise sources, and II. Information theoretical analysis," Neural Conipu:., vol. 11, pp. 1797-1873, Nov 1999.
54. R. Landauer, "Irreversibility and heat generation in the computing process," IBM J. Res. Develop., vol. 5, pp. 1S3-191, Jan. 1961.
55. [551 C. Mead and L. Con way. Introduction to VLSI Systems. Reading, MA: Addison-Wesle), 1980.
56. B. Hosticka, "Performance comparison of analog and digital circuits," Proc. IEEE, vol. 73, pp. 25-29, Jan. 1985.
57. [57 ; P. Funh and A. Andreou, "Comparing the bit-energy of continuous and discrete signai representations," in Proc. 4th Workshop Physics end Computation ' PhysComp96), Boston, MA, Nov. 1996, pp. 127-133.
58. G. J. Chaitin, "Information theoretic computational complexity," IEEE Trans, inform. Theory, vol. IT-20, pp. 10-15, Jan. 1974.
59. Y. Abu-Mostafa, "Complexity of information extraction," Ph.D. dissertation, California Inst. Tecnnology. 1983.
60. R. V. MarculescLi and M. Pedram, "Information theoretic measures of energy consumption at register transfer level," in Proc. ACM/IEEE ha. Symp. Lu Power Design, 1995.
61. J. Tierno, "An energy-complexity model for VLSI computation," Ph.D. dissertation, California Inst. Technology, 1995.
62. N. R. Shanbhag, "A mathematical basis for power-reduction in digital VLSI systems," IEEE Trans. Circuits Syif., vol. 44, pp. 935-951, 1997.