Could information theory provide an ecological theory of sensory processing?

Network: Computation in Neural Systems

Volumn 22, Issue 1-4, 2011, Pages 4-44

  Atick, Joseph J ^a  

^a INSTITUTE FOR ADVANCED STUDY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMAL; ARTIFICIAL NEURAL NETWORK; ECOLOGY; HUMAN; INFORMATION SCIENCE; METHODOLOGY; NERVE TRACT; PHYSIOLOGY; REVIEW;

ANIMALS; ECOLOGY; HUMANS; INFORMATION THEORY; NEURAL NETWORKS (COMPUTER); NEURAL PATHWAYS;

EID: 82955240925     PISSN: 0954898X     EISSN: 13616536     Source Type: Journal    
DOI: 10.3109/0954898X.2011.638888     Document Type: Review

References (67)

1. Atick JJ, Redlich AN. 1990a. Towards a theory of early visual processing. Neural Computation 2:308-320.
2. Atick JJ and Redlich AN. 1990b. Quantitative tests of a theory of retinal processing: Contrast sensitivity curves Report Inst for Advanced Study 1ASSNS-HEP-90/51, submitted for publication.
3. Atick JJ, Redlich AN. 1992a. What does the retina know about natural scenes? Neural Computation 4:196-210.
4. Atick JJ and Redlich AN. 1992b. Convergent algorithm for sensory receptive field development Report Inst for Advanced Study IASSNS-HEP-91/80, submitted for publication.
5. Atick JJ, Li Z and Redtich AN. 1990. Color coding and its interaction with spatiotemporal processing in the retina Report Inst for Advanced Study IASSNS-HEP-90/75.
6. Atick JJ, Li Z and Redtich AN. 1991. Understanding retinal color coding from first principles Report Inst for Advanced Study IASSNS-HEP-91/1 (1992 Neural Computation in press).
7. Atick JJ, Li Z and Redtich AN. 1992. What does post-adaptation color appearance reveal about cortical color representation? Report Inst for Advanced Study IASSNS-HEP-92/7, submitted for publication.
8. Attneave F. 1954. Some informational aspects of visual perception. Psychol Rev 61:183-193.
9. Barlow HB. 1961. Possiple principles underlying the transformation of sensory messages. In: Roscnblith WA, editor. Sensory Communication. Cambridge, MA: MIT Press.
10. Barlow HB. 1985. Perception: What quantitative laws govern the acquisition of knowledge from the senses? In: Coen CW, editor. Functions of the Brain. Oxford: Clarendon.
11. Barlow HB. 1989. Unsupervised learning. Neural Computation 1:295-311.
12. Barlow HB, Hawken M, Kaushal TP, Parker AJ. 1987. Human contrast discrimination and the contrast discrimination of corticai neurons. J Opt Soc Am A 4:2366-2371.
13. Barlow HB, Foldiak P. 1989. The Computing Neuron Reading, MA: Addison-Wesley.
14. Barlow HB, Kaushal TP, Mitchison GJ. 1989. Finding minimum entropy codes. Neural Computation 1:412-423.
15. Barnard GA. 1955. Statistical calculations of word entropies for four western languages. IRE Trans Inform Theory 1T-1:49-53.
16. Bialek W. 1990. Theoretical physics meets experimental neurobiology. In: Jen E, editor. Lectures in Complex Systems (SFJ Studies in the Sciences of Complexity, Lecture vol II). Menlo Park, CA: Addison-Wesley.
17. Bialek W, Rieke F, de Ruyter van Steveninck RR, Warland D. 1991. Reading a neural code. Science 252:1854-1857.
18. Bialek W, Ruderman DL, Zee A. 1991. Optimal sampling of natural images: A design principle for the visual system? In: Lippmann RP, Moody JE, Touretzky DS, editors. Advances in Neural Information Processing Systems. Vol. 3. San Mateo, CA: Morgan Kaufman.
19. Buchsbaum G, Gottschalk A. 1983. Trichromacy, opponent colours coding and optimum colour information transmission in the retina. Proc R Soc Land B 220:89-113.
20. Campbell FW, Gubisch RW. 1966. Optical quality of the human eye. J. Physiol. 186:558-578.
21. Davson H. 1980. Physiology of the Eye London: Academic.
22. Daw NW. 1968. Colour-coded ganglion celts in the goldfish retina: Extension of their receptive fields by means of new stimuli. J Physiol 197:567-592.
23. De Monasterio FM, McCrane EP, Newlander JK, Shein SJ. 1985. Density profiles of blue-sensitive cones along the horizontal meridian of macaque retina. Invest. Opthalmol Vis Sci 26:289-302.
24. Derrington AM, Krauskopf J, Lennie P. 1984. Chromatic mechanisms in lateral geniculate nucleus of macaque. J. Physiol. 357:241-265.
25. De Valois KL, Morgan H, Snodderly DM. 1974. Psychophysical studies of monkey vision: III spatial luminance contrast sensitivity tests of macaque and human observers. Vision Res. 14:75-81.
26. Enroth-Cugell C, Robson JG. 1966. The contrast sensitivity of retinal ganglion cells of the cat. J Physiol 187:517-552.
27. Field DJ. 1987. Relations between the statistics of natural images and the response properties of cortical cells. J Opt Soc Am A 4:2379-2394.
28. Field DJ. 1989. What the statistics of natural images tell us about visual coding Human Vision, Visual Processing and Digital Display (Proc SPIE 1077) pp 269-276.
29. Gallager RG. 1968. Information Theory and Reliable Communication. New York: Wiley.
30. Geman S, Geman D. 1984. Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images. IEEE Trans Pattern Anal Machine Intel PAMI-6:721-741.
31. Goodall MC. 1960. Performance of stochastic net. Nature 185:557-558.
32. Gouriet GG. 1952. A method of measuring television picture detail. Electron Eng 24:308.
33. Harrison GW. 1952. Experiments with linear prediction in television. Bell System Tech J 31:764.
34. Hentschel HG, Barlow HB. 1991. Minimum-entropy coding with Hopfield networks. Network 2:135-148.
35. Hinton GE, Sejnowski TJ. 1983. Optimal perceptual inference Proc IEEE Conf Computer Vision and Pattern Recognition (Washington, DC) (Piscataway, NJ: IEEE) pp 448-453.
36. Jacobson H. 1951. The informal capacity of the human eye. Science 113:292-293.
37. Kelly DH. 1972. Adaptation effects on spatio-temporal sine-wave thresholds. Vision Res 12:89-101.
38. Kersten D. 1990. Statistical limits to image understanding. In: Blakemore C, editor. Vision: Coding and Efficiency. Cambridge: Cambridge University Press.
39. Kretzmer ER. 1952. Statistics of television signals. Bell System Tech J 31:751-763.
40. Kornhuber HH. 1973. Neural control of input into long term memory: Limbic system and amnestic syndrome in man. In: Zippel HP, editor. Memory and Transfer of Information. New York: Plenum.
41. Laughlin SB. 1981. A simple coding procedure enhances a neuron's information capacity. Z Naturf 36c:910-2.
42. Laughlin SB. 1987. Form and function in retinal processing. Trends Neurosci 10:478-483.
43. Laughlin SB. 1989. Coding efficiency and design in visual processing. In: Stavenga DG, Hardie RC, editors. Facets of Vision. Berlin: Springer.
44. Linsker R. 1988. Self-organization in a perceptual network. Computer 21 (March 1988):105-117.
45. Linsker R. 1989a. An application of the principle of maximum information preservation to linear systems. In: Touretzky DS, editor. Advances in Neural Information Processing Systems. Vol. 1. San Mateo, CA: Morgan Kaufman. pp 186-194.
46. Linsker R. 1989b. How to generate ordered maps by maximizing the mutual information between input and output signals. Neural Computation 1:402-411.
47. Lythgoe JN. 1979. The Ecology of Vision Oxford: Oxford University Press.
48. Mullen KT. 1985. The contrast sensitivity of human colour vision to red-green and blue-yellow chromatic gratings. J Physio 359:381-400.
49. Papoulis A. 1984. Probability, Random Variables, and Stochastic Processes New York: McGraw-Hill.
50. Pearlmutter BA, Hinton GE. 1986. G-maximization: An unsupervised learning procedure for discovering regularities. In: Denker JS, editor. Neural Networks for Computing (AIP Conf Proc 151). New York: AIP.
51. Pratt F. 1942. Secret and Urgent New York: Blue Ribbon Books.
52. Redlich AN. 1991. Redundancy reduction as a strategy for unsupervised learning Report Inst for Advanced Study IASSNS-HEP-91/87.
53. Sehreiber WF. 1956. The measurement of third order probability distributions of television signals. IRE Trans Inform Theory IT-2:94-105.
54. Shannon CE. 1951. Prediction and entropy of printed English. Bell System Tech J 30:50-64.
55. Shannon CE, Weeaver W. 1949. The Mathematical Theory of Communication. Urbana, IL: University of Illinois Press.
56. Shapley R, Enroth-Cugell C. 1984. Visual adaptation and retinal gain controls. Prog Retinal Research 3:263-346.
57. Shaw SR. 1984. Early visual processing in insects. J Exp Biol 112:225-51.
58. Srinivisan MV, Laughlin SB, Dubs A. 1982. Predictive coding: A fresh view of inhibition in the retina. Proc R Soc Land B 216:427-59.
59. Sterling P. 1990. Retina. In: Shepherd G, editor. The Synoptic Organization of the Brain. Oxford: Oxford University Press.
60. Sziklai G. 1956. Some studies in the speed of visual perception. IRE Trans Inform Theory IT-2:125-8.
61. Uttley AM. 1979. Information Transmission in the Nervous System. London: Academic.
62. Van Essen DC, Anderson CH. 1988. Information processing strategies and pathways in the primate retina and visual cortex. Introduction to Neural and Electronic Networks. Orlando, FL: Academic.
63. Van Essen DC, Olshausen B, Anderson CH, Gallant JL. 1991. Pattern recognition, attention, and information bottlenecks in the primate visual system Conf on Visual Information Processing: From Neurons to Chips (SPIE Proc 1473).
64. Van Nes FL, Bouman MA. 1967. Spatial modultion transfer in the human eye. J Opt Soc Am 57:401-6.
65. Warland D, Landolfa MA, Miller JP, Bialek W. 1992. Reading between the spikes in the cercel filiform hair receptors of the cricket. In: Eeckman F, editor. Analysis and Modeling of Neural Sytems. Norwell, MA: Kluwer.
66. Watanabe S. 1981. Pattern recognition as a quest for minimum entropy. Pattern Recognition 13:381-387.
67. Watanabe S. 1985. Pattern Recognition: Human and Mechanical. New York: Wiley.