Efficient representation as a design principle for neural coding and computation

IEEE International Symposium on Information Theory - Proceedings

Volumn , Issue , 2006, Pages 659-663

  Bialek, William ^a   De Ruyter Van Steveninck, Rob R ^b   Tishby, Naftali ^c  

^a PRINCETON UNIVERSITY   (United States)

^b INDIANA UNIVERSITY   (United States)

^c HEBREW UNIVERSITY OF JERUSALEM   (Israel)

Author keywords

[No Author keywords available]

Indexed keywords

MODEL SYSTEM; NEURAL CODING;

CHANNEL CODING; COMPUTATION THEORY; INFORMATION RETRIEVAL; OPTIMIZATION;

NEURAL NETWORKS;

EID: 39049143402     PISSN: 21578101     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ISIT.2006.261867     Document Type: Conference Paper

References (23)

1. CE Shannon, A mathematical theory of communication, Bell Syst. Tech. J., vol. 27, pt. I, pp. 379-423, 1948; pt. II, pp. 623-656, 1948.
2. F Attneave, Some informational aspects of visual perception. Psych Rev 61, 183-193 (1954).
3. HB Barlow, Sensory mechanisms, the reduction of redundancy, and intelligence. In Proceedings of the Symposium on the Mechanization of Thought Processes, volume 2, DV Blake & AM Utlley, eds, pp 537-574 (HM Stationery Office, London, 1959).
4. HB Barlow, Possible principles underlying the transformation of sensory messages. In Sensory Communication, W Rosenblith, ed, pp 217-234 (MIT Press, Cambridge, 1961).
5. W Reichardt & T Poggio, Visual control of orientation behavior in the fly. Part I: A quantitative analysis. Q Rev Biophys 9, 311-375 (1976).
6. L G Bishop & D G Keehn Two types of neurones sensitive to motion in the optic lobe of the fly. Nature 212, 1374-1376 (1966).
7. K Hausen & C Wehrhahn, Microsurgical lesion of horizontal cells changes optomotor yaw responses in the blowfly Calliphora erythrocephala. Proc R Soc Lona B 219, 211-216 (1983).
8. F Rieke, D Warland, R de Ruyter van Steveninck & W Bialek Spikes: Exploring the Neural Code. (MIT Press, Cambridge, 1997).
9. SP Strong, R Koberle, RR de Ruyter van Steveninck & W Bialek, Entropy and information in neural spike trains. Phys Rev Lett 80, 197-200 (1998); cond-mat/9603127.
10. N Brenner, SP Strong, R Koberle, W Bialek & RR de Ruyter van Steveninck, Synergy in a neural code. Neural Comp 12, 1531-1552 (2000); physics/9902067.
11. E Schneidman, N Brenner, N Tishby, RR de Ruyter van Steveninck, & W Bialek, Universality and individuality in a neural code, in Advances in Neural Information Processing 13, TK Leen, TG Dietterich & V Tresp, eds, pp 159-165 (MIT Press, Cambridge, 2001); physics/0005043.
12. GD Lewen, W Bialek & RR de Ruyter van Steveninck, Neural coding of naturalistic motion stimuli. Network 12, 317-329 (2001); physics/0103088.
13. I Nemenman, W Bialek & R de Ruyter van Steveninck, Entropy and information in neural spike trains: Progress on the sampling problem. Phys Rev E 69, 056111 (2004); physics/0306063.
14. NIPS 2003 Workshop. Estimation of entropy and information of under-sampled probability distributions. http://nips.cc/Conferences/2003/ Workshops/#EstimationofEntropy.
15. N Brenner, W Bialek & R de Ruyter van Steveninck, Adaptive rescaling optimizes information transmission. Neuron 26, 695-702 (2000).
16. AL Fairhall, GD Lewen, W Bialek, & RR de Ruyter van Steveninck, Efficiency and ambiguity in an adaptive neural code. Nature 412, 787-792 (2001).
17. E Dekel & U Alon, Optimality and evolutionary tuning of the expression level of a protein. Nature 436, 588-592 (2005).
18. SB Laughlin, RR de Ruyter van Steveninck & JC Anderson, The metabolic cost of neural information. Nature Neurosci 1, 36-41 (1998).
19. V Balasubramanian, D Kimber & MJ Berry II, Metabolically efficient information processing. Neural Comp 13, 799-815(2001).
20. W Bialek, I Nemenman & N Tishby, Predictability, complexity and learning. Neural Comp 13, 2409-2463 (2001); physics/0007070.
21. N Tishby, FC Pereira & W Bialek, The information bottleneck method. In Proceedings of the 37th Annual Allerton Conference on Communication, Control and Computing, B Hajek & RS Sreenivas, eds, pp 368-377 (University of Illinois, 1999); physics/0004057.
22. G Chechik, A Globerson, N Tishby & Y Weiss, Information bottleneck for Gaussian variables. J Machine Learn Res 6, 165-188 (2005).
23. N Wiener, . Extrapolation, Interpolation, and Smoothing of Stationary Time Series (Wiley, New York, 1949).