Signal transcoding by nonlinear sensory neurons: Information-entropy maximization, optimal transfer function, and anti-Hebbian adaptation

IMA Journal of Mathemathics Applied in Medicine and Biology

Volumn 14, Issue 3, 1997, Pages 227-239

  Chapeau Blondeau, François ^a   Raguin, Frédéric ^a  

^a UNIVERSITÉ D'ANGERS   (France)

Author keywords

Anti hebbian adaptation; Entropy maximization; Information entropy; Neuron; Sensory processing; Signal transcoding

Indexed keywords

ADAPTATION; ANIMAL; ARTICLE; BIOLOGICAL MODEL; HUMAN; MATHEMATICS; NONLINEAR SYSTEM; PHYSIOLOGY; SENSORY NERVE CELL; SIGNAL TRANSDUCTION; SYNAPTIC TRANSMISSION;

ADAPTATION, PHYSIOLOGICAL; ANIMALS; HUMANS; MATHEMATICS; MODELS, NEUROLOGICAL; NEURONS, AFFERENT; NONLINEAR DYNAMICS; SIGNAL TRANSDUCTION; SYNAPTIC TRANSMISSION;

NEURAL NETWORKS;

ANTI-HEBBIAN ADAPTATION; ENTROPY MAXIMIZATION; HEBBIAN; INFORMATION ENTROPY; OPTIMAL TRANSFERS; SENSORY NEURONS; SENSORY PROCESSING; SIGNAL TRANSCODING; SIMPLE++; TRANSCODING;

NEURONS;

EID: 0031228773     PISSN: 02650746     EISSN: None     Source Type: Journal    
DOI: 10.1093/imammb/14.3.227     Document Type: Article

References (23)

1. ANTÓN, P. S., GRANGER, R., & LINCH, R., 1992. Temporal information processing in synapses, cells, and circuits. In: Single Neuron Computation (T. McKenna, J. Davis, & S. F. Zornetzer, eds.), pp. 291-313. San Diego: Academic Press.
2. ATICK, J. J., 1992. Could information theory provide an ecological theory of sensory processing? Network: Comput. Neural Syst., 3, 213-51.
3. BARLOW, H. B., 1989. Unsupervised learning. Neural Comput., 1, 295-311.
4. BELL, A. J., & SEJNOWSKI,T. J., 1995. An information-maximization approach to blind separation and blind deconvolution. Neural Comput. 7, 1129-59.
5. BROWN, T. H., KAIRISS, E. W., & KEENAN, C. L., 1990. Hebbian synapses: Biophysical mechanisms and algorithms. Ann. Rev. Neurosci., 13, 475-511.
6. CHAPEAU-BLONDEAU, F., 1993. Analysis of neural networks with chaotic dynamics. Chaos, Solitons and Fractals 3, 133-9.
7. CHAPEAU-BLONDEAU, F., 1994. Information entropy maximization in the transmission by a neuron nonlinearity. Comptes Rendus de l'Acad. Sci. Sér. II, Paris 319, 271-6.
8. CHAPEAU-BLONDEAU, F., 1995. Information processing in neural networks by means of controlled dynamic regimes. Acta Biotheoretica 43, 155-67.
9. CHAPEAU-BLONDEAU, F., & CHAUVET, G., 1992. Stable, oscillatory, and chaotic regimes in the dynamics of small neural networks with delay. Neural Net. 5, 735-43.
10. FREEMAN, W. J., 1992. Tutorial on neurobiology: From single neurons to brain chaos. Int. J. Bifurcat. Chaos 2, 451-82.
11. HODGKIN, A. L., & HUXLEY, A. F., 1952. A quantitative description of membrane current and its application to conduction and excitation in nerve. J. Physiol. 117, 500-44.
12. KANDEL, E., 1991. Principles of Neural Science. New York: Prentice-Hall.
13. LAUGHLIN, S., 1981. A simple coding procedure enhances a neuron's information capacity. Z. Naturforsch C 36, 910-12.
14. LAUGHLIN, S., 1987. Form and function in retinal processing. Trends Neurosci. 10, 478-83.
15. LINSKER, R., 1988. Self-organization in a perceptual network. IEEE Comput. 21, 105-17.
16. NADAL, J. P., & PARGA, N., 1994. Nonlinear neurons in the low-noise limit: A factorial code maximizes information transfer. Network: Comput. Neural Syst. 5, 565-81.
17. PLUMBLEY, M. D., 1993. Efficient information transfer and anti-Hebbian neural networks. Neural Net. 6, 823-33.
18. SHANNON, C. E., 1948. A mathematical theory of communication. Bell Syst. Tech. J. 27, 623-56.
19. SKARDA, C. A., & FREEMAN, W. J., 1987. How brains make chaos in order to make sense of the world. Behav. Brain Sci. 10, 161-95.
20. TAYLOR, J. G., & PLUMBLEY, M. D., 1993. Information theory and neural networks. In: Mathematical Approaches to Neural Networks (J. G. Taylor, ed.). Amsterdam: Elsevier.
21. VON DER MALSBURG, C., 1994. The correlation theory of brain function. In: Models of Neural Networks II: Temporal Aspects of Coding and Information Processing in Biological Systems (E. Domany, J. L. van Hemmen, & K. Schulten, eds.), pp. 95-119. New York: Springer-Verlag.
22. ZOHARY, E., 1992. Population coding of visual stimuli by cortical neurons tuned to more than one dimension. Biol. Cybernet. 66, 265-72.
23. ZUCKER, R. S., 1989. Short-term synaptic plasticity. Ann. Rev. Neurosci. 12, 13-31.