Maximizing multi-information

Kybernetika

Volumn 42, Issue 5, 2006, Pages 517-538

  Ay, Nihat ^a   Knauf, Andreas ^b  

^a MAX PLANCK INSTITUTE FOR MATHEMATICS IN THE SCIENCES   (Germany)

^b UNIVERSITY OF ERLANGEN NUREMBERG   (Germany)

Author keywords

Boltzmann machine; Exponential family; Infomax principle; Multi information; Neural networks; Pair interaction; Relative entropy

Indexed keywords

EID: 33846165056     PISSN: 00235954     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (11)

1. E. Aarts and J. Korst: Simulated Annealing and Boltzmann Machines. Wiley, New York 1989.
2. D.H. Ackley, G.E. Hinton, and T. J. Sejnowski: A learning algorithm for Boltzmann machines. Cognitive Science 9 (1985), 147-169.
3. M. Aigner: Combinatorial Theory, Classics in Mathematics. Springer-Verlag, Berlin 1997.
4. S. Amari: Information geometry on hierarchy of probability distributions. IEEE Trans. Inform. Theory 47 (2001), 1701-1711.
5. S. Amari, K. Kurata, and H. Nagaoka: Information geometry of Boltzmann machines. IEEE Trans. Neural Networks 3 (1992), 2, 260-271.
6. N. Ay: An information-geometric approach to a theory of pragmatic structuring. Ann. Probab. 30 (2002), 416-436.
7. N. Ay: Locality of global stochastic interaction in directed acyclic networks. Neural Computation 14 (2002), 2959-2980.
8. R. Linsker: Self-organization in a perceptual network. IEEE Computer 21 (1988), 105-117.
9. F. Matúš and N. Ay: On maximization of the information divergence from an exponential family. In: Proc. WUPES'03 (J. Vejnarová, éd.), University of Economics, Prague 2003, pp. 199-204.
10. C. E. Shannon: A mathematical theory of communication. Bell System Tech. J. 27 (1948), 379-423, 623-656.
11. G. Tononi, O. Sporns, and G. M. Edelman: A measure for brain complexity: Relating functional segregation and integration in the nervous system. Proc. Nat. Acad. Sci. U.S.A. 91 (1994), 5033-5037.