On minimization of entropy functionals under moment constraints

IEEE International Symposium on Information Theory - Proceedings

Volumn , Issue , 2008, Pages 2101-2105

  Csiszár, Imre ^a   Matúš, Prantišek ^b  

^a INSTITUTE OF EXPERIMENTAL MEDICINE   (Hungary)

^b INSTITUTE OF INFORMATION THEORY AND AUTOMATION   (Czech Republic)

Author keywords

[No Author keywords available]

Indexed keywords

BREGMAN DISTANCES; CONSTRAINT QUALIFICATIONS; EXPONENTIAL FAMILIES; FINITE NUMBERS; FUNCTIONALS; INTERNATIONAL SYMPOSIUM; LINEAR CONSTRAINTS; MINIMIZATION PROBLEMS; MOMENT CONSTRAINTS;

INFORMATION THEORY; TECHNICAL PRESENTATIONS;

CYBERNETICS;

EID: 52349095473     PISSN: 21578101     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ISIT.2008.4595360     Document Type: Conference Paper

References (19)

1. Amari S. and Nagaoka H., Methods of Information Geometry. Translations of Mathematical Monographs, Vol. 191, Oxford Univ. Press, 2000.
2. 1 and the existence of maximum entropy estimates. SIAM J. Optimization 3 (1993) 248-267.
3. Bregman, L.M., The relaxation method of finding the common point of convex sets and its application to the solution of problems in convex programming. USSR Computational Mathematics and Mathrematical Physics 7 (1967) 200-217.
4. Censor, Y. and Zenios, S.A., Parallel Optimization. Oxford University Press, New York 1997.
5. Csiszár, I., Generalized projections for non-negative functions. Acta Math. Hungar. 68 (1-2) (1995) 161-185.
6. Csiszár, I., Gamboa F. and Gassiat E., MEM pixel correlated solutions for generalized moment and interpolation problems. IEEE Trans. Inform. Theory 45 (1999) 2253-2270.
7. d. Studio Sci. Math. Hungar. 38 (2001) 177-190.
8. Csiszár, I. and Matúš, F., Information projections revisited. IEEE Trans. Inform. Theory 49 (2003) 1474-1490.
9. Csiszár, I. and Matúš, F., Generalized maximum likelihood estimates for infinite dimensional exponential families. Proceedings Prague Stochastics'06, Prague, Czech Republic, 2006, 288-297.
10. Csiszár, I. and Matúš, F., Generalized maximum likelihood estimates for exponential families. Probability Theory and Related Fields 141 (2008) 213-246.
11. Dawid, A.P. and Grünwald P.D., Game theory, maximum entropy, minimum discrepancy, and robust Bayesian decision theory. Ann. Statist. 32 (2004), 1367-1433.
12. Eguchi S., Information geometry and statistical pattern recognition. Sugaku Expositions, Amer. Math. Soc., 19 (2006) 197-216.
13. Jones, L. and Byrne, C., General entropy criteria for inverse problems with application to data compression, pattern classification and cluster analysis. IEEE Trans. Inform. Theory 36 (1990) 23-30.
14. Léonard, C., Minimizers of energy functionals. Acta Math. Hungar. 93 (2001) 281-325.
15. Léonard, C. Minimizers of energy functional under not very integrable constraints. J. Convex Anal. 10 (2003) 63-68.
16. Léonard, C., Minimization of entropy functionals. (arXiv:0710.1462)
17. Murata N., Takenouchi T., Kanamori T. and Eguchi S., Information geometry of U-Boost and Bregman divergence. Neural Computation 16 (2004) 1437-1481.
18. Rockafellar, R.T., Integrals which are convex functionals. Pacific Journal of Mathematics 24 (1968) 525-539.
19. Rockafellar, R.T., Convex Analysis. Princeton University Press, Princeton 1970.