Finding the maximizers of the information divergence from an exponential family

IEEE Transactions on Information Theory

Volumn 57, Issue 6, 2011, Pages 3236-3247

  Rauh, Johannes ^a  

^a MAX PLANCK INSTITUTE FOR MATHEMATICS IN THE SCIENCES   (Germany)

Author keywords

Binomial equations; exponential family; information divergence; optimization; relative entropy

Indexed keywords

BINOMIAL EQUATIONS; CONVEX COMBINATIONS; EXPONENTIAL FAMILY; INFORMATION DIVERGENCE; PROBABILITY MEASURES; RELATIVE ENTROPY; SUFFICIENT STATISTICS;

EID: 79957654873     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIT.2011.2136230     Document Type: Article

References (18)

1. 4ti2-a Software Package for Algebraic, Geometric and Combinatorial Problems on Linear Spaces 4ti2 team [Online]. Available: http://www. 4ti2.de
2. N. Ay, "An information-geometric approach to a theory of pragmatic structuring," Ann. Probab., vol. 30, pp. 416-436, 2002.
3. N. Ay and A. Knauf, "Maximizing multi-information," Kybernetika, vol. 42, pp. 517-538, 2006.
4. D. J. Bates, J. D. Hauenstein, A. J. Sommese, and C. W. Wampler, Bertini: Software for Numerical Algebraic Geometry [Online]. Available: http://www.nd.edu/̃sommese/bertini
5. A. Björner, M. L. Vergnas, B. Sturmfels, N. White, and G. Ziegler, "Oriented matroids," in Encyclopedia of Mathematics and its Applications, 1st ed. Cambridge, U.K.: Cambridge Univ. Press, 1993.
6. D. A. Cox, J. B. Little, and D. O'Shea, Ideals, Varieties and Algorithms: An Introduction to Computational Algebraic Geometry and Commutative Algebra, 3rd ed. New York: Springer, 2008.
7. I. Csiszár and P. C. Shields, "Information theory and statistics: A tutorial," Found. Trends Commun. Inf. Theory, 2004.
8. D. Eisenbud and B. Sturmfels, "Binomial ideals," Duke Math. J., vol. 84, no. 1, pp. 1-45, 1996. (Pubitemid 126344933)
9. G.-M. Greuel, G. Pfister, and H. Schönemann, SINGULAR 3-1-0-A Computer Algebra System for Polynomial Computations, 2009 [Online]. Available: http://www.singular.uni-kl.de
10. R. Hemmecke and P. Malkin, "Computing generating sets of lattice ideals," J. Symb. Comput., 2009.
11. T. Kahle, "Decomposition of binomial ideals," AISM, vol. 62, no. 4, pp. 727-745, 2009.
12. S. L. Lauritzen, "Graphical models," in Oxford Statistical Science Series, 1st ed. Oxford, U.K.: Oxford Univ. Press, 1996.
13. F. Matúš, "Optimality conditions for maximizers of the information divergence from an exponential family," Kybernetika, vol. 43, no. 5, pp. 731-746, 2007.
14. F. Matúš, "Divergence from factorizable distributions and matroid representations by partitions," IEEE Trans. Inf. Theory, vol. 55, no. 12, pp. 5375-5381, Dec. 2009.
15. F. Matúš and N. Ay, "On maximization of the information divergence from an exponential family," in Proc. WUPES'03, Prague, Czech Republic, 2003, pp. 199-204.
16. J. Rambau, "TOPCOM: Triangulations of point configurations and oriented matroids," in Proc. Mathematical Software-ICMS 2002, A.M. Cohen, X. Gao, and N. Takayama, Eds., 2002, pp. 330-340.
17. J. Rauh, T. Kahle, and N. Ay, "Support sets of exponential families and oriented matroids," Int. J. Approx. Reas., vol. 52, pp. 613-626, 2011.
18. A. J. Sommese and C. W. Wampler, The Numerical Solution of Systems of Polynomials Arising in Engineering and Science, 1st ed. Singapore: World Scientific, 2005.