Tsallis differential entropy and divergences derived from the generalized Shannon-Khinchin axioms

IEEE International Symposium on Information Theory - Proceedings

Volumn , Issue , 2009, Pages 149-153

  Suyari, Hiroki ^a   Tsukada, Makoto ^b  

^a CHIBA UNIVERSITY   (Japan)

^b TOHO UNIVERSITY   (Japan)

Author keywords

A divergence; Bregman divergence; Generalized shannon additivity; Generalized shannon khinchin axioms; Rooted tree; Tsallis differential entropy

Indexed keywords

A-DIVERGENCE; BREGMAN DIVERGENCE; GENERALIZED SHANNON ADDITIVITY; GENERALIZED SHANNON-KHINCHIN AXIOMS; ROOTED TREE; TSALLIS DIFFERENTIAL ENTROPY;

INFORMATION THEORY;

ENTROPY;

EID: 70449463208     PISSN: 21578102     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ISIT.2009.5205861     Document Type: Conference Paper

References (30)

1. C.E. Shannon, A mathematical theory of communication, Bell Syst. Tech. J., vol.27, pp.379-423, pp.623-656, 1948.
2. A.I. Khinchin, Mathematical Foundations of Information Theory, Dover, New York, 1957.
3. H. Suyari, Generalization of Shannon-Khinchin axioms to nonextensive systems and the uniqueness theorem for the nonextensive entropy, IEEE Trans. Inform. Theory, vol.50, pp.1783-1787, 2004.
4. C. Tsallis, Possible generalization of Boltzmann-Gibbs statistics, J. Stat. Phys. vol.52, pp.479-487, 1988.
5. E.T. Jaynes, Information theory and statistical mechanics, Phys. Rev. vol.106, pp.620-630, 1957;.E.T. Jaynes, Information theory and statistical mechanics. II, Phys. Rev. vol.108, pp.171-190, 1957.
6. H. Suyari, M. Tsukada and Y. Uesaka, Mathematical structures derived from the q-product uniquely determined by Tsallis entropy, Proc. of the 2005 IEEE Inter. Sym. on Inform. Theory (2005IEEE-ISIT), pp.2364- 2368, 2005.; H. Suyari, Mathematical structure derived from the qmultinomial coefficient in Tsallis statistics, Physica A, vol.368, pp.63-82, 2006.
7. H. Suyari, in preparation for submission.; H. Suyari, New developments in the studies of Tsallis statistical mechanics, BUTSURI, vol.63, pp.450-454, 2008. (in Japanese )
8. L. Nivanen, A. Le Mehaute, Q.A. Wang, Generalized algebra within a nonextensive statistics, Rep. Math. Phys. vol.52, pp.437-444, 2003.
9. E.P. Borges, A possible deformed algebra and calculus inspired in nonextensive thermostatistics, Physica A vol.340, pp.95-101, 2004.
10. A. Einstein, Theorie der Opaleszenz von homogenen Flüssigkeiten und Flüssigkeitsgemischen in der Nähe des kritischen Zustandes, Annalen der Physik vol.33, pp.1275-1298, 1910. (in German)
11. T.M. Cover and J.A. Thomas, Elements of information theory, Wiley, New York, 1991, (2nd edition, 2006)
12. J. H. Havrda and F. Charvat, Quantication method of classication processes: Concept of structural -entropy, Kybernetika, vol.3, pp. 30-35, 1967.
13. Z. Daröczy, Generalized information functions, Inform. Contr., vol.16, pp.36-51, 1970.
14. H. Suyari and T. Wada, Scaling property and Tsallis entropy derived from a fundamental nonlinear differential equation, Proc. of the 2006 Inter. Sym. on Inform. Theory and its Appli. (ISITA2006), pp.75-80, 2006. [LANL e-print cond-mat/0608007]
15. H. Suyari, Tsallis entropy as a lower bound of average description length for the q-generalized code tree, Proceedings of 2007 IEEE International Symposium on Information Theory (2007IEEE-ISIT), pp.901-905, 2007.
16. Y. Horibe, Jyouhou entropy ron, Morikita Pub., 1997. (in Japanese)
17. C. Tsallis, S.V.F. Levy, A.M.C. Souza and R. Maynard, Statisticalmechanical foundation of the ubiquity of Levy distributions in nature, Phys. Rev. Lett. vol.75, pp.3589-3593 (1995) [Erratum: 77, pp.5442, 1996].
18. D. Prato and C. Tsallis, Nonextensive foundation of Levy distributions, Phys. Rev. E vol.60, pp.2398-2401, 2000.
19. H. Suyari and M. Tsukada, Law of error in Tsallis statistics, IEEE Trans. Inform. Theory, vol.51, pp.753-757, 2005.
20. I. Csiszár, Information type measures of difference of probability distributions and indirect observations. Studia. Sci. Math. Hung., vol.2, pp.299-318, 1967.
21. C. Tsallis, Generalized entropy-based criterion for consistent testing, Phys.Rev.E, vol.58, pp.1442-1445, 1998.
22. S. Furuichi, On uniqueness theorems for Tsallis entropy and Tsallis relative entropy, IEEE Trans. Inform. Theory, vol.51, pp.3638-3645, 2005.
23. S. Furuichi, Information theoretical properties of Tsallis entropies, J.Math.Phys., vol.47, pp.023302-1-023302-18, 2006.
24. S. Amari and H. Nagaoka, Methods of Information Geometry, Translations of mathematical monographs; v. 191, American Mathematical Society & Oxford University Press, 2000.
25. A. Ohara, Geometry of distributions associated with Tsallis statistics and properties of relative entropy minimization, Phys. Lett. A, vol.370, pp.184-193, 2007.
26. A. Dukkipati, S. Bhatnagar, M N. Murty, Gelfand-Yaglom-Perez theorem for generalized relative entropies, Information Sciences: an International Journal, vo.177, pp.5707-5714, 2007. [LANL e-print mathph/0601035]
27. L. M. Bregman, The relaxation method of finding the common points of convex sets and its application to the solution of problems in convex programming, USSR Comp. Math. and Math. Phys. vol.7, pp.200-217, 1967.
28. J. Naudts, Continuity of a class of entropies and relative entropies, Reviews in Mathematical Physics, vol.16, pp.809-822, 2004.
29. R. Ahlswede and N. Cai, An interpretation of identification entropy, IEEE Trans. Inform. Theory, vol.52, pp.4198-4207, 2006 and references therein.
30. C. Tsallis, Introduction to Nonextensive Statistical Mechanics: Approaching a Complex World, Springer, New York, 2009.