On defining partition entropy by inequalities

IEEE Transactions on Information Theory

Volumn 53, Issue 9, 2007, Pages 3233-3239

  Luo, Ping ^a,b   Zhan, Guoxing ^b,c   He, Qing ^a   Shi, Zhongzhi ^a   Lü, Kevin ^d  

^a INSTITUTE OF COMPUTING TECHNOLOGY   (China)

^b UNIVERSITY OF CHINESE ACADEMY OF SCIENCES   (China)

^c INSTITUTE OF GEOLOGY AND GEOPHYSICS   (China)

^d BRUNEL UNIVERSITY   (United Kingdom)

Author keywords

Conditional entropy; Inequality; Partition entropy; Uncertainty

Indexed keywords

CONDITIONAL ENTROPY; DIRECT METHODS; FINITE SETS; INEQUALITY; INTUITIVE UNDERSTANDING; MONOTONICITY; PARTITION ENTROPY; UNCERTAINTY;

PARTITIONS (BUILDING); PROBABILITY DISTRIBUTIONS; SET THEORY;

ENTROPY;

EID: 58349119507     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIT.2007.903124     Document Type: Article

References (14)

1. R. V. Belavkin and F. E. Ritter, "The use of entropy for analysis and control of cognitive models," in Proc. Fifth Int. Conf. Cognitive Modeling, 2003, pp. 21-26.
2. D. A. Simovici and S. Jaroszewicz, "An axiomatization of partition entropy," IEEE Trans. Inf. Theory, vol. 48, no. 7, pp. 2138-2142, Jul. 2002.
3. J. R. Quinlan, C4.5: Programs for Machine Learning. New York: Morgan Kaufmann, 1993.
4. G.Wang, "Rough reduction in algebra view and information view," Int. J. Intell. Syst., vol. 18, no. 6, pp. 679-688, 2003.
5. D. Morales, L. Pardo, and I. Vajda, "Uncertainty of discrete stochastic systems: General theory and statistical inference," IEEE Trans. Syst., Man, Cybern., vol. 26, no. 6, pp. 681-697, 1996.
6. A. W. Marshall and I. Olkin, Inequalities: Theory of Majorization and its Applications. New York: Academic, 1979.
7. F. Cicalese and U. Vaccaro, "Supermodularity and subadditivity properties of the entropy on the majorization lattice," IEEE Trans. Inf. Theory, vol. 48, no. 4, pp. 933-938, Apr. 2002.
8. N. R. Pal and S. K. Pal, "Entropy: A new definition and its applications," IEEE Trans. Syst., Man, Cybern., vol. 21, no. 5, pp. 1260-1270, 1991.
9. L. Breiman, J. Friedman, R. Olshen, and C. Stone, Classification and Regression Trees. Belmont, CA: Wadsworth International Group, 1984.
10. D. A. Simovici and S. Jaroszewicz, "Generalized entropy and decision trees," EGC-Journes Francophones d'Extraction et de Gestion des Connaissances, 2003.
11. D. A. Simovici and S. Jaroszewicz, "A metric approach to building decision trees based on goodman-kruskal association index," in Proc. Pacific-Asia Conf. Knowledge Discovery and Data Mining, 2004, pp. 181-190.
12. S. Jaroszewicz, D. A. Simovici, W. Kuo, and L. Ohno-Machado, "The goodman-kruskal coefficient and its applications in the genetic diagnosis of cancer," IEEE Trans. Biomed. Eng., vol. 51, no. 7, pp. 1095-1102, Jul. 2004.
13. J. Liang, K. S. Chin, C. Dang, and R. C. M. Yam, "A new method for measuring uncertainty and fuzziness in rough set theory," Int. J. General Syst., vol. 31, no. 4, pp. 331-342, Jul. 2002.
14. P. Luo, Q. He, and Z. Shi, "Theoretical study on a new information entropy and its use in attribute reduction," in Proc. IEEE Int. Conf. Cognitive Information, 2005.