Conditional mutual information-based feature selection analyzing for synergy and redundancy

ETRI Journal

Volumn 33, Issue 2, 2011, Pages 210-218

  Cheng, Hongrong ^a   Qin, Zhiguang ^a   Feng, Chaosheng ^a   Wang, Yong ^a   Li, Fagen ^a  

^a UNIVERSITY OF ELECTRONIC SCIENCE AND TECHNOLOGY OF CHINA   (China)

Author keywords

Classification; Conditional mutual information; Feature selection; Interaction; Redundancy

Indexed keywords

CLASSIFICATION; CLASSIFICATION TASKS; CONDITIONAL MUTUAL INFORMATION; DISCRIMINATIVE FEATURES; FEATURE REDUNDANCY; FEATURE SELECTION; FEATURE SELECTION ALGORITHM; INTERACTION; INTERACTION INFORMATION; MUTUAL INFORMATIONS; REDUNDANT FEATURES;

ALGORITHMS; CLASSIFICATION (OF INFORMATION); QUALITY ASSURANCE; REDUNDANCY;

FEATURE EXTRACTION;

EID: 79954439038     PISSN: 12256463     EISSN: None     Source Type: Journal    
DOI: 10.4218/etrij.11.0110.0237     Document Type: Article

References (19)

1. D. Koller and M. Sahami, "Toward Optimal Feature Selection, " Proc. 13th Int. Conf. Machine Learning, 1996, pp. 284-292.
2. M. Dash and H. Liu, "Feature Selection for Classification, " Intelligent Data Analysis, vol. 1, 1997, pp. 131-156.
3. E. Amaldi and V. Kann, "On the Approximation of Minimizing Nonzero Variables or Unsatisfied Relations in Linear Systems, " Theoretical Computer Sci., vol. 209, 1998, pp. 237-260. (Pubitemid 128450440)
4. R. Kohavi and G. H. John, "Wrappers for Feature Subset Selection, " Artificial Intell., vol. 97, no. 1-2, 1997, pp. 273-324. (Pubitemid 127401107)
5. R Battiti, "Using Mutual Information for Selecting Features in Supervised Neural Net Learning, " IEEE Tram. Neural Netw., vol. 5, no. 4, 1994, pp. 537-550.
6. N. Kwak and C. H. Choi, "Input Feature Selection for Classification Problems, " IEEE Tram. Neural Netw., vol. 13, no. 1, 2002, pp. 143-159. (Pubitemid 34236844)
7. J. J. HUANG et al., "Feature Selection for Classificatoiy Analysis Based on Information-Theoretic Criteria, " Acta Automatica Sinica, vol. 34, no. 3, 2008, pp. 383-392.
8. H. Peng, F. Long, and C. Ding, "Feature Selection Based on Mutual Information: Criteria of Max-Dependency, Max-Relevance, and Min-Redundancy, " IEEE Tram. Pattern Anal. Machine Intell, vol. 27, no. 8, 2005, pp. 1226-1238. (Pubitemid 41245053)
9. P. A. Estevez et al., "Normalized Mutual Information Feature Selection, " IEEE Tram. Neural Netw., vol. 20, no. 2, 2009, pp. 189-201.
10. J. Novovicova, "Conditional Mutual Information Based Feature Selection for Classification Task, " Progress Pattern Recog., Image Anal. Appl., LNCS, Springer, vol. 4756, 2007, pp. 417-426.
11. R. M. Fano, Transmission of Information: A Statistical Theory of Communications, New York, USA: Wiley Press, 1961.
12. C. E. Shannon and W. Weaver, The Mathematical Theory of Communication, Urbana, Israel: University of Illinois Press, 1949.
13. T. M. Cover and J. A. Thomas, Elements of Information Theory, New York, USA:Wiley-Interscience Press, 1991.
14. U. M. Fayyad and K. B. Irani, "Multi-interval Discretization of Continuous-Valued Attributes for Classification Learning, " Proc. 13th Int. Joint Conf. Artificial Intell., 1993, pp. 1022-1027.
15. W. J. McGill, "Multivariate Information Transmission, " Psychomeetrika, vol. 19, no. 2, 1954, pp. 97-116.
16. A. Jakulin and I. Bratko, "Quantifying and Visualizing Attribute Interactions: An Approach Based on Entropy." Available: http://arxiv.org/abs/cs. AI/0308002v3, 2004.
17. C. J. Merz and P. M. Murphy, "UCI Repository of Machine Learning Databases [Online]." Available: http://www.ics.uci.edu/fmlearn/ MLRepository.html.
18. H. Peng, "mRMR Sample Data Sets [Online]." Available: http://penglab.janeUa.org/proj/mRMR/test colon s3.csv.
19. I. H. Witten and E. Frank, Data Mining-Practical Machine Learning Tools and Techniques with JAVA Implementations, Morgan Kaufmann Publishers, 2nd ed., 2005.