Comments on supervised feature selection by clustering using conditional mutual information-based distances

Pattern Recognition

Volumn 46, Issue 4, 2013, Pages 1220-1225

  Vinh, Nguyen X ^a   Bailey, James ^b  

^a UNIVERSITY OF NEW SOUTH WALES   (Australia)

^b UNIVERSITY OF MELBOURNE   (Australia)

Author keywords

Classification; Clustering; Conditional mutual information; Feature selection; Mutual information properties; Naive Bayes classifier

Indexed keywords

CLASSIFIERS; FEATURE EXTRACTION; INFORMATION USE; LEARNING SYSTEMS;

CLUSTERING; CLUSTERING PROCEDURE; CONDITIONAL MUTUAL INFORMATION; DISTANCE MEASURE; INFORMATION LOSS; MUTUAL INFORMATIONS; NAIVE BAYES CLASSIFIERS; OBJECTIVE FUNCTIONS;

CLASSIFICATION (OF INFORMATION);

EID: 84871288728     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2012.11.001     Document Type: Note

References (13)

1. J. Martínez Sotoca, and F. Pla Supervised feature selection by clustering using conditional mutual information-based distances Pattern Recognition 43 2010 2068 2081
2. H. Peng, F. Long, and C. Ding Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy IEEE Transactions on Pattern Analysis and Machine Intelligence 27 2005 1226 1238
3. P.L. Carmona, J.M. Sotoca, F. Pla, F.K.H. Phoa, J.B. Dias, Feature selection in regression tasks using conditional mutual information, in: Proceedings of the 5th Iberian Conference on Pattern Recognition and Image Analysis, pp. 224-231.
4. Y.Y. Yao, Information-theoretic measures for knowledge discovery and data mining, in: Karmeshu (Eds.), Entropy Measures, Maximum Entropy Principle and Emerging Applications. Springer, 2003, pp. 115-136.
5. T.M. Cover, and J.A. Thomas Elements of Information Theory 2nd edition 2006 Wiley-Interscience
6. R. Renner, U. Maurer, About the mutual (conditional) information, in: Proceedings of IEEE International Symposium on Information Theory, 2002, p. 364.
7. D. Koller, and N. Friedman Probabilistic Graphical Models: Principles and Techniques 2009 The MIT Press
8. I. Guyon, C. Aliferis, and A. Elisseeff Causal feature selection Computational Methods of Feature Selection 2007 Chapman and Hall
9. N. Friedman, D. Geiger, and M. Goldszmidt Bayesian network classifiers Machine Learning 29 1997 131 163
10. A. McCallum, K. Nigam, A comparison of event models for naive Bayes text classification, in: AAAI-98 Workshop on Learning for Text Categorization, AAAI Press, 1998, pp. 41-48.
11. H. Zhang, The optimality of naive Bayes, in: Proceedings of the Seventeenth International Florida Artificial Intelligence Research Society Conference, Miami Beach, Florida, USA.
12. G. Van Dijck, and M.M. Van Hulle Increasing and decreasing returns and losses in mutual information feature subset selection Entropy 12 2010 2144 2170
13. B. Guo, and M.S. Nixon Gait feature subset selection by mutual information Transactions on Systems, Man and Cybernetics Part A 39 2009 36 46