Efficient feature selection via analysis of relevance and redundancy

Journal of Machine Learning Research

Volumn 5, Issue , 2004, Pages 1205-1224

  Yu, Lei ^a   Liu, Huan ^a  

^a Arizona State University   (United States)

Author keywords

Feature selection; High dimensionality; Redundancy; Relevance; Supervised learning

Indexed keywords

CLUSTERING ALGORITHMS; REDUNDANCY; SUPERVISED LEARNING;

EFFICIENT FEATURE SELECTIONS; FEATURE REDUNDANCY; FEATURE SELECTION METHODS; HIGH DIMENSIONAL DATA; HIGH DIMENSIONALITY; REDUNDANCY ANALYSIS; RELEVANCE; RELEVANCE AND REDUNDANCIES;

FEATURE EXTRACTION;

EID: 25144492516     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Article

References (36)

1. H. Almuallim and T. G. Dietterich. Learning boolean concepts in the presence of many irrelevant features. Artificial Intelligence, 69(1-2):279-305, 1994.
2. D. A. Bell and H. Wang. A formalism for relevance and its application in feature subset selection. Machine Learning, 41(2):175-195, 2000.
3. A. L. Blum and P. Langley. Selection of relevant features and examples in machine learning. Artificial Intelligence, 97:245-271, 1997.
4. A. L. Blum and R. L. Rivest. Training a 3-node neural networks is NP-complete. Neural Networks, 5:117-127, 1992.
5. M. Dash, K. Choi, P. Scheuermann, and H. Liu. Feature selection for clustering - a filter solution. In Proceedings of the Second International Conference on Data Mining, pages 115-122, 2002.
6. M. Dash and H. Liu. Feature selection for classification. Intelligent Data Analysis: An International Journal, 1(3):131-156, 1997.
7. M. Dash and H. Liu. Consistency-based search in feature selection. Artificial Intelligence, 151(1-2):155-176, 2003.
8. J. G. Dy, C. E. Brodley, A. C. Kak, L. S. Broderick, and A. M. Aisen. Unsupervised feature selection applied to content-based retrieval of lung images. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25(3):373-378, 2003.
9. U. M. Fayyad and K. B. Irani. Multi-interval discretization of continuous-valued attributes for classification learning. In Proceedings of the Thirteenth International Joint Conference on Artificial Intelligence, pages 1022-1027, 1993.
10. G. Forman. An extensive empirical study of feature selection metrics for text classification. Journal of Machine Learning Research, 3:1289-1305, 2003.
11. I. Guyon and A. Elisseeff. An introduction to variable and feature selection. Journal of Machine Learning Research, 3:1157-1182, 2003.
12. M. A. Hall. Correlation-based feature selection for discrete and numeric class machine learning. In Proceedings of the Seventeenth International Conference on Machine Learning, pages 359-366, 2000.
13. T. Hastie, R. Tibshirani, and J. Friedman. The Elements of Statistical Learning. Springer, 2001.
14. D. D. Jensen and P. R. Cohen. Multiple comparisions in induction algorithms. Machine Learning, 38(3):309-338, 2000.
15. G. H. John, R. Kohavi, and K. Pfleger. Irrelevant feature and the subset selection problem. In Proceedings of the Eleventh International Conference on Machine Learning, pages 121-129, 1994.
16. Y. Kim, W. Street, and F. Menczer. Feature selection for unsupervised learning via evolutionary search. In Proceedings of the Sixth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pages 365-369, 2000.
17. R. Kohavi and G. H. John. Wrappers for feature subset selection. Artificial Intelligence, 97(1-2):273-324, 1997.
18. D. Koller and M. Sahami. Toward optimal feature selection. In Proceedings of the Thirteenth International Conference on Machine Learning, pages 284-292, 1996.
19. W. Lee, S. J. Stolfo, and K. W. Mok. Adaptive intrusion detection: A data mining approach. AI Review, 14(6):533-567, 2000.
20. H. Liu, F. Hussain, C. L. Tan, and M. Dash. Discretization: An enabling technique. Data Mining and Knowledge Discovery, 6(4):393-423, 2002a.
21. H. Liu and H. Motoda. Feature Selection for Knowledge Discovery and Data Mining. Boston: Kluwer Academic Publishers, 1998. ISBN 0-7923-8198-X.
22. H. Liu, H. Motoda, and L. Yu. Feature selection with selective sampling. In Proceedings of the Nineteenth International Conference on Machine Learning, pages 395-402, 2002b.
23. H. Liu and R. Setiono. A probabilistic approach to feature selection - a filter solution. In Proceedings of the Thirteenth International Conference on Machine Learning, pages 319-327, 1996.
24. A. Miller. Subset Selection in Regression. Chapman & Hall/CRC, 2 edition, 2002.
25. T. M. Mitchell. Machine Learning. McGraw-Hill, 1997.
26. P. Mitra, C. A. Murthy, and S. K. Pal. Unsupervised feature selection using feature similarity. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(3):301-312, 2002.
27. K. S. Ng and H. Liu. Customer retention via data mining. AI Review, 14(6):569-590, 2000.
28. W. H. Press, S. A. Teukolsky, W. T. Vetterling, and B. P. Flannery. Numerical Recipes in C. Cambridge University Press, Cambridge, 1988.
29. J. R. Quinlan. C4.5: Programs for Machine Learning. Morgan Kaufmann, 1993.
30. M. Robnik-Sikonja and I. Kononenko. Theoretical and empirical analysis of Relief and ReliefF. Machine Learning, 53:23-69, 2003.
31. D. L. Swets and J. J. Weng. Efficient content-based image retrieval using automatic feature selection. In IEEE International Symposium on Computer Vision, pages 85-90, 1995.
32. I. H. Witten and E. Frank. Data Mining - Pracitcal Machine Learning Tools and Techniques with JAVA Implementations. Morgan Kaufmann Publishers, 2000.
33. E. Xing, M. Jordan, and R. Karp. Feature selection for high-dimensional genomic microarray data. In Proceedings of the Eighteenth International Conference on Machine Learning, pages 601-608, 2001.
34. Y. Yang and J. O. Pederson. A comparative study on feature selection in text categorization. In Proceedings of the Fourteenth International Conference on Machine Learning, pages 412-420, 1997.
35. L. Yu and H. Liu. Feature selection for high-dimensional data: a fast correlation-based filter solution. In Proceedings of the twentieth International Conference on Machine Learning, pages 856-863, 2003.
36. L. Yu and H. Liu. Redundancy based feature selection for microarray data. In Proceedings of the Tenth ACM SIGKDD Conference on Knowledge Discovery and Data Mining, pages 737-742, 2004.