Feature selection for classification

Intelligent Data Analysis

Volumn 1, Issue 3, 1997, Pages 131-156

  Dash, M ^a   Liu, H ^a  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

Author keywords

Classification; Feature selection; Framework

Indexed keywords

BENCHMARK DATASETS; COMPARATIVE STUDIES; DOMAIN SPECIFIC; EVALUATION FUNCTION; FEATURE SELECTION METHODS; FRAMEWORK; MACHINE LEARNING TECHNIQUES; REAL-WORLD;

CLASSIFICATION (OF INFORMATION); FEATURE EXTRACTION; LEARNING SYSTEMS; SURVEYS;

FUNCTION EVALUATION;

EID: 0013326060     PISSN: 1088467X     EISSN: 15714128     Source Type: Journal    
DOI: 10.3233/IDA-1997-1302     Document Type: Article

References (50)

1. Aha, D.W., Kibler, D. and Albert, M.K., Instance-Based Learning Algorithms. Machine Learning, 6:37-66, 1991.
2. Almuallim, H., and Dietterich, T.G., Learning with many irrelevant features. In: Proceedings of Ninth National Conference on Artifical Intelligence, MIT Press, Cambridge, Massachusetts, 547-552, 1992.
3. Almuallim, H., and Dietterich, T.G., Learning Boolean Concepts in the Presence of Many Irrelevant Features. Artificial Intelligence, 69(1-2):279-305, November, 1994.
4. Ben-Bassat, M., Pattern recognition and reduction of dimensionality. In: Handbook of Statistics, (P. R. Krishnaiah and L. N. Kanal, eds.), North Holland, 773-791, 1982.
5. Bobrowski, L., Feature selection based on some homogeneity coefficient. In: Proceedings of Ninth International Conference on Pattern Recognition, 544-546, 1988.
6. Brassard, G., and Bratley, P., Fundamentals of Algorithms. Prentice Hall, New Jersey, 1996.
7. Breiman, G., Friedman, 1.R., Olshen, R.A. and Stone, c.J., Classification and Regression Trees. Wadsworth International Group, Belmont, California, 1984.
8. Callan, J.P', Fawcett, T.E. and Rissland, E.L., An adaptive approach to case-based search. In: Proceedings of the Twelfth International Joint Conference on Artificial Intelligence, 803-808, 1991.
9. Cardie, c., Using decision trees to improve case-based learning. In: Proceedings of Tenth International Conference on Machine Learning, 25-32, 1993.
10. Caruana, R. and Freitag, D., Greedy attribute selection. In: Proceedings of Eleventh 1nternational Conference on Machine Learning, Morgan Kaufmann, New Brunswick, New Jersey, 28-36, 1994.
11. Clark, P. and Niblett, T., The CN2 Induction Algorithm. Machine Learning, 3:261-283, 1989.
12. Devijver, P.A. and Kittler, 1., Pattern Recognition: A Statistical Approach. Prentice Hall, 1982.
13. Doak, J., An evaluation offeature selection methods and their application to computer security. Technical report, Davis, CA: University of California, Department of Computer Science, 1992.-
14. Domingos, P., Context-sensitive feature selection for lazy learners. Artificial Intelligence Review, 1996.
15. Duran, B.S. and Odell, P.K., Cluster Analysis-A Survey. Springer-Verlag, 1974.
16. Foroutan, 1. and Sklansky, J., Feature selection for automatic classification of non-gaussian data. IEEE Transactions on Systems, Man, and Cybernatics, SMC-17(2):187-198, 1987.
17. Geoffrion, AM., Integer programming by implicit enumeration and balas, method. SIAM Review, 9: 178-190, 1967.
18. Holte, Re., Very simple classification rules perform well on most commonly used datasets. Machine Learning, 11(1):63-90,1993.
19. Ichino, M. and Sklansky, J., Feature selection for linear classifier. In: Proceedings of the Seventh International Conference on Pattern Recognition, volume 1, 124-127, July-Aug 1984.
20. Ichino, M. and Sklansky, J., Optimum feature selection by zero-one programming. IEEE Trans. on Systems, Man and Cybernetics, SMC-I4(5):737-746, September/October 1984.
21. John, G.H., Kohavi, R and Pfleger, K., Irrelevant features and the subset selection problem. In: Proceedings of the Eleventh International Conference on Machine Learning, 121-129, 1994.
22. Kira, K. and Rendell, L.A., The feature selection problem: Traditional methods and a new algorithm. In: Proceedings of Ninth National Conference on Artificial Intelligence, 129-134, 1992.
23. Kohavi, R and Sommerfield, D., Feature subset selection using the wrapper method: Overfitting and dynamic search space topology. In: Proceedings of First International Conference on Knowledge Discovery and Data Mining, Morgan Kaufmann, 192-197, 1995.
24. Koller, D. and Saharni, M., Toward optimal feature selection. In: Proceedings of International Conference on Machine Learning, 1996.
25. Kononenko, I., Estimating attributes: Analysis and extension of RELIEF. In: Proceedings of European Conference on Machine Learning, 171-182, 1994.
26. Langley, P., Selection of relevant features in machine learning. In: Proceedings of the MAl Fall Symposium on Relevance, 1-5, 1994.
27. Liu, H. and Setiono, R, Feature selection and classification-a probabilistic wrapper approach. In: Proceedings of Ninth International Conference on Industrial and Engineering Applications of AI and ES, 284-292, 1996.
28. Liu, H. and Setiono, R, A probabilistic approach to feature selection-a filter solution. In: Proceedings of International Conference on Machine Learning, 319-327, 1996.
29. Michalski, RS., Carbonell, J.G. and Mitchell, T.M (eds.), The effect of noise on concept learning, In: Machine Learning: An Artificial Intelligence Approach (vol. II), Morgan Kaufmann, San Mateo, CA, 419-424, 1986.
30. Michalski, RS., Mozetic, I., Hong, J. and Lavrac, N., The aq15 inductive learning system: An overview and experiments. Technical Report UIUCDCS-R-86-1260, University of Illinois, July 1986.
31. Modrzejewski, M., Feature selection using rough sets theory. In: Proceedings of the European Conference on Machine Learning (P. B. Brazdil, ed.), 213-226, 1993.
32. Moore, A.W. and Lee, M.S., Efficient algorithms for minimizing cross validation error. In: Proceedings of Eleventh International Conference on Machine Learning, Morgan Kaufmann, New Brunswick, New Jersey, 190-198, 1994.
33. Mucciardi, AN. and Gose, B.B., A comparison of seven techniques for choosing subsets of pattern recognition. IEEE Transactions on Computers, C-20:1023-1031, September 1971.
34. Narendra, P.M. and Fukunaga, K., A branch and bound algorithm for feature selection. IEEE Transactions on Computers, C-26(9):917-922, September 1977.
35. Oliveira, AL. and Vincentelli, A.S., Constructive induction using a non-greedy strategy for feature selection. In: Proceedings of Ninth International Conference on Machine Learning, 355-360, Morgan Kaufmann, Aberdeen, Scotland, 1992.
36. Pagallo, G. and Haussler, D., Boolean feature discovery in empirical learning. Machine Learning, 1(1):81-106, 1986.
37. Queiros, C.E. and Gelsema, E.S., On feature selection. In: Proceedings of Seventh International Conference on Pattern Recognition, 1:128-130, July-Aug 1984.
38. Quinlan, J., Induction of decision trees. In: Machine Learning, Morgan Kaufmann, 81-106. 1986.
39. Quinlan, J.R, C4.5: Programs for Machine Learning. Morgan Kaufmann, San Mateo, California, 1993.
40. Rissanen, J., Modelling by shortest data description. Automatica, 14:465-471, 1978.
41. Schaffer, C., Overfitting avoidance as bias. Machine Learning, 10(2):153-178,1993.
42. Schaffer, C., A conservation law for generalization performance. In: Proceedings of Eleventh International Conference on Machine Learning, Morgan Kaufmann, New Brunswick, NJ, 259-265, 1994.
43. Schlimmer, J.e., Efficiently inducing determinations: A complete and systematic search algorithm that uses optimal pruning. In: Proceedings of Tenth International Conference on Machine Learning, 284-290, (1993).
44. Segen, J., Feature selection and constructive inference. In: Proceedings of Seventh International Conference on Pattern Recognition, 1344-1346, 1984.
45. Sheinvald, J., Dom, B. and Niblack, w., A modelling approach to feature selection. In: Proceedings of Tenth International Conference on Pattern Recognition, 1:535-539, June 1990.
46. Siedlecki, W. and Sklansky, J., On automatic feature selection. International Journal of Pattern Recognition and Artificial Intelligence, 2:197-220, 1988.
47. Skalak, D.B., Prototype and feature selection by sampling and random mutation hill-climbing algorithms. In: Proceedings of Eleventh International Conference on Machine Learning, Morgan Kaufmann, New Brunswick, 293-301, 1994.
48. Thrun, S.B., et aI., The monk's problem: A performance comparison of different algorithms. Technical Report CMU-CS-91-197, Carnegie Mellon University, December 1991.
49. Vafaie, H. and Imam, I.F., Feature selection methods: genetic algorithms vs. greedy-like search. In: Proceedings of International Conference on Fuzzy and Intelligent Control Systems, 1994.
50. Xu, L., Yan, P. and Chang, T., Best first strategy for feature selection. In: Proceedings of Ninth International Conference on Pattern Recognition, 706-708, 1988.