Toward optimal feature selection using ranking methods and classification algorithms

Yugoslav Journal of Operations Research

Volumn 21, Issue 1, 2011, Pages 119-135

  Novaković, Jasmina ^a   Strbac, Perica ^a   Bulatović, Dusan ^a  

^a Faculty of Management in Zajecar   (Serbia)

Author keywords

Classification accuracy; Classification algorithms; Feature ranking methods; Feature selection

Indexed keywords

EID: 84855749226     PISSN: 03540243     EISSN: 23346043     Source Type: Journal    
DOI: 10.2298/YJOR1101119N     Document Type: Article

References (38)

1. Kohavi, R., and John, G.H., "Wrappers for feature subset selection", Artificial Intelligence, 97 (1997) 273-324.
2. Blum, A.L., and Rivest, R.L., "Training a 3-node neural networks is NP-complete", Neural Networks, 5 (1992) 117-127.
3. Wyse, N., Dubes, R., and Jain, A.K., "A critical evaluation of intrinsic dimensionality algorithms", in: E.S. Gelsema and L.N. Kanal, (eds), Pattern Recognition in Practice, Morgan Kaufmann Publishers, Inc., 1980, 415-425.
4. Ben-Bassat, M., "Pattern recognition and reduction of dimensionality", in: P. R. Krishnaiah and L. N. Kanal, (eds), Handbook of Statistics-II, North Holland, 1982, 773-791.
5. Siedlecki, W., and Sklansky, J. "On automatic feature selection", International Journal of Pattern Recognition and Artificial Intelligence, 2 (1988) 197-220.
6. Blum, A.I., and Langley, P., "Selection of relevant features and examples in machine learning", Artificial Intelligence, 97 (1997) 245-271.
7. Dash, M., and Liu, H., "Feature selection methods for classifications", Intelligent Data Analysis: An International Journal, 1 (3) 1997. http://www-east.elsevier.com/ida/free.htm.
8. Dy, J.G., and Brodley, C.E., "Feature subset selection and order identification for unsupervised learning", in: Proceedings of the Seventeenth International Conference on Machine Learning, 2000, 247-254.
9. Kim, Y., Street, W., and Menczer, F., "Feature selection for unsupervised learning via evolutionary search", in: Proceedings of the Sixth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2000, 365-369.
10. Das, S., "Filters, wrappers and a boosting-based hybrid for feature selection", in: Proceedings of the Eighteenth International Conference on Machine Learning, 2001.
11. Mitra, P., Murthy, C. A., and Pal, S. K., "Unsupervised feature selection using feature similarity", IEEE Transactions on Pattern Analysis and Machine Intelligence, 24 (3) (2002) 301-312.
12. Quinlan, J. R., C4.5: Programs for Machine Learning, San Mateo, Morgan Kaufman, 1993.
13. Doak, J., "An evaluation of feature selection methods and their application to computer security", Technical report, Davis CA: University of California, Department of Computer Science, 1992.
14. Talavera, L., "Feature selection as a preprocessing step for hierarchical clustering", in: Proceedings of Internationl Conference on Machine Learning (ICML'99), 1999.
15. Liu, H., and Motoda, H., Feature Selection for Knowledge Discovery and Data Mining, Kluwer Academic Publishers, 1998.
16. Almuallim, H., and Dietterich, T. G., "Learning with many irrelevant features", in: Proc. AAAI-91, Anaheim, CA, 1991, 547-552.
17. Kira, K., and Rendell, L. A., "The feature selection problem: tradional methods and a new algorithm", in: Proc. AAAI-92, San Jose, CA, 1992, 122-126.
18. Breiman, L., Friedman, J.H., Olshen, R.H., and Stone, C.J., Classification and Regression Trees, Wadsworth and Brooks, Monterey, CA, 1984.
19. Duch, W., Adamczak, R., and Grabczewski, K., "A new methodology of extraction, optimization and application of crisp and fuzzy logical rules", IEEE Transactions on Neural Networks, 12 (2001) 277-306.
20. Fayyad, U.M., and Irani, K.B. "The attribute selection problem in decision tree generation", in: AAAI-92, Proceedings of the Ninth National Conference on Artificial Intelligence, AAAI Press/The MIT Press, 1992, 104-110.
21. Liu, H., and Setiono, R. "A probabilistic approach to feature selection - a filter solution", in: L. Saitta, (ed.), Proceedings of International Conference on Machine Learning (ICML-96), July 3-6, 1996, Bari, Italy, 1996, San Francisco: Morgan Kaufmann Publishers, CA, 319-327.
22. John, G.H., Kohavi, R., and Pfleger, K., "Irrelevant feature and the subset selection problem", in: W., W. and Hirsh H., Cohen, (eds.), Machine Learning: Proceedings of the Eleventh International Conference, New Brunswick, N.J., 1994, Rutgers University, 121-129.
23. Caruana, R., and Freitag, D., "Greedy attribute selection", in: Proceedings of International Conference on Machine Learning (ICML-94), Menlo Park, California, 1994, AAAI Press/The MIT Press, 28-36.
24. Xing, E., Jordan, M., and Karp, R., "Feature selection for high-dimensional genomic microarray data", in: Proceedings of the Eighteenth International Conference On Machine Learning, 2001.
25. Weiss, S.M., and Kulikowski, C.A., Computer Systems That Learn, Morgan Kaufmann Publishers, San Mateo, California, 1991.
26. Dash, M., Liu, H., and Yao, J., "Dimensionality reduction of unsupervised data", in: Proceedings of the Ninth IEEE International Conference on Tools with AI (ICTAI'97), November, 1997, Newport Beach, California, 1997, IEEE Computer Society, 532-539.
27. Dash, M., and Liu, H., "Handling large unsupervised data via dimensionality reduction", in: Proceedings of 1999 SIGMOD Research Issues in Data Mining and Knowledge Discovery (DMKD-99) Workshop, 1999.
28. Yang, J., and Honavar, V., "Feature subset selection using a genetic algorithm", IEEE Intelligent Systems, 13 (1998) 44-49.
29. Koller, D., and Sahami, M., "Toward optimal feature selection", in: International Conference on Machine Learning, 1996, 284-292.
30. Abe, N., and Kudo, M., "Entropy criterion for classifier-independent feature selection", Lecture Notes in Computer Science, 3684 (2005) 689-695.
31. Hall, M.A., and Smith, L.A., "Practical feature subset selection for machine learning", Proceedings of the 21st Australian Computer Science Conference, 1998, 181-191.
32. Liu, H., and Setiono, R., "Chi2: Feature selection and discretization of numeric attributes", Proc. IEEE 7th International Conference on Tools with Artificial Intelligence, 1995, 338-391.
33. Holte, R.C., "Very simple classification rules perform well on most commonly used datasets", Machine Learning, 11 (1993) 63-91.
34. Marko, R.S., and Igor, K., "Theoretical and empirical analysis of relief and rreliefF", Machine Learning Journal, 53 (2003) 23-69. doi: 10.1023/A:1025667309714
35. Kuramochi, M., and Karypis, G., "Gene classification using expression profiles: a feasibility study", International Journal on Artificial Intelligence Tools, 14 (4) (2005) 641-660.
36. Domingos, P., and Pazzani, M., "Feature selection and transduction for prediction of molecular bioactivity for drug design", Machine Learning, 29 (1997) 103-130.
37. Xing, E. P., Jordan, M. L., and Karp, R. M., "Feature selection for high-dimensional genomic microarray data", Proceedings of the 18th International Conference on Machine Learning, 2001, 601-608.
38. Frank, A., and Asuncion, A., UCI Machine Learning Repository [http://archive.ics.uci.edu/ml]. Irvine, CA: University of California, School of Information and Computer Science, 2010.