Feature selection methods for text classification

Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining

Volumn , Issue , 2007, Pages 230-239

  Dasgupta, Anirban ^a   Drineas, Petros ^b   Harb, Boulos ^c   Josifovski, Vanja ^a   Mahoney, Michael W ^a  

^a YAHOO RESEARCH   (United States)

^b RENSSELAER POLYTECHNIC INSTITUTE   (United States)

^c UNIVERSITY OF PENNSYLVANIA   (United States)

Author keywords

Feature selection; Random sampling; Regularized least squares classification; Text classification

Indexed keywords

RANDOM SAMPLING; REGULARIZED LEAST SQUARES CLASSIFICATION; TEXT CLASSIFICATION;

CLASSIFICATION (OF INFORMATION); DATA MINING; KNOWLEDGE ACQUISITION; LEAST SQUARES APPROXIMATIONS; SAMPLING; TEXT PROCESSING;

FEATURE EXTRACTION;

EID: 36849093470     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1281192.1281220     Document Type: Conference Paper

References (42)

1. 20 Newsgroups Dataset. J. Rennie. http://people.csail.mit.edu/jrennie/ 20Newsgroups/.
2. 20 Newsgroups Dataset. UCI KDD Archive. http://kdd.ics.uci.edu/databases/ 20newsgroups/20newsgroups.html.
3. D.K. Agarwal. Shrinkage estimator generalizations of proximal support vector machines. In Proceedings of the 8th Annual ACM SIGKDD Conference, pages 173-182, 2002.
4. A.L. Blum and P. Langley. Selection of relevant features and examples in machine learning. Artificial Intelligence, 97:245-271, 1997.
5. A.L. Blum and R.L. Rivest. Training a 3-node neural network is NP-complete. Neural Networks, 5:117-127, 1992.
6. M. Charikar, V. Guruswami, R. Kumar, S. Rajagopalan, and A. Sahai. Combinatorial feature selection problems. In Proceedings of the 41st Annual IEEE Symposium on Foundations of Computer Science, pages 631-642, 2000.
7. A. Das and D. Kempe. Algorithms for subset selection in linear regression. Manuscript.
8. p regression. In Manuscript submitted for publication.
9. D. Davidov, E. Gabrilovich, and S. Markovitch. Parameterized generation of labeled datasets for text categorization based on a hierarchical directory. In Proceedings of the 27th Annual International ACM SIGIR Conference, pages 250-257, 2004.
10. J. Demmel and K. Veselić. Jacobi's method is more accurate than QR. SIAM Journal on Matrix Analysis and Applications, 13:1204-1245, 1992.
11. 2 regression and applications. In Proceedings of the 17th Annual ACM-SIAM Symposium on Discrete Algorithms, pages 1127-1136, 2006.
12. T. Evgeniou, M. Pontil, and T. Poggio. Regularization networks and support vector machines. Advances in Computational Mathematics, 13(1):1-50, 1999.
13. G. Forman. An extensive empirical study of feature selection metrics for text classification. Journal of Machine Learning Research, 3:1289-1305, 2003.
14. D. Fragoudis, D. Meretakis, and S. Likothanassis. Integrating feature and instance selection for text classification. In Proceedings of the 8th Annual ACM SIGKDD Conference, pages 501-506, 2002.
15. G. Fung and O.L. Mangasarian. Proximal support vector machine classifiers. In Proceedings of the 7th Annual ACM SIGKDD Conference, pages 77-86, 2001.
16. E. Gabrilovich and S. Markovitch. Text categorization with many redundant features: using aggressive feature selection to make SVMs competitive with C4.5. In Proceedings of the 21th International Conference on Machine Learning, pages 41-48, 2004.
17. I. Guyon and A. Elisseeff. An introduction to variable and feature selection. Journal of Machine Learning Research, 3:1157-1182, 2003.
18. T. Joachims. Text categorization with suport vector machines: Learning with many relevant features. In Proceedings of the 10th European Conference on Machine Learning, pages 137-142, 1998.
19. H. Kim, P. Howland, and H. Park. Dimension reduction in text classification with support vector machines. Journal of Machine Learning Research, 6:37-53, 2005.
20. R. Kohavi and G.H. John. Wrappers for feature subset selection. Artificial Intelligence, 97:273-324, 1997.
21. K. Lang. Newsweeder: Learning to filter netnews. In Proceedings of the 12th International Conference on Machine Learning, pages 331-339, 1995.
22. E. Leopold and J. Kindermann. Text categorization with support vector machines. How to represent texts in input space? Machine Learning, 46:423-444, 2002.
23. D.D. Lewis, Y. Yang, T.G. Rose, and F. Li. RCV1: A new benchmark collection for text categorization research. Journal of Machine Learning Research, 5:361-397, 2004.
24. D. Mladenic and M. Grobelnik. Feature selection for unbalanced class distribution and Naive Bayes. In Proceedings of the 16th International Conference on Machine Learning, pages 258-267, 1999.
25. T. Poggio and S. Smale. The mathematics of learning: Dealing with data. Notices of the AMS, 50(5):537-544, May 2003.
26. R. Rifkin. Everything Old Is New Again: A Fresh Look at Historical Approaches in Machine Learning. PhD thesis, Massachusetts Institute of Technology, 2002.
27. R. Rifkin, G. Yeo, and T. Poggio. Regularized least-squares classification. In J.A.K. Suykens, G. Horvath, S. Basu, C. Micchelli, and J. Vandewalle, editors, Advances in Learning Theory: Methods, Models and Applications, NATO Science Series III: Computer and Systems Sciences, pages 131-154. VIOS Press, 2003.
28. M. Rudelson and R. Vershynin. Sampling from large matrices: an approach through geometric functional analysis. Manuscript.
29. G. Salton. The smart document retrieval project. In Proceedings of the 14th Annual International ACM SIGIR Conference, pages 356-358, 1991.
30. Bernhard Schölkopf, Ralf Herbrich, Alex J. Smola, and Robert C. Williamson. A generalized representer theorem. In Proceedings of the 14th Annual Conference on Computational Learning Theory (COLT 2001) and the 5th European Conference on Computational Learning Theory (EuroCOLT 2001), pages 416-426, 2001.
31. F. Sebastiani. Machine learning in automated text categorization. ACM Computing Surveys, 34(1):1-47, 2002.
32. G.W. Stewart and J.G. Sun. Matrix Perturbation Theory. Academic Press, New York, 1990.
33. J.A.K. Suykens and J. Vandewalle. Least squares support vector machine classifiers. Neural Processing Letters, 9(3):293-300, 1999.
34. A.N. Tikhonov and V.Y. Arsenin. Solutions of Ill-Posed Problems. W.H. Winston, Washington, D.C., 1977.
35. V.N. Vapnik. Statistical Learning Theory. Wiley, New York, 1998.
36. Y. Yang. Noise reduction in a statistical approach to text categorization. In Proceedings of the 18th Annual International A CM SIGIR. Conference, pages 256-263, 1995.
37. Y. Yang. Sampling strategies and learning efficiency in text categorization. In AAAI Spring Symposium on Machine Learning in Information Access, pages 88-95, 1996.
38. Y. Yang and X. Liu. A re-examination of text categorization methods. In Proceedings of the 22nd Annual International ACM SIGIR Conference, pages 42-49, 1999.
39. Y. Yang and J.O. Pedersen. A comparative study on feature selection in text categorization. In Proceedings of the 14th International Conference on Machine Learning, pages 412-420, 1997.
40. J. Zhang and Y. Yang. Robustness of regularized linear classification methods in text categorization. In Proceedings of the 26th Annual International ACM SIGIR Conference, pages 190-197, 2003.
41. P. Zhang and J. Peng. SVM vs regularized least squares classification. In Proceedings of the 17th International Conference on Pattern Recognition, pages 176-179, 2004.
42. T. Zhang and F.J. Oles. Text categorization based on regularized linear classification methods. Information Retrieval, 4(1):5-31, 2001.