Text categorization with many redundant features: Using aggressive feature selection to make SVMs competitive with C4.5

Proceedings, Twenty-First International Conference on Machine Learning, ICML 2004

Volumn , Issue , 2004, Pages 321-328

  Gabrilovich, Evgeniy ^a   Markovitch, Shaul ^a  

^a TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; CLASSIFICATION (OF INFORMATION); COMPUTATIONAL METHODS; DECISION THEORY; FEATURE EXTRACTION; NATURAL LANGUAGE PROCESSING SYSTEMS; NOISE ABATEMENT; VECTORS;

FEATURE SELECTION; OPEN DIRECTORY PROJECT (ODP); SUPPORT VECTOR MACHINE (SVM); TEXT CATEGORIZATION;

TEXT PROCESSING;

EID: 14344259210     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (27)

1. Bekkerman, R. (2003). Distributional clustering of words for text categorization. Master's thesis, CS Department, Technion - Israel Inst. of Technology.
2. Brank, J., Grobelnik, M., Milic-Prayling, N., & Mladenic, D. (2002). Interaction of feature selection methods and linear classification models. Workshop on Text Learning held at ICML-2002.
3. Chakrabarti, S., Joshi, M. M., Punera, K., & Pennock, D. M. (2002). The structure of broad topics on the web. Proc. of the Int'l World Wide Web Conference.
4. Cohen, D., Herscovici, M., Petruschka, Y., Maarek, Y. S., Soffer, A., & Newbold, D. (2002). Personalized pocket directories for mobile devices. Proc. of the Int'l World Wide Web Conference.
5. Davidov, D., Gabrilovich, E., & Markovitch, S. (2004). Parameterized generation of labeled datasets for text categorization based on a hierarchical directory. To appear in SIGIR'04.
6. Duda, R., & Hart, P. (1973). Pattern classification and scene analysis. John Wiley and Sons.
7. Dumais, S., Platt, J., Heckerman, D., & Sahami, M. (1998). Inductive learning algorithms and representations for text categorization. CIKM (pp. 148-155).
8. Fellbaum, C. (Ed.). (1998). Wordnet: An electronic lexical database. MIT Press.
9. Forman, G. (2003). An extensive empirical study of feature selection metrics for text classification. Journal of Machine Learning Research, 3, 1289-1305.
10. Joachims, T. (1998). Text categorization with support vector machines: Learning with many relevant features. ECML'98 (pp. 137-142).
11. Joachims, T. (1999). Making large-scale SVM learning practical. In B. Schoelkopf, C. Burges and A. Smola (Eds.), Advances in kernel methods - support vector learning. The MIT Press.
12. Lang, K. (1995). Newsweeder: Learning to filter net-news. ICML'95(pp. 331-339).
13. Leopold, E., & Kindermann, J. (2002). Text categorization with support vector machines: How to represent texts in input space. Machine Learning, 46, 423-444.
14. Lewis, D. D., Yang, Y., Rose, T., & Li, F. (2004). RCV1: A new benchmark collection for text categorization research. JMLR, 5, 361-397.
15. Mladenic, D. (1998). Feature subset selection in text learning. ECML '98 (pp. 95-100).
16. Mladenic, D., & Grobelnik, M. (1998). Word sequences as features in text-learning. Proc. of 7th Electrotech. and Comp. Sci. Conf. (pp. 145-148).
17. Pang, B., Lee, L., & Vaithyanathan, S. (2002). Thumbs up? Sentiment classification using machine learning techniques. EMNLP'02 (pp. 79-86).
18. Quinlan, J. R. (1993). C4-5: Programs for machine learning. Morgan Kaufmann.
19. Reuters (1997). Reuters-21578 text categorization test collection, Distribution 1.0. Reuters, http://www.daviddlewis.com/resources/testcollections/ reuters21578.
20. Rogati, M., & Yang, Y. (2002). High-performing feature selection for text classification. CIKM'02 (pp. 659-661).
21. Scott, S., & Matwin, S. (1999). Feature engineering for text classification. ICML'99 (pp. 379-388).
22. Sebastiani, F. (2002). Machine learning in automated text categorization. ACM Comp. Surveys, 34, 1-47.
23. Vapnik, V. (1995). The nature of statistical learning theory. Springer-Verlag.
24. Wermter, S., & Hung, C. (2002). Selforganizing classification on the reuters news corpus. COLING'02.
25. Yang, Y., & Liu, X. (1999). A re-examination of text categorization methods. SIGIR'99 (pp. 42-49).
26. Yang, Y., & Pedersen, J. (1997). A comparative study on feature selection in text categorization. ICML'97 (pp. 412-420).
27. Yang, Y., Slattery, S., & Ghani, R. (2002). A study of approaches to hypertext categorization. JIIS, 18, 219-241.