An extensive empirical study of feature selection metrics for text classification

Journal of Machine Learning Research

Volumn 3, Issue , 2003, Pages 1289-1305

  Forman, George ^a  

^a HEWLETT PACKARD LABORATORIES   (United States)

Author keywords

Document categorization; ROC; Supervised learning; Support vector machines

Indexed keywords

CORRELATED FAILURES; DOCUMENT CATEGORIZATION; EMPIRICAL - COMPARISONS; EVALUATION METHODOLOGIES; FEATURE SELECTION METHODS; FEATURE SELECTION METRICS; INDUCTION ALGORITHMS; ROC;

CLASSIFICATION (OF INFORMATION); INFORMATION RETRIEVAL SYSTEMS; SUPERVISED LEARNING; SUPPORT VECTOR MACHINES;

TEXT PROCESSING;

EID: 2942731012     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Article

References (14)

1. Susan Dumais, John Platt, David Heckerman and Mehran Sahami. Inductive Learning Algorithms and Representations for Text Categorization. In Proceedings of the 17th International Conference on Information and Knowledge Management, pages 148-155, Maryland, 1998.
2. Isabelle Guyon, Jason Weston, Stephen Barnhill, and Vladimir Vapnik. Gene Selection for Cancer Classification using Support Vector Machines. Machine Learning, 46(1-3):389-422, 2002.
3. Eui-Hong Sam Han and George Karypis. Centroid-Based Document Classification: Analysis & Experimental Results. In Proceedings of the Fourth European Conference on the Principles of Data Mining and Knowledge Discovery (PKDD), pages 424-431, Lyon, France, 2000.
4. James A. Hanley. The Robustness of the "Binormal" Assumptions Used in Fitting ROC Curves. Medical Decision Making, 8(3):197-203, 1988.
5. Thorsten Joachims. Text Categorization with Support Vector Machines: Learning with Many Relevant Features. In Proceedings of the Tenth European Conference on Machine Learning (ECML), pages 137-142, Berlin, Germany, 1998.
6. Ron Kohavi and George H. John. Wrappers for Feature Subset Selection. Artificial Intelligence, 97(1- 2):273-324, 1997.
7. George A. Miller and Edwin B. Newman. Tests of a statistical explanation of the rank-frequency relation for words in written English. American Journal of Psychology, 71:209-218, 1958.
8. Andrew McCallum and Kamal Nigam. A Comparison of Event Models for Naive Bayes Text Classification. Workshop on Learning for Text Categorization, In the Fifteenth National Conference on Artificial Intelligence (AAAI), 1998.
9. Dunja Mladenic and Marko Grobelnik. Feature Selection for Unbalanced Class Distribution and Naïve Bayes. In Proceedings of the Sixteenth International Conference on Machine Learning (ICML), pages 258-267, 1999.
10. Bernhard Schölkopf and Alex Smola. Learning with Kernels. MIT Press, Cambridge, MA, 2002.
11. Adrian J. Simpson and Mike J. Fitter. What is the Best Index of Detectability? Psychological Bulletin, 80(6):481-488, 1973.
12. Ian H. Witten and Eibe Frank. Data Mining: Practical Machine Learning Tools and Techniques with Java Implementations. Morgan Kaufmann, 1999.
13. Yiming Yang and Xin Liu. A Re-examination of Text Categorization Methods. In Proceedings of the Twenty-Second International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), pages 42-49, 1999.
14. Yiming Yang and Jan O. Pedersen. A Comparative Study on Feature Selection in Text Categorization. In Proceedings of the 14th International Conference on Machine Learning (ICML), pages 412-420, 1997.