Feature selection for text classification with Naïve Bayes

Expert Systems with Applications

Volumn 36, Issue 3 PART 1, 2009, Pages 5432-5435

  Chen, Jingnian ^a,b   Huang, Houkuan ^a   Tian, Shengfeng ^a   Qu, Youli ^a  

^a BEIJING JIAOTONG UNIVERSITY   (China)

^b SHANDONG UNIVERSITY OF FINANCE AND ECONOMICS   (China)

Author keywords

Feature selection; Na ve Bayes; Text classification; Text preprocessing

Indexed keywords

FEATURE EXTRACTION; TEXT PROCESSING;

BAYESIAN CLASSIFIER; FEATURE EVALUATION; FEATURE SELECTION METHODS; ODDS RATIOS; PRE-PROCESSING TECHNOLOGY; TEXT CLASSIFICATION; TEXT CLASSIFIERS; TEXT PREPROCESSING;

CLASSIFICATION (OF INFORMATION);

EID: 58349094507     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2008.06.054     Document Type: Article

References (18)

1. Cover T.M., and Hart P.E. Nearest neighbor pattern classification. IEEE Transaction on Information Theory IT 13 1 (1967) 21-27
2. Forman G. An extensive empirical study of feature selection metrics for text classification. Journal of Machine Learning Research 3 (2003) 1289-1305
3. Frank E., and Bouchaert R.R. Naive Bayes for text classification with unbalanced classes. Proceedings of the 10th European conference on principles and practice of knowledge discovery in databases (2006), Springer, Berlin 503-510
4. Joachims T. Text categorization with support vector machines: Learning with many relevant features. Proceedings of the 10th European conference on machine learning (1998), Springer, New York 137-142
5. John G.H., Kohavi R., and Pfleger K. Irrelevant Features and the Subset Selection Problem. Proceedings of the 11th International Conference on machine learning (1994), Morgan Kaufmann, San Francisco 121-129
6. Kim S., Han K., Rim H., and Myaeng S. Some effective techniques for Naive Bayes text classification. IEEE Transactions on Knowledge and Data Engineering 18 11 (2006) 1457-1466
7. Lewis D.D. Naive Bayes at forty: The independence assumption in information retrieval. Proceedings of the 10th European conference on machine learning (1998), Springer, New York 4-15
8. Lewis, D.D., & Ringuette, M. (1994). Comparison of two learning algorithms for text categorization. In Proceedings of the third annual symposium on document analysis and information retrieval (pp. 81-93). Las Vegas, NV.
9. McCallum, A. & Nigam, K. (1998). A comparison of event models for naive Bayes text classification. In AAAI-98 workshop on learning for text categorization.
10. Mladenic, D., & Grobelnik, M., 1999. Feature selection for unbalanced class distribution and Naive Bayes. In Proceedings of 16th international conference on machine learning (pp. 258-267). San Francisco.
11. Mladenic D., and Grobelnik M. Feature selection on hierarchy of web documents. Decision Support Systems 35 1 (2003) 45-87
12. Shang W., Huang H., Zhu H., Lin Y., et al. A novel feature selection algorithm for text categorization. Expert System with Applications 33 1 (2007) 1-5
13. Tan S. Neighbor-weighted K-nearest neighbor for unbalanced text corpus. Expert System with Applications 28 4 (2005) 667-671
14. Wiener, E. D., Pedersen, J. O., & Weigend, A. S. (1995). A neural network approach to topic spotting. In Proceedings of SDAIR-95, 4th annual symposium on document analysis and information retrieval (pp. 317-332).
15. Yang Y. An evaluation of statistical approaches to text categorization. Information Retrieval 1 1 (1997) 76-88
16. Yang Y., and Chute C.G. An example-based mapping method for text categorization and retrieval. ACM Transactions on Information System 12 3 (1994) 252-277
17. Yang, Y., & Pedersen, J.O. (1997). A Comaprative Study on Feature Selection in Text Categorization. In Proceedings of the 14th international conference on machine learning (pp. 412-420). Nashville, USA.
18. Zhou Q., Zhao M., and Hu M. Study on feature selection in Chinese text categorization. Journal of Chinese Information Processing 18 3 (2004) 17-23