A novel feature selection algorithm for text categorization

Expert Systems with Applications

Volumn 33, Issue 1, 2007, Pages 1-5

  Shang, Wenqian ^a   Huang, Houkuan ^a   Zhu, Haibin ^b   Lin, Yongmin ^a   Qu, Youli ^a   Wang, Zhihai ^a  

^a BEIJING JIAOTONG UNIVERSITY   (China)

^b NIPISSING UNIVERSITY   (Canada)

Author keywords

Gini index; kNN classifier; Text categorization; Text feature selection; Text preprocessing

Indexed keywords

ALGORITHMS; DATA REDUCTION; DIGITAL LIBRARIES; FEATURE EXTRACTION; INTERNET; WORLD WIDE WEB;

GINI INDEX THOERY; KNN CLASSIFIERS; TEXT CATEGORIZATION; TEXT FEATURE SELECTION; TEXT PREPROCESSING;

TEXT PROCESSING;

EID: 33845622338     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2006.04.001     Document Type: Article

References (16)

1. Breiman L., Friedman J.H., Olshen R.A., et al. Classification and regression trees (1984), Wadsworth International Group, Montery, CA
2. Cover T.M., and Hart P.E. Nearest neighbor pattern classification. IEEE Transaction on Information Theory IT-13 1 (1967) 21-27
3. Gupta S.K., Somayajulu D.V.L.N., Arora J.K., and Vasudha B. Scalable classifiers with dynamic pruning. Proceedings of the 9th international workshop on database and expert systems applications (1998), IEEE Computer Society, Washington, DC, USA 246-251
4. Joachims T. Text categorization with support vector machines: learning with many relevant features. Proceedings of the 10th European conference on machine learning (1998), Springer, New York 137-142
5. Lewis D.D. Naïve (Bayes) at forty: the independence assumption in information retrieval. Proceedings of the 10th European conference on machine learning (1998), Springer, New York 4-15
6. Lewis, D.D., Ringuette, M., 1994. Comparison of two learning algorithms for text categorization. In Proceedings of the third annual symposium on document analysis and information retrieval. Las Vegas, NV, USA, pp. 81-93.
7. Mladenic, D., Grobelnik, M., 1999. Feature selection for unbalanced class distribution and Naïve Bayes. In Proceedings of 16th international conference on machine learning, San Francisco 258-267.
8. Mladenic D., and Grobelnik M. Feature selection on hierarchy of web documents. Decision Support Systems 35 1 (2003) 45-87
9. Rijsbergen V. Information retrieval (1979), Butterworth, London
10. Shang W., Huang H., Zhu H., and Lin Y. An improved kNN algorithm-Fuzzy kNN. Proceedings of international conference on computational intelligence and security (2005), Xi'an, China 741-746
11. Shankar, S., Karypis, G. A feature weight adjustment algorithm for document categorization. Available from: http://www.cs.umm.edu/~karypis.
12. Tan S. Neighbor-weighted K-nearest Neighbor for Unbalanced Text Corpus. Expert System with Applications 28 4 (2005) 667-671
13. Vapnik V. The nature of statistical learning theory (1995), Springer
14. Yang Y. An evaluation of statistical approaches to text categorization. Information Retrieval 1 1 (1997) 76-88
15. Yang, Y., Pedersen, J.O., 1997. A Comparative Study on Feature Selection in Text Categorization. In Proceedings of the 14th international conference on machine learning, Nashville, USA, pp. 412-420.
16. Yang Y., and Lin X. A re-examination of text categorization methods. Proceedings of the 22nd annual international ACM SIGIR conference on research and development in the information retrieval (1999), ACM Press, New York 42-49