Feature selection with a measure of deviations from Poisson in text categorization

Expert Systems with Applications

Volumn 36, Issue 3 PART 2, 2009, Pages 6826-6832

  Ogura, Hiroshi ^a   Amano, Hiromi ^a   Kondo, Masato ^a  

^a SHOWA UNIVERSITY   (Japan)

Author keywords

Feature selection; k NN classifier; Poisson distribution; Support vector machine; Text categorization

Indexed keywords

CLASSIFIERS; FEATURE EXTRACTION; NEAREST NEIGHBOR SEARCH; POISSON DISTRIBUTION; SUPPORT VECTOR MACHINES; TEXT PROCESSING;

AUTOMATIC TEXT CLASSIFICATION; BINARY CLASSIFICATION; EVALUATION EXPERIMENTS; HIGH DIMENSIONALITY; K-NN CLASSIFIER; REUTERS-21578 CORPUS; TEXT CATEGORIZATION; TEXT CLASSIFICATION;

CLASSIFICATION (OF INFORMATION);

EID: 58349094495     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2008.08.006     Document Type: Article

References (15)

1. Church, K. W., & Gale, W. A. (1995). Inverse document frequency (IDF): A measure of deviation from Poisson. In Proceedings of the third workshop on very large corpora (pp. 121-130).
2. Church K.W., and Gale W.A. Poisson mixtures. Journal of Natural Language Engineering 1 2 (1995) 163-190
3. Forman G. Feature selection for text classification. Computational methods of feature selection (2007), Chapman and Hall/CRC Press, USA 57-276
4. Guyon I., and Elisseeff A. An introduction to variable and feature selection. Journal of Machine Learning Research 3 (2003) 1157-1182
5. Jansche, M. (2003). Parametric models of linguistic count data. In Proceedings of the 41st annual meeting on association for computational linguistics (Vol. 1, pp. 288-295).
6. Joachims T. Text categorization with support vector machines: Learning with many relevant features. Proceedings of the 10th European conference on machine learning (1998), Springer, New York 137-142
7. Joachims, T. (2002). Learning to classify text using support vector machines. Dissertation. Kluwer.
8. Larsen R.J., and Marx M.L. An introduction to mathematical statistics and its applications. 4th ed. (2006), Pearson Education International
9. Lewis, D. D. (1997). Reuters-21578 text categorization collection. .
10. Porter M. An algorithm for suffix stripping. Automated Library and Information Systems 14 3 (1980) 130-137
11. Sebastiani F. Machine learning in automated text categorization. ACM Computing Surveys 34 1 (2002) 1-47
12. Shang W., Huang H., Zhu H., and Lin Y. A novel feature selection algorithm for text categorization. Expert System with Applications 33 (2007) 1-5
13. Tan P., Steinbach M., and Kumar V. Introduction to data mining (2006), Pearson Education International
14. Yamamoto M., and Church K.W. Using suffix arrays to compute term frequency and document frequency for all substrings in a corpus. Computational Linguistics 27 1 (2001) 1-30
15. Yang Y., and Pedersen J.O. A comparative study on feature selection in text categorization. Proceedings of the 14th international conference on machine learning (1997), Nashville 412-420