Distinctive characteristics of a metric using deviations from Poisson for feature selection

Expert Systems with Applications

Volumn 37, Issue 3, 2010, Pages 2273-2281

  Ogura, Hiroshi ^a   Amano, Hiromi ^a   Kondo, Masato ^a  

^a SHOWA UNIVERSITY   (Japan)

Author keywords

Feature selection; Imbalanced data; k NN classifier; Poisson distribution; Text categorization

Indexed keywords

AUTOMATIC TEXT CLASSIFICATION; CLASS DISTRIBUTIONS; DATA COLLECTION; EXTREME CASE; FEATURE SELECTION; GINI INDEX; IMBALANCED DATA; INFORMATION GAIN; K-NN CLASSIFIER; LIMITING BEHAVIOR; NEWSGROUPS; TERM IMPORTANCE; TEXT CATEGORIZATION; TEXT CLASSIFICATION;

CLASSIFICATION (OF INFORMATION); CLASSIFIERS; EXPERIMENTS; EXPERT SYSTEMS; FEATURE EXTRACTION; LEARNING SYSTEMS; METRIC SYSTEM; POISSON EQUATION; TEXT PROCESSING;

POISSON DISTRIBUTION;

EID: 70449522157     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2009.07.045     Document Type: Article

References (17)

1. Chawla N.V., Japkowicz N., and Kotcz A. Editorial: special issue on learning from imbalanced data sets. ACM SIGKDD Explorations Newsletter 6 1 (2004) 1-6
2. Church, K. W., & Gale, W. A. (1995b), Inverse document frequency (IDF): A measure of deviation from Poisson. In Proceedings of the third workshop on very large corpora, (pp. 121-130)..
3. Church K.W., and Gale W.A. Poisson mixtures. Journal of Natural Language Engineering 1 2 (1995) 163-190
4. Forman G. Feature selection for text classification. Computational methods of feature selection (2007), Chapman and Hall/CRC Press, USA 257-276
5. Joachims, T. (2002). Learning to classify text using support vector machines. Dissertation, Kluwer.
6. Kotsiantis S., and Pintelas P. Mixture of expert agents for handling imbalanced data sets. Annals of Mathematics, Computing and Teleinformatics 1 1 (2003) 46-55
7. Lang, K. (1995). NewsWeeder: Learning to filter netnews. In Proceedings of the 12th international machine learning conference (pp. 331-339). Morgan Kaufmann.
8. Mitchell T. Machine learning (1997), McGraw Hill
9. Mladenic D., and Grobelnik M. Feature selection for unbalanced class distribution and Naive Bayes. Proceedings of the 16th international conference on machine learning (1999), Morgan Kaufmann Publishers 258-267
10. Ogura H., Amano H., and Kondo M. Feature selection with a measure of deviations from Poisson in text categorization. Expert Systems with Applications 36 (2009) 6826-6832
11. Sebastiani F. Machine learning in automated text categorization. ACM Computing Surveys 34 1 (2002) 1-47
12. Shang W., Huang H., Zhu H., and Lin Y. A novel feature selection algorithm for text categorization. Expert Systems with Applications 33 (2007) 1-5
13. Tan S. An improved centroid classifier for text categorization. Expert Systems with Applications 35 (2008) 279-285
14. Tang, L., & Liu, H. (2005). Bias analysis in text classification for highly skewed data. In Proceedings of the fifth IEEE international conference on data mining (ICDM'05) (pp. 781-784). IEEE Computer Society.
15. Tan P., Steinbach M., and Kumar V. Introduction to data mining (2006), Pearson Education International
16. Yang, Y., & Pedersen, J. O. (1997). A comparative study on feature selection in text categorization. In Proceedings of the 14th international conference on machine learning (pp. 412-420). Nashville, USA.
17. Zheng Z., Wu X., and Srihari R. Feature selection for text categorization on imbalanced data. ACM SIGKDD Explorations Newsletter 6 1 (2004) 80-89