A new feature selection algorithm based on binomial hypothesis testing for spam filtering

Knowledge-Based Systems

Volumn 24, Issue 6, 2011, Pages 904-914

  Yang, Jieming ^a,b   Liu, Yuanning ^a   Liu, Zhen ^a,c   Zhu, Xiaodong ^a   Zhang, Xiaoxu ^a  

^a JILIN UNIVERSITY   (China)

^b NORTHEAST ELECTRIC POWER UNIVERSITY   (China)

^c NAGASAKI INSTITUTE OF APPLIED SCIENCE   (Japan)

Author keywords

Binomial distribution; Binomial hypothesis testing; Feature selection; Spam filtering; Text categorization

Indexed keywords

BINOMIAL DISTRIBUTION; BINOMIAL HYPOTHESIS TESTING; FEATURE SELECTION; SPAM FILTERING; TEXT CATEGORIZATION;

ALGORITHMS; INTERNET; POISSON DISTRIBUTION; SUPPORT VECTOR MACHINES; TEXT PROCESSING;

FEATURE EXTRACTION;

EID: 79957440082     PISSN: 09507051     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.knosys.2011.04.006     Document Type: Article

References (40)

1. I. Androutsopoulos, J. Koutsias, K.V. Chandrinos, G. Paliouras, C.D. Spyropoulos, An evaluation of Naive Bayesian anti-spam filtering, in: Proceedings of the workshop on Machine Learning in the New Information Age, 11th European Conference on Machine Learning. Barcelona, Spain, 2000, pp. 9-17.
2. I. Androutsopoulos, G. Paliouras, E. Michelakis, Learning to filter unsolicited commercial E-mail, in: Technical Report NCSR Demokritos, 2004.
3. A.L. Blum, and P. Langley Selection of relevant features and examples in machine learning Artificial Intelligence 97 1997 245 271 (Pubitemid 127401106)
4. C.-C. Chang, C.-J. Lin, LIBSVM: a library for support vector machines, 2001. .
5. J. Chen, H. Huang, S. Tian, and Y. Qu Feature selection for text classification with Naive Bayes Expert Systems with Applications 36 2009 5432 5435
6. Z. Chen, and K. Lu A preprocess algorithm of filtering irrelevant information based on the minimum class difference Knowledge-Based System 19 2006 422 429 (Pubitemid 44293386)
7. W.J. Conover Practical Nonparametric Statistics third ed. 1998 Wiley New York
8. J. Demšar Statistical comparisons of classifiers over multiple data sets Journal of Machine Learning Research 7 2006 1 30 (Pubitemid 43022939)
9. H. Drucker, D. Wu, and V.N. Vapnik Support vector machines for spam categorization IEEE Transactions on Neural Networks 10 1999 1048 1054
10. T. Fawcett An introduction to ROC analysis Pattern Recognition Letters 27 2006 861 874
11. G. Forman An extensive empirical study of feature selection metrics for text classification Journal of Machine Learning Research 3 2003 1289 1305
12. D. Fragoudis, D. Meretakis, and S. Likothanassis Best terms: an efficient feature-selection algorithm for text categorization Knowledge and Information Systems 8 2005 16 33 (Pubitemid 40743372)
13. S. García, A. Fernández, J. Luengo, and F. Herrera A study of statistical techniques and performance measures for genetics-based machine learning: Accuracy and interpretability Soft Computing - A Fusion of Foundations, Methodologies and Applications 13 2009 959 977
14. S. García, and F. Herrera An extension on "statistical comparisons of classifiers over multiple data sets" for all pairwise comparisons Journal of Machine Learning Research 9 2008 2677 2694
15. T.S. Guzella, and W.M. Caminhas A review of machine learning approaches to spam filtering Expert Systems with Applications 36 2009 10206 10222
16. S. Holm A simple sequentially rejective multiple test procedure Scandinavian Journal of Statistics 6 1979 65 70
17. R.L. Iman, and J.M. Davenport Approximations of the critical region of the Friedman statistic Communications in Statistics 18 1980 571 579
18. Joachims, T., 1998. Text categorization with support vector machines: learning with many relevant features, in: C.N.C. Rouveirol (Ed.), Proceedings of the ECML-98, 10th European Conference on Machine Learning, Heidelberg, DE, Chemnitz, DE, pp. 137-142. (Pubitemid 128067178)
19. G.H. John, R. Kohavi, K. Pfleger, Irrelevant Features and the subset selection problem, in: Machine Learning: Proceedings of the Eleventh International Conference. San Francisco, CA, 1994, pp. 121-129.
20. C. Lee, and G.G. Lee Information gain and divergence-based feature selection for machine learning-based text categorization Infromation Processing and Management 42 2006 155 165 (Pubitemid 41119082)
21. D.D. Lewis, Evaluating text categorization, in: Proceedings of the Workshop on Speech and Natural Language Publishing, Pacific Grove, California, 1991, pp. 312-318.
22. D.D. Lewis, Feature selection and feature extraction for text categorization, in: Proceedings of the Workshop on Speech and Natural Language, Harriman, New York, 1992, pp. 212-217.
23. A. McCallum, K. Nigam, A comparison of event models for Naive Bayes text classification, in: AAAI-98 Workshop on Learning for Text Categorization, 1998.
24. S.S.R. Mengle, and N. Goharian Ambiguity measure feature-selection algorithm Journal of the American Society for Information Science and Technology 60 2009 1037 1050
25. D. Mladenic, M. Grobelnik, Feature selection for unbalanced class distribution and Naive Bayes, in: Proceedings of the Sixteenth International Conference on Machine Learning, 1999, pp. 258-267.
26. D. Mladenic, and M. Grobelnik Feature selection on hierarchy of web documents Decision Support Systems 35 2003 45 87
27. H. Ogura, H. Amano, and M. Kondo Feature selection with a measure of deviations from Poisson in text categorization Expert Systems with Applications 36 2009 6826 6832
28. M. Palatucci, A. Carlson, On the chance accuracies of large collections of classifiers, in: Proceedings of the 25th International Conference on Machine Learning, Helsinki, Finland, 2008, pp. 744-751.
29. C. Pozna, R.-E. Precup, J.K. Tar, I. Skrjanc, and S. Preitl New results in modelling derived from Bayesian filtering Knowledge-Based Systems 23 2010 182 194
30. G. Robinson A statistical approach to the spam problem Linux Journal 2003 2003 1075 3583
31. K.-M. Schneider A comparison of event models for Naive Bayes anti-spam e-mail filtering ACM Transactions on Asian Language Information Processing (TALIP) 3 2004 243 269
32. F. Sebastiani Machine learning in automated text categorization ACM Computing Surveys 34 2002 1 47
33. W. Shang, H. Huang, and H. Zhu A novel feature selection algorithm for text categorization Expert Systems with Applications 33 2007 1 5 (Pubitemid 44959912)
34. F. Song, S. Liu, and J. Yang A comparative study on text representation schemes in text categorization Pattern Analysis & Applications 8 2005 199 209 (Pubitemid 41649106)
35. R.D.C. Team, R: a language and environment for statistical computing, Vienna, Austria, 2009. .
36. L. Wasserman All of Statistics: A Concise Course in Statistical Inference 2003 Springer New York
37. J.-M. Yang, and K.F. Li Recommendation based on rational inferences in collaborative filtering Knowledge-Based Systems 22 2009 105 114
38. Y. Yang, J.O. Pedersen, A comparative study on feature selection in text categorization, in: Proceedings of the Fourteenth International Conference on Machine Learning, 1997, pp. 412-420.
39. E. Youn, and M.K. Jeong Class dependent feature scaling method using Naive Bayes classifier for text datamining Pattern Recognition Letters 30 2009 477 485
40. B. Yu, and D.-h. Zhu Combining neural networks and semantic feature space for email classification Knowledge-Based Systems 22 2009 376 381