A novel probabilistic feature selection method for text classification

Knowledge-Based Systems

Volumn 36, Issue , 2012, Pages 226-235

  Uysal, Alper Kursat ^a   Gunal, Serkan ^a  

^a ANADOLU UNIVERSITY   (Turkey)

Author keywords

Dimension reduction; Feature selection; Filter; Pattern recognition; Text classification

Indexed keywords

CLASSIFICATION ACCURACY; CLASSIFICATION ALGORITHM; DATA SETS; DIMENSION REDUCTION; FEATURE SELECTION METHODS; FEATURE SPACE; FILTER; FILTER APPROACH; FILTER-BASED; GINI INDEX; HIGH DIMENSIONALITY; INFORMATION GAIN; PROCESSING TIME; SUCCESS MEASURE; TEXT CLASSIFICATION;

CLASSIFICATION (OF INFORMATION); FEATURE EXTRACTION; PATTERN RECOGNITION; POISSON DISTRIBUTION;

TEXT PROCESSING;

EID: 84867846144     PISSN: 09507051     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.knosys.2012.06.005     Document Type: Article

References (43)

1. T.A. Almeida, J.M.G. Hidalgo, A. Yamakami, Contributions to the study of SMS spam filtering: new collection and results, in: Proceedings of the 11th ACM Symposium on Document, Engineering, 2011, pp. 259-262.
2. I. Anagnostopoulos, C. Anagnostopoulos, V. Loumos, and E. Kayafas Classifying web pages employing a probabilistic neural network IEE Proceedings - Software 151 3 2004 139 150
3. A. Asuncion, and D.J. Newman UCI Machine Learning Repository 2007 University of California, Department of Information and Computer Science Irvine, CA
4. C.M. Bishop Pattern Recognition and Machine Learning 2006 Springer-Verlag Inc. New York
5. D.B. Bracewell, J. Yan, F. Ren, and S. Kuroiwa Category classification and topic discovery of Japanese and English news articles Electronic Notes in Theoretical Computer Science 225 2009 51 65
6. J. Chen, H. Huang, S. Tian, and Y. Qu Feature selection for text classification with Naive Bayes Expert Systems with Applications 36 3 2009 5432 5435
7. R.-C. Chen, and C.-H. Hsieh Web page classification based on a support vector machine using a weighted vote schema Expert Systems with Applications 31 2 2006 427 435
8. Y.-T. Chen, and M.C. Chen Using chi-square statistics to measure similarities for text categorization Expert Systems with Applications 38 4 2011 3085 3090
9. N. Cheng, R. Chandramouli, and K.P. Subbalakshmi Author gender identification from text Digital Investigation 8 1 2011 78 88
10. H. Drucker, D. Wu, and V. Vapnik Support vector machines for spam categorization IEEE Transactions on Neural Networks 10 5 1999
11. S. Efstathios Author identification: using text sampling to handle the class imbalance problem Information Processing and Management 44 2 2008 790 799
12. L. Fausett Fundamentals of Neural Networks: Architectures, Algorithms, and Applications 1994 Prentice-Hall, Inc.
13. G. Forman An extensive empirical study of feature selection metrics for text classification Journal of Machine Learning Research 3 2003 1289 1305
14. S. Gunal, Hybrid feature selection for text classification, Turkish Journal of Electrical Engineering and Computer Sciences (in press), doi: 10.3906/elk-1101-1064.
15. S. Gunal, and R. Edizkan Subspace based feature selection for pattern recognition Information Sciences 178 19 2008 3716 3726
16. S. Gunal, S. Ergin, M.B. Gulmezoglu, and O.N. Gerek On feature extraction for spam e-mail detection Lecture Notes in Computer Science 4105 2006 635 642
17. S. Gunal, O.N. Gerek, D.G. Ece, and R. Edizkan The search for optimal feature set in power quality event classification Expert Systems with Applications 36 7 2009 10266 10273
18. I. Guyon, and A. Elisseeff An introduction to variable and feature selection Journal of Machine Learning Research 3 2003 1157 1182
19. T.S. Guzella, and W.M. Caminhas A review of machine learning approaches to spam filtering Expert Systems with Applications 36 7 2009 10206 10222
20. C.-W. Hsu, and C.-J. Lin A comparison of methods for multiclass support vector machines IEEE Transactions on Neural Networks 13 2 2002 415 425
21. T. Joachims, A probabilistic analysis of the Rocchio algorithm with TFIDF for text categorization, in: Proceedings of the 14th International Conference on Machine Learning, 1997, pp. 143-151.
22. T. Joachims, Text categorization with support vector machines: learning with many relevant features, in: Proceedings of the 10th European Conference on Machine Learning, 1998, pp. 137-142.
23. D.E. Johnson, F.J. Oles, T. Zhang, and T. Goetz A decision-tree-based symbolic rule induction system for text categorization IBM Systems Journal 41 3 2002 428 437
24. R. Kohavi, and G.H. John Wrappers for feature subset selection Artificial Intelligence 97 1997 273 324
25. M.A. Kumar, and M. Gopal A comparison study on multiple binary-class SVM methods for unilabel text categorization Pattern Recognition Letters 31 11 2010 1437 1444
26. C. Lee, and G.G. Lee Information gain and divergence-based feature selection for machine learning-based text categorization Information Processing and Management 42 1 2006 155 165
27. H. Liu, J. Sun, L. Liu, and H. Zhang Feature selection with dynamic mutual information Pattern Recognition 42 7 2009 1330 1339
28. C.D. Manning, P. Raghavan, and H. Schtze Introduction to Information Retrieval 2008 Cambridge University Press New York, USA
29. S.S.R. Mengle, and N. Goharian Ambiguity measure feature-selection algorithm Journal of the American Society for Information Science and Technology 60 5 2009 1037 1050
30. V. Metsis, I. Androutsopoulos, G. Paliouras, Spam filtering with naive Bayes - which naive Bayes? in: Proceedings of the 3rd Conference on Email and Anti-Spam, 2006.
31. D. Mladenic, and M. Grobelnik Feature selection on hierarchy of web documents Decision Support Systems 35 1 2003 45 87
32. H. Ogura, H. Amano, and M. Kondo Feature selection with a measure of deviations from Poisson in text categorization Decision Support Systems 36 3 2009 6826 6832
33. S.A. Ozel A web page classification system based on a genetic algorithm using tagged-terms as features Expert Systems with Applications 38 4 2011 3407 3415
34. M.F. Porter An algorithm for suffix stripping Program 14 3 1980 130 137
35. Y. Saeys, I. Inza, and P. Larranaga A review of feature selection techniques in bioinformatics Bioinformatics 23 19 2007 2507 2517
36. W. Shang, H. Huang, H. Zhu, Y. Lin, Y. Qu, and Z. Wang A novel feature selection algorithm for text categorization Expert Systems with Applications 33 1 2007 1 5
37. S. Theodoridis, and K. Koutroumbas Pattern Recognition fourth ed. 2008 Academic Press
38. H. Uguz A two-stage feature selection method for text categorization by using information gain, principal component analysis and genetic algorithm Knowledge-Based Systems 24 7 2011 1024 1032
39. K. Wu, B.L. Lu, M. Uchiyama, and H. Isahara A probabilistic approach to feature selection for multi-class text categorization Lecture Notes in Computer Science 4491 2007 1310 1317
40. J. Yang, Y. Liu, Z. Liu, X. Zhu, and X. Zhang A new feature selection algorithm based on binomial hypothesis testing for spam filtering Knowledge-Based Systems 24 6 2011 904 914
41. Y. Yang, Noise reduction in a statistical approach to text categorization, in: Proceedings of the ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR'95), 1995, pp. 256-263.
42. Y. Yang, J.O. Pedersen, A comparative study on feature selection in text categorization, in: Proceedings of the 14th International Conference on Machine Learning, 1997, pp. 412-420.
43. B. Yu, and D.-h. Zhu Combining neural networks and semantic feature space for email classification Knowledge-Based Systems 22 5 2009 376 381