Feature subset selection using naive Bayes for text classification

Pattern Recognition Letters

Volumn 65, Issue , 2015, Pages 109-115

  Feng, Guozhong ^a   Guo, Jianhua ^a   Jing, Bing Yi ^b   Sun, Tieli ^a  

^a NORTHEAST NORMAL UNIVERSITY   (China)

^b HONG KONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Hong Kong)

Author keywords

Bayesian model averaging; Global selection index; Latent selection augmented naive Bayes; Local selection index; Text classification

Indexed keywords

BAYESIAN NETWORKS; CLASSIFICATION (OF INFORMATION); CLASSIFIERS; NUMERICAL METHODS; TEXT PROCESSING;

BAYESIAN MODEL AVERAGING; GLOBAL SELECTIONS; NAIVE BAYES; SELECTION INDEXES; TEXT CLASSIFICATION;

FEATURE EXTRACTION;

EID: 84939803083     PISSN: 01678655     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patrec.2015.07.028     Document Type: Article

References (32)

1. B. An, H. Wang, and J. Guo Testing the statistical significance of an ultra-high-dimensional naive Bayes classifier Stat. Interf. 6 2013 223 229
2. K. Bache, and M. Lichman UCI Machine Learning Repository 2013 University of California, School of Information and Computer Science Irvine, CA
3. M. Boullé Compression-based averaging of selective naive Bayes classifiers J. Mach. Learn. Res. 8 2007 1659 1685
4. C. Chang, and C. Lin LIBSVM: a library for support vector machines ACM Trans. Intell. Syst. Technol. 2 3 2011 27
5. D. Dash, and G. Cooper Exact model averaging with naive Bayesian classifiers Proceedings of the Nineteenth International Conference on Machine Learning 2002 91 98
6. D. Dash, and G. Cooper Model averaging for prediction with discrete Bayesian networks J. Mach. Learn. Res. 5 2004 1177 1203
7. B. Efron The efficiency of logistic regression compared to normal discriminant analysis J. Am. Stat. Assoc. 70 1975 892 898
8. G. Feng, J. Guo, B. Jing, and L. Hao A Bayesian feature selection paradigm for text classification Inform. Process. Manage. 48 2012 283 302
9. G. Forman An extensive empirical study of feature selection metrics for text classification J. Mach. Learn. Res. 3 2003 1289 1305
10. A. Gelman, J.B. Carlin, H.S. Stern, and D.B. Rubin Bayesian Data Analysis 2014 Taylor & Francis
11. P.J. Green Reversible jump Markov chain Monte Carlo computation and Bayesian model determination Biometrika 82 4 1995 711 732
12. I. Guyon, and A. Elisseeff An introduction to variable and feature selection J. Mach. Learn. Res. 3 2003 1157 1182
13. I. Guyon, S. Gunn, A. Ben-Hur, and G. Dror Result analysis of the NIPS 2003 feature selection challenge NIPS 17 2004 545 552
14. T. Hastie, R. Tibshirani, and J. Friedman The Elements of Statistical Learning: Data Mining, Inference, and Prediction 2009 Springer New York
15. J.A. Hoeting, D. Madigan, A.E. Raftery, and C.T. Volinsky Bayesian model averaging: a tutorial Stat. Sci. 14 1999 382 417
16. K.S. Jones A statistical interpretation of term specificity and its application in retrieval J. Docum. 28 1972 11 21
17. K.S. Jones, S. Walker, and S.E. Robertson A probabilistic model of information retrieval: development and comparative experiments Inform. Process. Manage. 36 2000 779 840
18. S.B. Kim, H.C. Seo, and H.C. Rim Poisson naive Bayes for text classification with feature weighting Proceedings of the Sixth International Workshop on Information Retrieval with Asian Languages 11 2003 33 40
19. J. Lafferty, and C. Zhai Probabilistic Relevance Models based on Document and Query Generation in Language Modeling for Information Retrieval 2003 Kluwer Academic Publishers
20. M. Lan, C.L. Tan, J. Su, and Y. Lu Supervised and traditional term weighting methods for automatic text categorization IEEE Trans. Pattern Anal. Mach. Intell. 31 4 2009 721 735
21. P. Langley, and S. Sage Induction of selective Bayesian classifiers Proceedings of the 10th Conference on Uncertainty in Artificial Intelligence 1994 399 406
22. C.H. Lee, F. Gutierrez, and D. Dou Calculating feature weights in naive Bayes with Kullback-Leibler measure Proceedings of ICDM 2011 1146 1151
23. D.D. Lewis Naive (Bayes) at forty: the independence assumption in information retrieval Proceedings of the 10th European Conference on Machine Learning 1998 4 15
24. D. Madigan, and A.E. Raftery Model selection and accounting for model uncertainty in graphical models using Occam's window J. Am. Stat. Assoc. 89 1994 1535 1546
25. C. Manning, and D. Klein Optimization, Maxent models, and conditional estimation without magic Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology: Tutorials-Volume 5 2003 8
26. A. McCallum, and K. Nigam A comparison of event models for naive Bayes text classification AAAI-98 Workshop on Learning for Text Categorization 752 1998 41 48
27. A.Y. Ng, and M.I. Jordan On discriminative vs. generative classifiers: A comparison of logistic regression and naive Bayes NIPS 2001 841 848
28. M. Rogati, and Y. Yang High-performing variable selection for text classification CIKM '02 Proceedings of the 11th International Conference on Information and Knowledge Management 2002 659 661
29. F. Sebastiani Machine learning in automated text categorization ACM Comput. Surv. 34 1 2002 1 47
30. F. Sha, and F. Pereira Shallow parsing with conditional random fields Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology-Volume 1 2003 134 141
31. S. Wang, and C.D. Manning Baselines and bigrams: simple, good sentiment and topic classification Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics: Short Papers-Volume 2 2012 90 94
32. Y. Yang, and J.O. Pedersen A comparative study on feature selection in text categorization The Fourteenth International Conference on Machine Learning (ICML 97) 1997 412 420