Data-driven global-ranking local feature selection methods for text categorization

Expert Systems with Applications

Volumn 42, Issue 4, 2015, Pages 1941-1949

  Pinheiro, Roberto H W ^a   Cavalcanti, George D C ^a   Ren, Tsang Ing ^a  

^a FEDERAL UNIVERSITY OF PERNAMBUCO   (Brazil)

Author keywords

ALOFT; Feature selection; Filtering method; High dimensionality; Text classification; Variable Ranking

Indexed keywords

CLASSIFICATION (OF INFORMATION); INFORMATION RETRIEVAL SYSTEMS; TEXT PROCESSING; VECTORS;

ALOFT; FILTERING METHOD; HIGH DIMENSIONALITY; TEXT CLASSIFICATION; VARIABLE RANKING;

FEATURE EXTRACTION;

EID: 84910619618     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2014.10.011     Document Type: Article

References (32)

1. Baccianella, S., Esuli, A., & Sebastiani, F. (2013). Using micro-documents for feature selection: The case of ordinal text classification. Expert Systems with Applications, 40, 4687-4696.
2. Bekkerman, R., El-Yaniv, R., Tishby, N., & Winter, Y. (2003). Distributional word clusters vs. words for text categorization. Journal of Machine Learning Research, 3, 1183-1208.
3. Bermejo, P., Gámez, J., & Puerta, J. (2014). Speeding up incremental wrapper feature subset selection with Naive Bayes classifier. Knowledge-Based Systems, 55, 140-147.
4. Breiman, L., Friedman, J., Stone, C., & Olshen, R. (1984). Classification and regression trees. Wadsworth International Group
5. Cai, D., Mei, Q., Han, J., & Zhai, C. (2008). Modeling hidden topics on document manifold. In Proceeding of the 17th ACM conference on information and knowledge management (CIKM'08) (pp. 911-920).
6. Chang, Y., Chen, S., & Liau, C. (2008). Multilabel text categorization based on a new linear classifier learning method and a category-sensitive refinement method. Expert Systems with Applications, 34, 1948-1953.
7. Chen, J., Huang, H., Tian, S., & Qu, Y. (2009). Feature selection for text classification with Naive Bayes. Expert Systems with Applications, 36, 5432-5435.
8. Debole, F., & Sebastiani, F. (2003). Supervised term weighting for automated text categorization. In Proceedings of the ACM symposium on applied computing (pp. 784-788). ACM.
9. Forman, G. (2003). An extensive empirical study of feature selection metrics for text classification. The Journal of Machine Learning Research, 3, 1289-1305.
10. Fragoudis, D., Meretakis, D., & Likothanassis, S. (2005). Best terms: An efficient feature-selection algorithm for text categorization. Knowledge and Information Systems, 8, 16-33.
11. Guyon, I., & Elisseeff, A. (2003). An introduction to variable and feature selection. The Journal of Machine Learning Research, 3, 1157-1182.
12. John, G., Kohavi, R., & Pfleger, K. (1994). Irrelevant features and the subset selection problem. In Proceedings of the international conference on machine learning (pp. 121-129).
13. Lewis, D. D. (1992). Feature selection and feature extraction for text categorization. In Proceedings of the workshop on speech and natural language, association for computational linguistics (pp. 212-217).
14. Manning, C., Raghavan, P., & Schtze, H. (2008). Introduction to information retrieval. Cambridge University Press.
15. McCallum, A., & Nigam, K. (1998). A comparison of event models for Naive Bayes text classification. In Workshop on learning for text categorization (pp. 41-48).
16. Meiri, R., & Zahavi, J. (2006). Using simulated annealing to optimize the feature selection problem in marketing applications. European Journal of Operational Research, 171, 842-858.
17. Mengle, S., & Goharian, N. (2009). Ambiguity measure feature-selection algorithm. Journal of the American Society for Information Science and Technology, 60, 1037-1050.
18. Mladenic, D., & Grobelnik, M. (1998). Feature selection for classification based on text hierarchy. In Text and the web, conference on automated learning and discovery, Citeseer.
19. Nigam, K., McCallum, A., Thrun, S., & Mitchell, T. (1998). Learning to classify text from labeled and unlabeled documents. In Proceedings of the national conference on artificial intelligence (pp. 792-799).
20. Pinheiro, R., Cavalcanti, G., Correa, R., & Ren, T. (2012). A global-ranking local feature selection method for text categorization. Expert Systems with Applications, 39, 12851-12857.
21. Quinlan, J. (1986). Induction of decision trees. Machine Learning, 1, 81-106.
22. Rogati, M., & Yang, Y. (2002). High-performing feature selection for text classification. In Proceedings of the international conference on information and knowledge management (pp. 661). ACM.
23. Sebastiani, F. (2002). Machine learning in automated text categorization. ACM Computing Surveys, 34, 1-47.
24. Shang, W., Huang, H., Zhu, H., Lin, Y., Qu, Y., & Wang, Z. (2007). A novel feature selection algorithm for text categorization. Expert Systems with Applications, 33, 1-5.
25. Taşci, Ş., & Güngör, T. (2013). Comparison of text feature selection policies and using an adaptive framework. Expert Systems with Applications, 40, 4871-4886.
26. Uysal, A., & Gunal, S. (2012). A novel probabilistic feature selection method for text classification. Knowledge-Based Systems, 36, 226-235.
27. Xue, X., & Zhou, Z. (2009). Distributional features for text categorization. IEEE Transactions on Knowledge and Data Engineering, 21, 428-442.
28. Yang, Y., & Pedersen, J. (1997). A comparative study on feature selection in text categorization. In Proceedings of the international conference on machine learning (pp. 412-420).
29. Yang, J., Liu, Y., Liu, Z., Zhu, X., & Zhang, X. (2011). A new feature selection algorithm based on binomial hypothesis testing for spam filtering. Knowledge-Based Systems, 24, 904-914.
30. Yang, J., Liu, Y., Zhu, X., Liu, Z., & Zhang, X. (2012). A new feature selection based on comprehensive measurement both in inter-category and intra-category for text categorization. Information Processing and Management: An International Journal, 48, 741-754.
31. Yan, J., Liu, N., Zhang, B., Yan, S., Chen, Z., Cheng, Q., et al. (2005). OCFS: Optimal orthogonal centroid feature selection for text categorization. In Proceedings of the ACM SIGIR conference on research and development in information retrieval (pp. 122-129). ACM.
32. Yu, L., & Liu, H. (2003). Feature selection for high-dimensional data: A fast correlation-based filter solution. In Proceedings of the international conference on machine leaning (pp. 856-863).