Hybrid dimension reduction by integrating feature selection with feature extraction method for text clustering

Expert Systems with Applications

Volumn 42, Issue 6, 2015, Pages 3105-3114

  Bharti, Kusum Kumari ^a   Singh, Pramod Kumar ^a  

^a ABV INDIAN INSTITUTE OF INFORMATION TECHNOLOGY AND MANAGEMENT   (India)

Author keywords

Document frequency; Feature extraction; Feature selection; Principal component analysis; Term variance; Text clustering

Indexed keywords

CLUSTER ANALYSIS; COMPUTATIONAL COMPLEXITY; EXTRACTION; PRINCIPAL COMPONENT ANALYSIS; REDUCTION; TEXT PROCESSING;

DIMENSION REDUCTION METHOD; DOCUMENT FREQUENCY; FEATURE EXTRACTION METHODS; FEATURE SELECTION METHODS; FEATURE SUBSET SELECTION; INTEGRATION APPROACH; TERM VARIANCE; TEXT CLUSTERING;

FEATURE EXTRACTION;

EID: 84919781928     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2014.11.038     Document Type: Article

References (56)

1. A. Akadi, A. Amine, A. Ouardighi, and D. Aboutajdine A two-stage gene selection scheme utilizing MRMR filter and GA wrapper Knowledge and Information System 26 2011 487 500
2. A. Arauzo-Azofra, J.L. Aznarte, and J.M. Benítez Empirical study of feature selection methods based on individual feature evaluation for classification problems Expert Systems with Applications 38 2011 8170 8177
3. K.K. Bharti, and P.K. Singh A three-stage unsupervised dimension reduction method for text clustering Journal of Computational Science 5 2014 156 169
4. A.L. Blum, and P. Langley Selection of relevant features and examples in machine learning Artificial Intelligence 97 1997 245 271
5. Bradley, P.S., & Mangasarian, O.L. (1998). Feature selection via concave minimization and support vector machines. In Proceedings of the 15th international conference on machine learning (ICML) (Vol. 98, pp. 82-90).
6. Buckley, C., Singhal, A., Mitra, M., & Salton, G. (1995). New retrieval approaches using smart: Trec 4. In Proceedings of the fourth text retrieval conference (TREC-4) (pp. 25-48).
7. C.J. Burges Geometric methods for feature extraction and dimensional reduction Data mining and knowledge discovery handbook 2005 Springer 59 91
8. P. Comon Independent component analysis, a new concept? Signal Processing 36 1994 287 314
9. D.R. Cutting, D.R. Karger, J.O. Pedersen, and J.W. Tukey Scatter/gather: A cluster-based approach to browsing large document collections Proceedings of the 15th annual international ACM SIGIR conference on research and development in information retrieval 1992 ACM 318 329
10. Deerwester, S. (1988). Improving information retrieval with latent semantic indexing. In Proceedings of the 51st annual meeting of the american society for information science (Vol. 25, pp. 36-40).
11. A.P. Dempster, N.M. Laird, and D.B. Rubin Maximum likelihood from incomplete data via the EM algorithm Journal of the Royal statistical Society 39 1977 1 38
12. A.J. Ferreira, and M.A. Figueiredo Efficient feature selection filters for high-dimensional data Pattern Recognition Letters 33 2012 1794 1804
13. F. Figueiredo, L. Rocha, T. Couto, T. Salles, M.A. Gonçalves, and W. Meira Jr. Word co-occurrence features for text classification Information Systems 36 2011 843 858
14. H. Hsu, C. Hsieh, and M. Lu Hybrid feature selection by combining filters and wrappers Expert Systems with Applications 38 2011 8144 8150
15. S. Huang, X. Peng, Z. Niu, and K. Wang News topic detection based on hierarchical clustering and named entity 2011 7th international conference on natural language processing and knowledge engineering (NLP-KE) 2011 IEEE 280 284
16. D.A. Hull Stemming algorithms: A case study for detailed evaluation Journal of the American Society for Information Science 47 1996 70 84
17. M. Janaki Meena, K. Chandran, A. Karthik, and A. Vijay Samuel An enhanced ACO algorithm to select features for text categorization and its parallelization Expert Systems with Applications 39 2012 5861 5871
18. M.M. Kabir, M. Shahjahan, and K. Murase A new hybrid ant colony optimization algorithm for feature selection Expert Systems with Applications 39 2012 3747 3763
19. Kira, K., & Rendell, L. A. (1992). The feature selection problem: Traditional methods and a new algorithm. In Proceedings of the 10th national conference on artificial intelligence (AAAI) (pp. 129-134).
20. Koller, D., & Sahami, M. (1997). Hierarchically classifying documents using very few words. In Proceedings of the 14th international conference on machine learning (ML) (pp. 170-178).
21. I. Kononenko Estimating attributes: analysis and extensions of relief Proceedings of the European conference on machine learning (ECML) 1994 Springer 171 182
22. H.-P. Kriegel, P. Kröger, J. Sander, and A. Zimek Density-based clustering Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery 1 2011 231 240
23. Kruskal, J.B., & M., Wish. (1978). Multidimensional scaling. Sage university paper series on quantitative application in the social sciences.
24. Y. Li, C. Luo, and S.M. Chung Text clustering with feature selection by using statistical data IEEE Transactions on Knowledge and Data Engineering 20 2008 641 652
25. Liu, L., Kang, J., Yu, J., & Wang, Z. (2005). A comparative study on unsupervised feature selection methods for text clustering. In Proceeding of international conference on natural language processing and knowledge engineering (pp. 597-601).
26. C.H. Li, J.C. Yang, and S.C. Park Text categorization algorithms using semantic approaches, corpus-based thesaurus and wordnet Expert Systems with Applications 39 2012 765 772
27. MacQueen, J. et al. (1967). Some methods for classification and analysis of multivariate observations. In Proceedings of the 5th Berkeley symposium on mathematical statistics and probability (Vol. 1, pp. 281-297). California, USA.
28. S. Maldonado, and R. Weber A wrapper method for feature selection using support vector machines Information Sciences 179 2009 2208 2217
29. J. Menga, H. Lin, and Y. Yu A two-stage feature selection method for text categorization Computer and Mathematics with Applications 62 2011 2793 2800
30. S.S. Mengle, and N. Goharian Ambiguity measure feature-selection algorithm Journal of the American Society for Information Science and Technology 60 2009 1037 1050
31. J. Miranda, R. Montoya, and R. Weber Linear penalization support vector machines for feature selection Pattern Recognition and Machine Intelligence 2005 Springer 188 192
32. P. Pantel, and D. Lin Document clustering with committees Proceedings of the 25th annual international ACM SIGIR conference on research and development in information retrieval 2002 ACM 199 206
33. K. Pearson On lines and planes of closest fit to systems of points in space The London, Edinburgh, and Dublin Philosophical Magazine and Journal of Science 2 1901 559 572
34. H. Peng, F. Long, and C. Ding Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy IEEE Transactions on Pattern Analysis and Machine Intelligence 27 2005 1226 1238
35. J.R. Quinlan Induction of decision trees Machine Learning 1 1986 81 106
36. J.W. Reed, Y. Jiao, T.E. Potok, B.A. Klump, M.T. Elmore, and A.R. Hurson TF-ICF: A new term weighting scheme for clustering dynamic data streams 5th International conference on machine learning and applications (ICMLA) 2006 IEEE 258 263
37. Robertson, S. E., & Walker, S. (1999). Okapi/keenbow at trec-8. In Text retrieval conference (TREC) (Vol. 8, pp. 151-162).
38. Y. Saeys, I. Inza, and P. Larrañaga A review of feature selection techniques in bioinformatics Bioinformatics 23 2007 2507 2517
39. B. Sahu, and D. Mishra A novel feature selection algorithm using particle swarm optimization for cancer microarray data Procedia Engineering 38 2012 27 31
40. G. Salton, and C. Buckley Term-weighting approaches in automatic text retrieval Information processing & management 24 1988 513 523
41. G. Salton, A. Wong, and C. Yang A vector space model for automatic indexing Communications of the ACM 18 1975 613 620
42. W. Shang, H. Huang, H. Zhu, Y. Lin, Y. Qu, and Z. Wang A novel feature selection algorithm for text categorization Expert Systems with Applications 33 2007 1 5
43. Smith, L. I. (2002). A tutorial on principal components analysis (Vol. 51, p. 52). Cornell University, USA.
44. W. Song, and S. Park Genetic algorithm for text clustering based on latent semantic indexing Computers and Mathematics with Applications 57 2009 1901 1907
45. M. Tenenhaus, V.E. Vinzi, Y.-M. Chatelin, and C. Lauro PLS path modeling Computational Statistics & Data Analysis 48 2005 159 205
46. C.-F. Tsai, and Y.-C. Hsiao Combining multiple feature selection methods for stock prediction: Union, intersection, and multi-intersection approaches Decision Support Systems 50 2010 258 269
47. H. Uguz A two-stage feature selection method for text categorization by using information gain, principal component analysis and genetic algorithm Knowledge-Based Systems 24 2012 1024 1032
48. A. Unler, A. Murat, and R. Chinnam mr2PSO: A maximum relevance minimum redundancy feature selection method based on swarm intelligence for support vector machine classification Information Sciences 181 2011 4625 4641
49. H. Uʇuz A two-stage feature selection method for text categorization by using information gain, principal component analysis and genetic algorithm Knowledge-Based Systems 24 2011 1024 1032
50. X. Wang, and K.K. Paliwal Feature extraction and dimensionality reduction algorithms and their applications in vowel recognition Pattern Recognition 36 2003 2429 2439
51. J. Weston, A. Elisseeff, B. Schölkopf, and M. Tipping Use of the zero norm with linear models and kernel methods The Journal of Machine Learning Research 3 2003 1439 1461
52. Y.-L. Wu, C.-Y. Tang, M.-K. Hor, and P.-F. Wu Feature selection using genetic algorithm and cluster validation Expert Systems with Applications 38 2011 2727 2732
53. Y. Yang Noise reduction in a statistical approach to text categorization Proceedings of the 18th annual international ACM SIGIR conference on research and development in information retrieval 1995 ACM 256 263
54. J. Yan, N. Liu, S. Yan, Q. Yang, W. Fan, and W. Wei Trace-oriented feature analysis for large-scale text data dimension reduction IEEE Transactions on Knowledge and Data Engineering 23 2011 1103 1117
55. Zamir, O., Etzioni, O., Madani, O., & Karp, R. M. (1997). Fast and intuitive clustering of web documents. In Proceedings of the 3rd International Conference on Knowledge Discovery and Data Mining (Vol. 97, pp. 287-290).
56. Zhang, Y., Ding, C., & Li, T. (2008). Gene selection algorithm by combining ReliefF and mRMR. In IEEE 7th international conference on bioinformatics and bioengineering (pp. 127-132).