Unsupervised feature selection using clustering ensembles and population based incremental learning algorithm

Pattern Recognition

Volumn 41, Issue 9, 2008, Pages 2742-2756

  Hong, Yi ^a   Kwong, Sam ^a   Chang, Yuchou ^b   Ren, Qingsheng ^c  

^a CITY UNIVERSITY OF HONG KONG   (Hong Kong)

^b BRIGHAM YOUNG UNIVERSITY   (United States)

^c SHANGHAI JIAO TONG UNIVERSITY   (China)

Author keywords

Clustering ensembles; Dimensionality unbiased; Population based incremental learning algorithm; Unsupervised feature selection

Indexed keywords

CLUSTERING ALGORITHMS; DATABASE SYSTEMS; FEATURE EXTRACTION; SET THEORY;

CLUSTERING ENSEMBLES; DIMENSIONALITY UNBIASED; POPULATION BASED INCREMENTAL LEARNING ALGORITHM; UNSUPERVISED FEATURE SELECTION;

UNSUPERVISED LEARNING;

EID: 44649105615     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2008.03.007     Document Type: Article

References (34)

1. Fukunaga K. Introduction to Statistical Pattern Recognition (1990), Academic Press, San Deigo, California
2. Liu H., and Motoda H. Feature Selection for Knowledge Discovery and Data Mining (1998), Kluwer Academic Publishers, Boston
3. Blum A., and Langley P. Selection of relevant features and examples in machine learning. Artif. Intell. 97 (1997) 245-271
4. Kudo M., and Sklanshy J. Comparison of algorithms that select features for pattern classifier. Pattern Recognition 33 (2000) 25-41
5. Liu H., Dougherty E.R., Dy Jennifer G., Torkkola K., Tuv E., Peng H., Ding C., Long F., Berens M., Parsons L., Zhao Z., Yu L., and Forman G. Evolutionary feature selection. IEEE Intelligent Syst. 20 6 (2005) 64-76
6. Zhang H., and Sun G. Feature selection using tabu search method. Pattern Recognition 35 (2002) 701-711
7. S. Baluja, S. Davis, Removing the genetics from the standard genetic algorithm, in: Proceedings of the International Conference on Machine Learning, 1995, pp. 38-46.
8. Strehl A., and Ghosh J. Clustering ensembles-a knowledge reuse framework for combining multiple partitions. J. Mach. Learn. Res. 3 (2002) 583-617
9. Yang S., and Yao X. Experimental study on population-based incremental learning algorithms for dynamic optimization problems. Soft Comput. 9 (2005) 815-834
10. L. Yu, H. Liu, Feature selection for high-dimensional data: A fast correlation-based filter approach, in: Proceedings of the International Conference on Machine Learning, 2003.
11. Kohavi R., and John G.H. Wrappers for feature subset selection. Artif. Intell. 97 (1997) 273-324
12. M. Dash, K. Choi, P. Scheuermann, H. Liu, Feature selection for clustering-A filter solution, in: Proceedings of the IEEE International Conference on Data Mining, 2002, pp. 115-122.
13. Mitra P., and Murthy C.A. Unsupervised feature selection using feature similarity. IEEE Trans. Pattern Anal. Mach. Intell. 24 (2002) 301-312
14. Hong Y., Kwong S., Chang Y., and Ren Q. Consensus unsupervised feature ranking from multiple views. Pattern Recognition Lett. 29 (2008) 595-602
15. Dy J.G., and Brodley C.E. Feature selection for unsupervised learning. J. Mach. Learn. Res. 5 (2004) 845-889
16. Y. Kim, W. Street, F. Menczer, Feature selection for unsupervised learning via evolutionary search, in: Proceedings of the ACM SIGKDD Conference on Knowledge Discovery and Data Mining, 2000, pp. 365-369.
17. M. Morita, R. Sabourin, F. Bortolozzi, C.Y. Suen, Unsupervised feature selection using multi-objective genetic algorithms for handwritten word recognition, in: Proceedings of the International Conference on Document Analysis and Recognition, 2003.
18. Jain A.K., Murty M.N., and Flynn P.J. Data clustering: a review. ACM Comput. Sur. 13 (1999) 264-323
19. Fred A., and Jain A.K. Combining multiple clusterings using evidence accumulation. IEEE Trans. Pattern Anal. Mach. Intell. 27 (2005) 835-850
20. X.Z. Fern, C.E. Brodley, Clustering ensembles for high dimensional data clustering, in: Proceedings of the International Conference on Machine Learning, 2003, pp. 186-193.
21. Monti S., Tamaya P., Mesirov J., and Golub T. Consensus clustering: A resampling-based method for class discovery and visualization of gene expression moscovery data. J. Mach. Learn. 52 (2003) 91-118
22. Fischer B., and Buhmann J. Bagging for path-based clustering. IEEE Trans. Pattern Anal. Mach. Intell. 25 (2003) 1411-1415
23. Y.C. Chang, D.J. Lee, Y. Hong, J.K. Archibald, Unsupervised video shot detection using clustering ensemble with a color global scale-invariant feature transform descriptor, EURASIP Journal on Image and Video Processing 2008, Article ID 860743, 10 pages, February 2008.
24. Larrañaga P., and Lozano J.A. Estimation of Distribution Algorithm: A New Tool for Evolutionary Computation (2001), Kluwer Academic Publisher, Dordrecht
25. Inza I., Larrañaga P., Etxberria R., and Sierra B. Feature subset selection by Bayesian network based optimization. Artif. Intell. (2000) 157-184
26. Michael L. A simple method for generating additive clustering models with limited complexity. J. Mach. Learn. 49 (2002) 39-58
27. Handl J., and Knowles J. Feature subset selection in unsupervised learning via multiobjective optimization. Int. J. Comput. Intell. Res. 2 (2006) 217-238
28. Ho T.K. The random subspace method for constructing decision forests. IEEE Trans. Pattern Anal. Mach. Intell. 20 8 (1998) 832-844
29. M. Skurichina, R.P.W. Duin, Bagging and the random subspace method for redundant feature spaces, in: Proceedings of the International Workshop Multiple Classifier Systems, 2001.
30. Topchy A., Jain A.K., and Punch W. Clustering ensembles: models of consensus and weak partitions. IEEE Trans. Pattern Anal. Mach. Intell. 27 (2005) 207-215
31. Rand W.M. Objective criteria for the evaluation of clustering methods. J. Am. Stat. Assoc. 66 (1971) 846-850
32. Mühlenbein H. The equation for response to selection and its use for prediction. Evol. Comput. 5 (1998) 303-346
33. Shin H.W., and Sohn S.Y. Selected tree classifier combination based on both accuracy and error diversity. Pattern Recognition 38 (2005) 191-197
34. Suganthan P.N. Pattern classification using multiple hierarchical overlapped self-organising maps. Pattern Recognition 34 (2001) 2173-2179