Discriminative embedded clustering: A framework for grouping high-dimensional data

IEEE Transactions on Neural Networks and Learning Systems

Volumn 26, Issue 6, 2015, Pages 1287-1299

  Hou, Chenping ^a   Nie, Feiping ^b   Yi, Dongyun ^a   Tao, Dacheng ^c  

^a NATIONAL UNIVERSITY OF DEFENSE TECHNOLOGY   (China)

^b University of Texas at Arlington   (United States)

^c UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

Author keywords

Clustering; Dimensionality reduction; Discriminative embedded clustering (DEC); High dimensional data; Subspace learning

Indexed keywords

ARTIFICIAL INTELLIGENCE; CLUSTERING ALGORITHMS; DATA MINING; DATA REDUCTION; ITERATIVE METHODS; LEARNING SYSTEMS; OPTIMIZATION;

CLUSTERING; DIMENSIONALITY REDUCTION; DISCRIMINATIVE EMBEDDED CLUSTERING (DEC); HIGH DIMENSIONAL DATA; SUBSPACE LEARNING;

REDUCTION;

EID: 84930210143     PISSN: 2162237X     EISSN: 21622388     Source Type: Journal    
DOI: 10.1109/TNNLS.2014.2337335     Document Type: Article

References (45)

1. J. Shi and J. Malik, "Normalized cuts and image segmentation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 8, pp. 888-905, Aug. 2000.
2. A. Y. Ng, M. I. Jordan, and Y. Weiss, "On spectral clustering: Analysis and an algorithm," in Advances in Neural Information Processing Systems. Cambridge, MA, USA: MIT Press, 2001, pp. 849-856.
3. L. Xu, J. Neufeld, B. Larson, and D. Schuurmans, "Maximum margin clustering," in Advances in Neural Information Processing Systems. Cambridge, MA, USA: MIT Press, 2004.
4. F. Nie, Z. Zeng, I. W. Tsang, D. Xu, and C. Zhang, "Spectral embedded clustering: A framework for in-sample and out-of-sample spectral clustering," IEEE Trans. Neural Netw., vol. 22, no. 11, pp. 1796-1808, Nov. 2011.
5. C. Hou, F. Nie, D. Yi, and Y. Wu, "Efficient image classification via multiple rank regression," IEEE Trans. Image Process., vol. 22, no. 1, pp. 340-352, Jan. 2013.
6. C. Hou, F. Nie, C. Zhang, D. Yi, and Y. Wu, "Multiple rank multi-linear SVM for matrix data classification," Pattern Recognit., vol. 47, no. 1, pp. 454-469, 2014.
7. J. Li and D. Tao, "Simple exponential family PCA," IEEE Trans. Neural Netw. Learn. Syst., vol. 24, no. 3, pp. 485-497, Mar. 2013.
8. R. O. Duda, P. E. Hart, and D. G. Stork, Pattern Classification, 2nd ed. New York, NY, USA: Wiley, 2000.
9. H. Park, M. Jeon, and J. B. Rosen, "Lower dimensional representation of text data based on centroids and least squares," BIT Numer. Math., vol. 43, no. 2, pp. 427-448, 2003.
10. X. R. Li, T. Jiang, and K. Zhang, "Efficient and robust feature extraction by maximum margin criterion," IEEE Trans. Neural Netw., vol. 17, no. 1, pp. 157-165, Jan. 2006.
11. F. Nie, S. Xiang, Y. Liu, C. Hou, and C. Zhang, "Orthogonal vs. uncorrelated least squares discriminant analysis for feature extraction," Pattern Recognit. Lett., vol. 33, no. 5, pp. 485-491, 2012.
12. J. B. Tenenbaum, V. de Silva, and J. C. Langford, "A global geometric framework for nonlinear dimensionality reduction," Science, vol. 290, no. 5500, pp. 2319-2323, Dec. 2000.
13. S. T. Roweis and L. K. Saul, "Nonlinear dimensionality reduction by locally linear embedding," Science, vol. 290, pp. 2323-2326, Dec. 2000.
14. M. Belkin and P. Niyogi, "Laplacian eigenmaps for dimensionality reduction and data representation," Neural Comput., vol. 15, no. 6, pp. 1373-1396, 2003.
15. S. Xiang, F. Nie, C. Zhang, and C. Zhang, "Nonlinear dimensionality reduction with local spline embedding," IEEE Trans. Knowl. Data Eng., vol. 21, no. 9, pp. 1285-1298, Sep. 2009.
16. S. Yan, D. Xu, B. Zhang, H.-J. Zhang, Q. Yang, and S. Lin, "Graph embedding and extensions: A general framework for dimensionality reduction," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 1, pp. 40-51, Jan. 2007.
17. C. Hou, C. Zhang, Y. Wu, and F. Nie, "Multiple view semisupervised dimensionality reduction," Pattern Recognit., vol. 43, no. 3, pp. 720-730, 2010.
18. J. Chen, Z. Ma, and Y. Liu, "Local coordinates alignment with global preservation for dimensionality reduction," IEEE Trans. Neural Netw. Learn. Syst., vol. 24, no. 1, pp. 106-117, Jan. 2013.
19. Y. Pang, Z. Ji, P. Jing, and X. Li, "Ranking graph embedding for learning to rerank," IEEE Trans. Neural Netw. Learn. Syst., vol. 24, no. 8, pp. 1292-1303, Aug. 2013.
20. L. Parsons, E. Haque, and H. Liu, "Subspace clustering for high dimensional data: A review," ACM SIGKDD Explorations Newslett., vol. 6, no. 1, pp. 90-105, 2004.
21. R. Agrawal, J. Gehrke, D. Gunopulos, and P. Raghavan, "Automatic subspace clustering of high dimensional data for data mining applications," in Proc. ACM SIGMOD Int. Conf. Manage. Data, Jun. 1998, pp. 94-105.
22. C.-H. Cheng, A. W. Fu, and Y. Zhang, "Entropy-based subspace clustering for mining numerical data," in Proc. 5th ACM SIGKDD Int. Conf. Knowl. Discovery Data Mining (KDD), 1999, pp. 84-93.
23. S. Goil, H. Nagesh, and A. Choudhary, "MAFIA: Efficient and scalable subspace clustering for very large data sets," Dept. Electr. Comput. Eng., Northwestern Univ., Evanston, IL, USA, Tech. Rep. CPDC-TR-9906-010, 1999.
24. B. Liu, Y. Xia, and P. S. Yu, "Clustering through decision tree construction," in Proc. 9th Int. Conf. Inform. Knowl. Manage., Nov. 2000, pp. 20-29.
25. C. M. Procopiuc, M. Jones, P. K. Agarwal, and T. M. Murali, "A Monte Carlo algorithm for fast projective clustering," in Proc. ACM SIGMOD Int. Conf. Manage. Data, Jun. 2002, pp. 418-427.
26. C. C. Aggarwal, C. Procopiuc, J. L. Wolf, P. S. Yu, and J. S. Park, "Fast algorithms for projected clustering," in Proc. ACM SIGMOD Int. Conf. Manage. Data, Jun. 1999, pp. 61-72.
27. C. C. Aggarwal and P. S. Yu, "Finding generalized projected clusters in high dimensional spaces," in Proc. ACM SIGMOD Int. Conf. Manage. Data, Jun. 2000, pp. 70-81.
28. J. Yang, W. Wang, H. Wang, and P. Yu, "δ-clusters: Capturing subspace correlation in a large data set," in Proc. 18th Int. Conf. Data Eng., 2002, pp. 517-528.
29. J. H. Friedman and J. J. Meulman, "Clustering objects on subsets of attributes," J. Roy. Statist. Soc., vol. 66, no. 4, pp. 815-849, 2004.
30. C. Ding, X. He, H. Zha, and H. D. Simon, "Adaptive dimension reduction for clustering high dimensional data," in Proc. ICDM, 2002, pp. 147-154.
31. C. Ding and T. Li, "Adaptive dimension reduction using discriminant analysis and K-means clustering," in Proc. ICML, 2007, pp. 521-528.
32. F. De La Torre and T. Kanade, "Discriminative cluster analysis," in Proc. ICML, 2006, pp. 241-248.
33. J. Ye, Z. Zhao, and H. Liu, "Adaptive distance metric learning for clustering," in Proc. IEEE CVPR, Jun. 2007, pp. 1-7.
34. J. Ye, Z. Zhao, and M. Wu, "Discriminative K-means for clustering," in Advances in Neural Information Processing Systems. Cambridge, MA, USA: MIT Press, 2007.
35. D. Niu, J. G. Dy, and M. I. Jordan, "Dimensionality reduction for spectral clustering," in Proc. Int. Conf. Artif. Intell. Statist., vol. 15. 2011, pp. 552-560.
36. Q. Gu and J. Zhou, "Subspace maximum margin clustering," in Proc. CIKM, Nov. 2009, pp. 1337-1346.
37. C. Domeniconi, D. Papadopoulos, D. Gunopulos, and S. Ma, "Subspace clustering of high dimensional data," in Proc. SIAM Int. Conf. Data Mining (SDM), Apr. 2004, pp. 517-521.
38. D. Wang, F. Nie, and H. Huang, "Unsupervised feature selection via unified trace ratio formulation and K-means clustering (track)," in Proc. Eur. Conf. Mach. Learn. Principles Pract. Knowl. Discovery Databases (ECML PKDD), Nancy, France, 2014.
39. C. Hou, F. Nie, C. Zhang, and Y. Wu, "Learning a subspace for face image clustering via trace ratio criterion," Opt. Eng., vol. 48, no. 6, p. 060501, 2009.
40. T. Li, S. Ma, and M. Ogihara, "Document clustering via adaptive subspace iteration," in Proc. 27th Annu. Int. ACM SIGIR Conf. Res. Develop. Inform. Retr., Jul. 2004, pp. 218-225.
41. R. W. Sembiring, S. Sembiring, and J. M. Zain, "An efficient dimensional reduction method for data clustering," Bull. Math., vol. 4, no. 1, pp. 43-58, 2012.
42. F. Nie, D. Xu, and X. Li, "Initialization independent clustering with actively self-training method," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 42, no. 1, pp. 17-27, Feb. 2012.
43. Y. Saad, Numerical Methods for Large Eigenvalue Problems. Manchester, U.K.: Manchester Univ. Press, 1992.
44. S. C. H. Hoi, R. Jin, J. Zhu, and M. R. Lyu, "Semi-supervised SVM batch mode active learning for image retrieval," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2008, pp. 1-7.
45. C. H. Papadimitriou and K. Steiglitz, Combinatorial Optimization: Algorithms and Complexity. New York, NY, USA: Dover, Jul. 1998.