SCE: A manifold regularized set-covering method for data partitioning

IEEE Transactions on Neural Networks and Learning Systems

Volumn 29, Issue 5, 2018, Pages 1760-1773

  Li, Xuelong ^a   Lu, Quanmao ^a,b   Dong, Yongsheng ^a,c   Tao, Dacheng ^d  

^a XI AN INSTITUTE OF OPTICS AND PRECISION MECHANICS   (China)

^b UNIVERSITY OF CHINESE ACADEMY OF SCIENCES   (China)

^c HENAN UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

^d UNIVERSITY OF SYDNEY   (Australia)

Author keywords

Cluster ensemble; Discriminative constraint; Manifold structure; Set covering

Indexed keywords

CLUSTER ANALYSIS; DATA HANDLING;

CLUSTER ENSEMBLES; CLUSTERING RESULTS; CLUSTERING SOLUTIONS; DATA PARTITIONING; OBJECTIVE FUNCTIONS; SET COVERING PROBLEM; STRUCTURE INFORMATION; SYNTHETIC AND REAL DATA;

CLUSTERING ALGORITHMS;

EID: 85017177481     PISSN: 2162237X     EISSN: 21622388     Source Type: Journal    
DOI: 10.1109/TNNLS.2017.2682179     Document Type: Article

References (64)

1. X. Huang, Y. Ye, and H. Zhang, "Extensions of kmeans-type algorithms: A new clustering framework by integrating intracluster compactness and intercluster separation, " IEEE Trans. Neural Netw. Learn. Syst., vol. 25, no. 8, pp. 1433-1446, Aug. 2014.
2. R. O. Duda et al., Pattern Classification and Scene Analysis. New York, NY, USA: Wiley, 1973.
3. H. Frigui and R. Krishnapuram, "A robust competitive clustering algorithm with applications in computer vision, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 21, no. 5, pp. 450-465, May 1999.
4. J. Philbin, O. Chum, M. Isard, L. Sivic, and A. Zissennan, "Lost in quantization: Improving particular object retrieval in large scale image databases, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2008, pp. 1-8.
5. A. Gersho and R. M. Gray, Vector Quantization and Signal Compression. Boston, MA, USA: Springer, 1992.
6. T. Liu and D. Tao, "Classification with noisy labels by importance reweighting, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 38, no. 3, pp. 447-461, Mar. 2016.
7. C. Ding, J. Choi, D. Tao, and L. S. Davis, "Multi-directional multi-level dual-cross patterns for robust face recognition, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 38, no. 3, pp. 518-531, Mar. 2016.
8. T. Liu, D. Tao, M. Song, and S. J. Maybank, "Algorithm-dependent generalization bounds for multi-task learning, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 39, no. 2, pp. 227-241, Feb. 2017.
9. C. Xu, T. Liu, D. Tao, and C. Xu, "Local rademacher complexity for multi-label learning, " IEEE Trans. Image Process., vol. 25, no. 3, pp. 1495-1507, Mar. 2016.
10. A. K. Jain, M. N. Murty, and P. J. Flynn, "Data clustering: A review, " ACM Comput. Surv., vol. 31, no. 3, pp. 264-323, Sep. 1999.
11. H. F. Bassani and A. F. Araujo, "Dimension selective self-organizing maps with time-varying structure for subspace and projected clustering, " IEEE Trans. Neural Netw. Learn. Syst., vol. 26, no. 3, pp. 458-471, Mar. 2015.
12. C. Hou, F. Nie, D. Yi, and D. Tao, "Discriminative embedded clustering: A framework for grouping high-dimensional data, " IEEE Trans. Neural Netw. Learn. Syst., vol. 26, no. 6, pp. 1287-1299, Jun. 2015.
13. C. Elkan, "Using the triangle inequality to accelerate k-means, " in Proc. Int. Conf. Mach. Learn., vol. 3. Washington, DC, USA, Aug. 2003, pp. 147-153.
14. L. Jing, M. K. Ng, and T. Zeng, "Dictionary learning-based subspace structure identification in spectral clustering, " IEEE Trans. Neural Netw. Learn. Syst., vol. 24, no. 8, pp. 1188-1199, Aug. 2013.
15. T. Liu, D. Tao, and D. Xu, "Dimensionality-dependent generalization bounds for k-dimensional coding schemes, " Neural Comput., vol. 28, no. 10, pp. 2213-2249, Oct. 2016.
16. U. Von Luxburg, "A tutorial on spectral clustering, " Statist. Comput., vol. 17, no. 4, pp. 395-416, 2007.
17. R. Ghaemi, M. N. Sulaiman, H. Ibrahim, and N. Mustapha, "A survey: Clustering ensembles techniques, " World Acad. Sci. Eng. Technol., vol. 50, pp. 636-645, Feb. 2009.
18. A. Strehl and J. Ghosh, "Cluster ensembles-A knowledge reuse framework for combining partitionings, " in Proc. AAAI, Edmonton, AB, Canada, Jul. 2002, pp. 93-99.
19. B. Mirkin, "Reinterpreting the category utility function, " Mach. Learn., vol. 45, no. 2, pp. 219-228, Nov. 2001.
20. A. P. Topchy, A. K. Jain, and W. F. Punch, "A mixture model for clustering ensembles, " in Proc. SIAM Int. Conf. Data Mining, Lake Buena Vista, FL, USA, Apr. 2004, pp. 379-390.
21. H. Wang, H. Shan, and A. Banerjee, "Bayesian cluster ensembles, " Statist. Anal. Data Mining, vol. 4, no. 1, pp. 54-70, Feb. 2011.
22. A. Topchy, A. K. Jain, and W. Punch, "Combining multiple weak clusterings, " in Proc. 3rd IEEE Int. Conf. Data Mining, Melbourne, FL, USA, Nov. 2003, pp. 331-338.
23. X. Z. Fern and C. E. Brodley, "Random projection for high dimensional data clustering: A cluster ensemble approach, " in Proc. Int. Conf. Mach. Learn., Washington, DC, USA, Aug. 2003, pp. 186-193.
24. L. I. Kuncheva and S. T. Hadjitodorov, "Using diversity in cluster ensembles, " in Proc. IEEE Int. Conf. Syst., Man, Cybern., The Hague, The Netherlands, Oct. 2004, pp. 1214-1219.
25. L. Jia, "Clustering algorithm based on max-min distance and dynamic tunneling, " Comput. Eng. Design, vol. 31, no. 8, pp. 1775-1778, Jan. 2010.
26. S. Dudoit and J. Fridlyand, "Bagging to improve the accuracy of a clustering procedure, " Bioinformatics, vol. 19, no. 9, pp. 1090-1099, Jun. 2003.
27. A. Fred, "Finding consistent clusters in data partitions, " in Proc. Int. Workshop Multiple Classifier Syst., Cambridge, U.K., Jul. 2001, pp. 309-318.
28. C. Domeniconi and M. Al-Razgan, "Weighted cluster ensembles: Methods and analysis, " ACM Trans. Knowl. Discovery Data, vol. 2, no. 4, p. 17, Jan. 2009.
29. S. Vega-Pons and J. Ruiz-Shulcloper, "A survey of clustering ensemble algorithms, " Int. J. Pattern Recognit. Artif. Intell., vol. 25, no. 3, pp. 337-372, 2011.
30. D. Cai, X. He, J. Han, and T. S. Huang, "Graph regularized nonnegative matrix factorization for data representation, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 8, pp. 1548-1560, Aug. 2011.
31. Y. Hong, S. Kwong, Y. Chang, and Q. Ren, "Unsupervised feature selection using clustering ensembles and population based incremental learning algorithm, " Pattern Recognit., vol. 41, no. 9, pp. 2742-2756, Sep. 2008.
32. B. Fischer and J. M. Buhmann, "Bagging for path-based clustering, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 11, pp. 1411-1415, Nov. 2003.
33. J. Azimi, M. Mohammadi, A. Movaghar, and M. Analoui, "Clustering ensembles using genetic algorithm, " in Proc. Int. Workshop Comput. Archit. Mach. Perception Sens., Montreal, QC, Canada, Aug. 2006, pp. 119-123.
34. I. T. Christou, "Coordination of cluster ensembles via exact methods, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 2, pp. 279-293, Feb. 2011.
35. E. Dimitriadou, A. Weingessel, and K. Hornik, "Voting-merging: An ensemble method for clustering, " in Proc. Int. Conf. Artif. Neural Netw., Vienna, Austria, Aug. 2001, pp. 217-224.
36. A. L. Fred and A. K. Jain, "Data clustering using evidence accumulation, " in Proc. 16th Int. Conf. Pattern Recognit., Aug. 2002, pp. 276-280.
37. H. Ayad and M. Kamel, "Finding natural clusters using multi-clusterer combiner based on shared nearest neighbors, " in Proc. Int. Workshop Multiple Classifier Syst., Jun. 2003, pp. 166-175.
38. A. Topchy, B. Minaei-Bidgoli, A. K. Jain, and W. F. Punch, "Adaptive clustering ensembles, " in Proc. 17th Int. Conf. Pattern Recognit., Cambridge, U.K., Aug. 2004, pp. 272-275.
39. A. L. Fred and A. K. Jain, "Combining multiple clusterings using evidence accumulation, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 6, pp. 835-850, Jun. 2005.
40. N. Iam-On, T. Boongoen, S. Garrett, and C. Price, "A link-based approach to the cluster ensemble problem, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 12, pp. 2396-2409, Dec. 2011.
41. Z. F. Hao, L. J. Wang, R. C. Cai, and W. Wen, "An improved clustering ensemble method based link analysis, " World Wide Web, vol. 18, no. 2, pp. 185-195, Mar. 2015.
42. A. Strehl and J. Ghosh, "Cluster ensembles-A knowledge reuse framework for combining multiple partitions, " J. Mach. Learn. Res., vol. 3, pp. 583-617, Dec. 2002.
43. X. Z. Fern and C. E. Brodley, "Solving cluster ensemble problems by bipartite graph partitioning, " in Proc. 21st Int. Conf. Mach. Learn., Banff, AB, Canada, Jul. 2004, pp. 36-42.
44. A. Topchy, A. K. Jain, and W. Punch, "Clustering ensembles: Models of consensus and weak partitions, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 12, pp. 1866-1881, Dec. 2005.
45. J. Wu, H. Liu, H. Xiong, and J. Cao, "A theoretic framework of k-meansbased consensus clustering, " in Proc. Int. Conf. Artif. Intell., Beijing, China, Aug. 2013, pp. 1799-1805.
46. M. Analoui and N. Sadighian, "Solving cluster ensemble problems by correlation's matrix & GA, " in Proc. Int. Conf. Intell. Inf. Process., Adelaide, SA, Australia, Sep. 2007, pp. 227-231.
47. H. Alizadeh, B. Minaei-Bidgoli, and H. Parvin, "Cluster ensemble selection based on a new cluster stability measure, " Intell. Data Anal., vol. 18, no. 3, pp. 389-408, Apr. 2014.
48. O. Du Merle, P. Hansen, B. Jaumard, and N. Mladenovíc, "An interior point algorithm for minimum sum-of-squares clustering, " SIAM J. Sci. Comput., vol. 21, no. 4, pp. 1485-1505, 1999.
49. Z. Qi, Y. Tian, and Y. Shi, "Successive overrelaxation for Laplacian support vector machine, " IEEE Trans. Neural Netw. Learn. Syst., vol. 26, no. 4, pp. 674-683, Apr. 2015.
50. C. Gong, T. Liu, D. Tao, K. Fu, E. Tu, and J. Yang, "Deformed graph Laplacian for semisupervised learning, " IEEE Trans. Neural Netw. Learn. Syst., vol. 26, no. 10, pp. 2261-2274, Oct. 2015.
51. N. Guan, D. Tao, Z. Luo, and B. Yuan, "Manifold regularized discriminative nonnegative matrix factorization with fast gradient descent, " IEEE Trans. Image Process., vol. 20, no. 7, pp. 2030-2048, Jul. 2011.
52. P. Hansen and N. Mladenovíc, "J-means: A new local search heuristic for minimum sum of squares clustering, " Pattern recognit., vol. 34, no. 2, pp. 405-413, Feb. 2001.
53. M. Laszlo and S. Mukherjee, "A genetic algorithm using hyper-quadtrees for low-dimensional k-means clustering, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 4, pp. 533-543, Apr. 2006.
54. J. A. Pacheco, "A scatter search approach for the minimum sumof- squares clustering problem, " Comput. Oper. Res., vol. 32, no. 5, pp. 1325-1335, May 2005.
55. J. Philbin, O. Chum, M. Isard, J. Sivic, and A. Zisserman, "Object retrieval with large vocabularies and fast spatial matching, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2007, pp. 1-8.
56. H. Jegou and A. Zisserman, "Triangulation embedding and democratic aggregation for image search, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Columbus, OH, USA, Jun. 2014, pp. 3310-3317.
57. L. Xu, T. W. S. Chow, and E. W. M. Ma, "Topology-based clustering using polar self-organizing map, " IEEE Trans. Neural Netw. Learn. Syst., vol. 26, no. 4, pp. 798-808, Apr. 2015.
58. C. Xu, D. Tao, and C. Xu, "Multi-view intact space learning, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 37, no. 12, pp. 2531-2544, Dec. 2015.
59. A. Rodriguez and A. Laio, "Clustering by fast search and find of density peaks, " Science, vol. 344, no. 6191, pp. 1492-1496, Jun. 2014.
60. N. Mladenovíc and P. Hansen, "Variable neighborhood search, " Comput. Oper. Res., vol. 24, no. 11, pp. 1097-1100, Nov. 1997.
61. K. Rose, "Deterministic annealing for clustering, compression, classification, regression, and related optimization problems, " Proc. IEEE, vol. 86, no. 11, pp. 2210-2239, Nov. 1998.
62. D. Arthur and S. Vassilvitskii, "k-means++: The advantages of careful seeding, " in Proc. ACM-SIAM Symp. Discrete Algorithms, New Orleans, LA, USA, Jan. 2007, pp. 1027-1035.
63. L. Franek and X. Jiang, "Ensemble clustering by means of clustering embedding in vector spaces, " Pattern Recognit., vol. 47, no. 2, pp. 833-842, Feb. 2014.
64. C. Xu, D. Tao, and C. Xu, "Multi-view learning with incomplete views, " IEEE Trans. Image Process., vol. 24, no. 12, pp. 5812-5825, Dec. 2015.