Fast semi-supervised clustering with enhanced spectral embedding

Pattern Recognition

Volumn 45, Issue 12, 2012, Pages 4358-4369

  Jiao, L C ^a   Shang, Fanhua ^a   Wang, Fei ^b   Liu, Yuanyuan ^a  

^a XIDIAN UNIVERSITY   (China)

^b IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

Pairwise constraint; Semantic gap; Semi supervised clustering (SSC); Side information; Spectral embedding

Indexed keywords

PAIRWISE CONSTRAINTS; SEMANTIC GAP; SEMI-SUPERVISED CLUSTERING; SIDE INFORMATION; SPECTRAL EMBEDDING;

VIRTUAL REALITY;

SEMANTICS;

EID: 84864282457     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2012.05.007     Document Type: Article

References (46)

1. O. Chapelle, B. Schölkopf, A. Zien Semi-Supervised Learning 2006 The MIT Press Cambridge, MA
2. X. Zhu, Semi-supervised learning literature survey, Technical Report, Computer Sciences, University of Wisconsin-Madison, 2007.
3. K. Wagstaff, C. Cardie, S. Rogers, S. Schroedl, Constrained k-means clustering with background knowledge, in: Proceedings of the 18th International Conference on Machine Learning (ICML), 2001, pp. 577-584.
4. D. Klein, S. Kamvar, C. Manning, From instance-level constraints to space-level constraints: making the most of prior knowledge in data clustering, in: Proceedings of the 19th International Conference on Machine Learning (ICML), 2002, pp. 307-314.
5. B. Kulis, S. Basu, I. Dhillon, R. Mooney Semi-supervised graph clustering: a kernel approach Machine Learning 74 1 2009 1 22
6. E. Xing, A. Ng, M. Jordan, S. Russell Distance metric learning, with application to clustering with side-information Advances in Neural Information Processing Systems (NIPS) 15 2003 505 512
7. S. Kamvar, D. Klein, C. Manning, Spectral learning, in: Proceedings of the 18th International Joint Conference on Artificial Intelligence (IJCAI), 2003, pp. 561-566.
8. A. Globerson, S. Roweis Metric learning by collapsing classes Advances in Neural Information Processing Systems (NIPS) 18 2006 451 458
9. S. Basu, M. Bilenko, R. Mooney, A probabilistic framework for semi-supervised clustering, in: Proceedings of the 10th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD), 2004, pp. 59-68.
10. M. Bilenko, S. Basu, R. Mooney, Integrating constraints and metric learning in semi-supervised clustering, in: Proceedings of the 21st International Conference on Machine Learning (ICML), 2004, pp. 81-88.
11. A. Bar-Hillel, T. Hertz, N. Shental, D. Weinshall, Learning distance functions using equivalence relations, in: Proceedings of the 20th International Conference on Machine Learning (ICML), 2003, pp. 11-18.
12. S. Hoi, R. Jin, M. Lyu, Learning nonparametric kernel matrices from pairwise constraints, in: Proceedings of the 24th International Conference on Machine Learning (ICML), 2007, pp. 361-368.
13. J. Davis, B. Kulis, P. Jain, S. Sra, I. S. Dhillon, Information theoretic metric learning, in: Proceedings of the 24th International Conference on Machine Learning (ICML), 2007, pp. 209-216.
14. Z. Li, J. Liu, X. Tang, Constrained clustering via spectral regularization, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2009, pp. 421-428.
15. Z. Li, J. Liu, X. Tang, Pairwise constraint propagation by semidefinite programming for semi-supervised classification, in: Proceedings of the 25th International Conference on Machine Learning (ICML), 2008, pp. 576-583.
16. K. Wagstaff, C. Cardie, Clustering with instance-level constraints, in: Proceedings of the 17th International Conference on Machine Learning (ICML), 2000, pp. 1103-1110.
17. X. Wang, I. Davidson, Flexible constrained spectral clustering, in: Proceedings of the 16th ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD), 2010, pp. 563-572.
18. W.E. Donath, A.J. Hofmann Lower bounds for the partitioning of graphs IBM Journal of Research and Development 17 1973 420 425
19. F. Shang, L.C. Jiao, J. Shi, F. Wang, M. Gong Fast affinity propagation clustering: a multilevel approach Pattern recognition 45 1 2012 474 486
20. J. Shi, J. Malik Normalized cuts and image segmentation, IEEE Transactions on Pattern Analysis and Machine Intelligence 22 8 2000 888 905
21. L. Hagen, A. Kahng New spectral methods for ratio cut partitioning and clustering, IEEE, Transactions on Computer-Aided Design of Integrated Circuits and Systems 11 9 1992 1074 1085
22. C. H. Q. Ding, X. He, H. Zha, M. Gu, H. D. Simon, A min-max cut algorithm for graph partitioning and data clustering, in: Proceedings of the IEEE International Conference on Data Mining (ICDM), 2001, pp. 107-114.
23. S. White, P. Smyth, A spectral clustering approach to finding communities in graph, in: Proceedings of the Fifth SIAM International Conference on Data Mining (SDM), 2005, pp. 76-84.
24. Z. Lu, M. Á. Carreira-Perpiñán, Constrained spectral clustering through affinity propagation, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2008, pp. 848-855.
25. F. Wang, C.H.Q. Ding, T. Li, Integrated KL (K-means-Laplacian) clustering: a new clustering approach by combining attribute data and pairwise relations, in: Proceedings of the Fifth SIAM International Conference on Data Mining (SDM), 2009, pp. 38-48.
26. S.X. Yu, J. Shi Segmentation given partial grouping constraints, IEEE Transactions of the Pattern Analysis and Machine Intelligence 26 2 2004 173 183
27. F. Shang, Y. Liu, F. Wang, Learning spectral embedding for semisupervised clustering, in: Proceedings of the IEEE International Conference on Data Mining (ICDM), 2011, pp. 597-606.
28. L. Zelnik-Manor, P. Perona Self-tuning spectral clustering Advances in Neural Information Processing Systems (NIPS) 16 2004 1601 1608
29. F. Shang, L.C. Jiao, J. Shi, M. Gong, R.H Shang Fast density-weighted low-rank approximation spectral clustering Data Mining and Knowledge Discovery 23 2 2011 345 378
30. W. Liu, S. Chang, Robust multi-class transductive learning with graphs, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2009, pp. 381-388.
31. F. Chung Spectral Graph Theory 1997 American Mathematical Society
32. U. von Luxburg A tutorial on spectral clustering Statistics and Computing 17 4 2007 395 416
33. J.T. Kwok, I.W. Tsang, Learning with idealized kernels, in: Proceedings of the 20th International Conference on Machine Learning (ICML), 2003, pp. 400-407.
34. X. -M. Wu, A. So, Z. Li, S. Li Fast graph Laplacian regularized kernel learning via semidefinite-quadratic-linear programming Advances in Neural Information Processing Systems (NIPS) 21 2009 1964 1972
35. G.H. Golub, C.F.V. Loan Matrix Computations Third edition 1996 The Johns Hopkins University Press Baltimore, Maryland
36. R.H. Tütüncü, K.C. Toh, M.J. Todd Solving semidefinite-quadratic-linear programs using SDPT3 Mathematical Programming 95 2003 189 217
37. T. Coleman, J. Saunderson, A. Wirth, Spectral clustering with inconsistent advice, in: Proceedings of the 25th International Conference on Machine Learning (ICML), 2008, pp. 152-159.
38. Y. LeCun, C. Cortes The MNIST Database of Handwritten Digits 2009 〈http://yann.lecun.com/exdb/mnist/〉
39. S.A. Nene, S.K. Nayar, J. Murase, Columbia object image library (COIL-20), Technical Report CUCS-005-96, Columbia University, February 1996.
40. A.S. Georghiades, P.N. Belhumeur, D.J. Kriegman From few to many: illumination cone models for face recognition under variable lighting and pose, IEEE Transactions on PatternAnalysis and Machine Intelligence 23 6 2001 643 660
41. L. Fei-Fei, R. Fergus, P. Perona, Learning generative visual models from few training examples: an incremental Bayesian approach tested on 101 object categories, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Workshop on Generative Model Based Vision, 2004.
42. A. Oliva, A. Torralba Modeling the shape the scene: a holistic representation of the spatial envelope International Journal of Computer Vision 42 3 2001 145 175
43. K. Grauman, T. Darrell, The pyramid match kernel: discriminative classification with sets of image features, in: Proceedings of the IEEE International Conference on Computer Vision (ICCV), 2005, pp. 1458-1465.
44. J. Chai, H. Liu, Z. Bao Generalized re-weighting local sampling mean discriminant analysis Pattern recognition 43 10 2010 3422 3432
45. F. Shang, L.C. Jiao, F. Wang Graph dual regularization non-negative matrix factorization for co-clustering Pattern Recognition 45 6 2012 2237 2250
46. M. Xing, Z. Bao, B. Pei Properties of high-resolution range profiles Optical Engineering 41 2 2002 493 504