A regularized formulation for spectral clustering with pairwise constraints

Proceedings of the International Joint Conference on Neural Networks

Volumn , Issue , 2009, Pages 141-148

  Alzate, Carlos ^a   Suykens, Johan A K ^a  

^a Katholieke Universiteit Leuven   (Belgium)

Author keywords

[No Author keywords available]

Indexed keywords

CLUSTERING MODEL; EIGENVALUE PROBLEM; KERNEL MATRICES; KERNEL PCA; KERNEL PRINCIPAL COMPONENT ANALYSIS; LEAST SQUARES SUPPORT VECTOR MACHINES; MODEL SELECTION CRITERIA; MODIFIED KERNELS; PAIRWISE CONSTRAINTS; PRIMAL PROBLEM; PRIMAL-DUAL; PRIOR KNOWLEDGE; REGULARIZED METHOD; SAMPLE POINT; SIMULATION RESULT; SPECTRAL CLUSTERING;

CLUSTER ANALYSIS; EIGENVALUES AND EIGENFUNCTIONS; NEURAL NETWORKS; SIMULATORS; SUPPORT VECTOR MACHINES;

PRINCIPAL COMPONENT ANALYSIS;

EID: 70449416233     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IJCNN.2009.5178772     Document Type: Conference Paper

References (23)

1. J. Shi and J. Malik, "Normalized cuts and image segmentation, " IEEE Trans. Pattern Anal. Machine Intell., vol. 22, no. 8, pp. 888-905, 2000.
2. F. R. K. Chung, Spectral Graph Theory. American Mathematical Society, 1997.
3. A. Y. Ng, M. I. Jordan, and Y. Weiss, "On spectral clustering: Analysis and an algorithm, " in Advances in Neural Information Processing Systems 14, T. G. Dietterich, S. Becker, and Z. Ghahramani, Eds. Cambridge, MA: MIT Press, 2002, pp. 849-856.
4. M. Meila and J. Shi, "A random walks view of spectral segmentation, " in Artificial Intelligence and Statistics AISTATS, 2001.
5. C. Fowlkes, S. Belongie, F. Chung, and J. Malik, "Spectral grouping using the Nyström method, " IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 26, no. 2, pp. 214-225, Feb. 2004.
6. Y. Bengio, J. Paiement, P. Vincent, O. Delalleau, N. Le Roux, and M. Ouimet, "Out-of-sample extensions for LLE, isomap, MDS, eigenmaps, and spectral clustering, " in Advances in Neural Information Processing Systems 16. Cambridge, MA: MIT Press, 2004.
7. C. Alzate and J. A. K. Suykens, "Multiway spectral clustering with out-of-sample extensions through weighted kernel PCA, " IEEE Transactions on Pattern Analysis and Machine Intelligence. In Press, 2009.
8. -, "A weighted kernel PCA formulation with out-of-sample extensions for spectral clustering methods, " in Proceedings of the 2006 International Joint Conference on Neural Networks (IJCNN'06), 2006, pp. 138-144.
9. J. A. K. Suykens, T. Van Gestel, J. De Brabanter, B. De Moor, and J. Vandewalle, Least Squares Support Vector Machines. World Scientific, Singapore, 2002.
10. J. A. K. Suykens, T. Van Gestel, J. Vandewalle, and B. De Moor, "A support vector machine formulation to PCA analysis and its kernel version, " IEEE Transactions on Neural Networks, vol. 14, no. 2, pp. 447-450, Mar. 2003.
11. S. Basu, M. Bilenko, and R. J. Mooney, "A probabilistic framework for semi-supervised clustering, " in Proceedings of the 10th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD-2004), Seattle, WA, 2004, pp. 59-68.
12. K. Wagstaff, C. Cardie, S. Rogers, and S. Schrödl, "Constrained k-means clustering with background knowledge, " in ICML '01: Proceedings of the Eighteenth International Conference on Machine Learning, 2001, pp. 577-584.
13. S. D. Kamvar, D. Klein, and C. D. Manning, "Spectral learning, " in Proceedings of the 18th International Joint Conference on Artificial Intelligence (IJCAI'03), 2003, pp. 561-566.
14. Z. Lu and M. Carreira-Perpinan, "Constrained spectral clustering through affinity propagation, " in IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2008), 2008.
15. M. Fiedler, "A property of eigenvectors of nonnegative symmetric matrices and its applications to graph theory, " Czech. Math. J., vol. 25, no. 100, pp. 619-633, 1975.
16. M. Gu, H. Zha, C. Ding, X. He, and H. Simon, "Spectral relaxation models and structure analysis for k-way graph clustering and bi-clustering, " Penn. State Univ, Computer Science and Engineering., Technical Report, 2001.
17. K. Fan, "On a theorem of Weyl concerning eigenvalues of linear transformations." Proc. Natl. Acad. Sci. USA, vol. 35, no. 11, pp. 652-655, 1949.
18. F. R. Bach and M. I. Jordan, "Learning spectral clustering, with application to speech separation, " Journal of Machine Learning Research, vol. 7, pp. 1963-2001, 2006.
19. M. Hein, J.-Y. Audibert, and U. von Luxburg, "Graph Laplacians and their convergence on random neighborhood graphs, " Journal of Machine Learning Research, vol. 8, pp. 1325-1370, 2007.
20. T. G. Dietterich and G. Bakiri, "Solving multiclass learning problems via error-correcting output codes, " Journal of Machine Learning Research, vol. 2, pp. 263-286, 1995.
21. L. Hubert and P. Arabie, "Comparing partitions, " Journal of Classification, pp. 193-218, 1985.
22. D. Martin, C. Fowlkes, D. Tal, and J. Malik, "A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics, " in Proc. 8th Int'l Conf. Computer Vision, vol. 2, 2001, pp. 416-423.
23. J. Puzicha, T. Hofmann, and J. Buhmann, "Non-parametric similarity measures for unsupervised texture segmentation and image retrieval, " in Computer Vision and Pattern Recognition, 1997, pp. 267-272.