Multiclass Semisupervised Learning Based Upon Kernel Spectral Clustering

IEEE Transactions on Neural Networks and Learning Systems

Volumn 26, Issue 4, 2015, Pages 720-733

  Mehrkanoon, Siamak ^a   Alzate, Carlos ^b   Mall, Raghvendra ^a   Langone, Rocco ^a   Suykens, Johan A K ^a  

^a Katholieke Universiteit Leuven   (Belgium)

^b IBM RESEARCH   (Ireland)

Author keywords

Kernel spectral clustering (KSC); low embedding dimension for clustering; multiclass problem; semisupervised learning

Indexed keywords

ALGORITHMS; CLUSTERING ALGORITHMS; COST FUNCTIONS; LINEAR SYSTEMS; SUPERVISED LEARNING;

EMBEDDING DIMENSIONS; LABELED AND UNLABELED DATA; MULTI-CLASS PROBLEMS; REGULARIZATION TERMS; SEMI- SUPERVISED LEARNING; SEMI-SUPERVISED CLUSTERING; SEMISUPERVISED LEARNING ALGORITHM; SPECTRAL CLUSTERING;

LEARNING ALGORITHMS;

EID: 85027937419     PISSN: 2162237X     EISSN: 21622388     Source Type: Journal    
DOI: 10.1109/TNNLS.2014.2322377     Document Type: Article

References (36)

1. O. Chapelle, B. Schölkopf, and A. Zien, Semi-Supervised Learning, vol. 2. Cambridge, MA, USA: MIT Press, 2006.
2. X. Zhu, "Semi-supervised learning literature survey," Ph.D. dissertation, Dept. Comput. Sci., Univ. Wisconsin-Madison, Madison, WI, USA, 2006.
3. M. M. Adankon, M. Cheriet, and A. Biem, "Semisupervised least squares support vector machine," IEEE Trans. Neural Netw., vol. 20, no. 12, pp. 1858-1870, Dec. 2009.
4. Y. Huang, D. Xu, and F. Nie, "Semi-supervised dimension reduction using trace ratio criterion," IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 3, pp. 519-526, Mar. 2012.
5. F. Nie, Z. Zeng, I. W. Tsang, D. Xu, and C. Zhang, "Spectral embedded clustering: A framework for in-sample and out-of-sample spectral clustering," IEEE Trans. Neural Netw., vol. 22, no. 11, pp. 1796-1808, Nov. 2011.
6. M. Belkin, P. Niyogi, and V. Sindhwani, "Manifold regularization: A geometric framework for learning from labeled and unlabeled examples," J. Mach. Learn. Res., vol. 7, pp. 2399-2434, Nov. 2006.
7. S. Xiang, F. Nie, and C. Zhang, "Semi-supervised classification via local spline regression," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 11, pp. 2039-2053, Nov. 2010.
8. Y. Yang, F. Nie, D. Xu, J. Luo, Y. Zhuang, and Y. Pan, "A multimedia retrieval framework based on semi-supervised ranking and relevance feedback," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 4, pp. 723-742, Apr. 2012.
9. M. Karasuyama and H. Mamitsuka, "Multiple graph label propagation by sparse integration," IEEE Trans. Neural Netw. Learn. Syst., vol. 24, no. 12, pp. 1999-2012, Dec. 2013.
10. Y. Wang, S. Chen, and Z.-H. Zhou, "New semi-supervised classification method based on modified cluster assumption," IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 5, pp. 689-702, May 2012.
11. A. Y. Ng, M. I. Jordan, and Y. Weiss, "On spectral clustering: Analysis and an algorithm," in Proc. Adv. NIPS, vol. 2. 2002, pp. 849-856.
12. U. von Luxburg, "A tutorial on spectral clustering," Statist. Comput., vol. 17, no. 4, pp. 395-416, 2007.
13. F. R. Chung, Spectral Graph Theory, vol. 92. Providence, RI, USA: AMS, 1997.
14. C. Alzate and J. A. K. Suykens, "Multiway spectral clustering with out-of-sample extensions through weighted kernel PCA," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 2, pp. 335-347, Feb. 2010.
15. J. A. K. Suykens, "Data visualization and dimensionality reduction using kernel maps with a reference point," IEEE Trans. Neural Netw., vol. 19, no. 9, pp. 1501-1517, Sep. 2008.
16. C. Alzate and J. A. K. Suykens, "A semi-supervised formulation to binary kernel spectral clustering," in Proc. IEEE IJCNN, Jun. 2012, pp. 1992-1999.
17. S. Mehrkanoon and J. A. K. Suykens, "Non-parallel semi-supervised classification based on kernel spectral clustering," in Proc. IEEE IJCNN, 2012, pp. 2311-2318.
18. C. M. Bishop and N. M. Nasrabadi, Pattern Recognition and Machine Learning, vol. 1. New York, NY, USA: Springer-Verlag, 2006.
19. P. J. Rousseeuw, "Silhouettes: A graphical aid to the interpretation and validation of cluster analysis," J. Comput. Appl. Math., vol. 20, no. 1, pp. 53-65, 1987.
20. V. Vapnik, Statistical Learning Theory. New York, NY, USA: Wiley, 1998.
21. S. Boyd and L. Vandenberghe, Convex Optimization. New York, NY, USA: Cambridge Univ. Press, 2004.
22. S. Xavier-De-Souza, J. A. K. Suykens, J. Vandewalle, and D. Bollé, "Coupled simulated annealing," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 40, no. 2, pp. 320-335, Apr. 2010.
23. J. C. Bezdek and N. R. Pal, "Some new indexes of cluster validity," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 28, no. 3, pp. 301-315, Jun. 1998.
24. O. Chapelle, V. Sindhwani, and S. S. Keerthi, "Branch and bound for semi-supervised support vector machines," in Proc. NIPS, 2006, pp. 217-224.
25. Y.-F. Li, J. T. Kwok, and Z.-H. Zhou, "Semi-supervised learning using label mean," in Proc. 26th Annu. Int. Conf. Mach. Learn., 2009, pp. 633-640.
26. A. Asuncion and D. J. Newman, "UCI machine learning repository,"Dept. Inf. Comput. Sci., Univ. California, Irvine, CA, USA, 2007.
27. J. A. Nelder and R. Mead, "A simplex method for function minimization," Comput. J., vol. 7, no. 4, pp. 308-313, 1965.
28. D. Martin, C. Fowlkes, D. Tal, and J. Malik, "A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics," in Proc. 8th Int. Conf. Comput. Vis., vol. 2. 2001, pp. 416-423.
29. P. Arbelaez, M. Maire, C. Fowlkes, and J. Malik, "Contour detection and hierarchical image segmentation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 5, pp. 898-916, May 2011.
30. S. Fortunato, "Community detection in graphs," Phys. Rep., vol. 486, no. 3, pp. 75-174, 2010.
31. X. Ma, L. Gao, X. Yong, and L. Fu, "Semi-supervised clustering algorithm for community structure detection in complex networks,"Phys. A, Statist. Mech. Appl., vol. 389, no. 1, pp. 187-197, 2010.
32. S. A. Macskassy and F. Provost, "Classification in networked data: A toolkit and a univariate case study," J. Mach. Learn. Res., vol. 8, pp. 935-983, May 2007.
33. W. W. Zachary, "An information flow modelfor conflict and fission in small groups," J. Anthropological Res., vol. 33, no. 4, pp. 452-473, 1977.
34. M. Girvan and M. E. Newman, "Community structure in social and biological networks," Proc. Nat. Acad. Sci., vol. 99, no. 12, pp. 7821-7826, 2002.
35. N. X. Vinh, J. Epps, and J. Bailey, "Information theoretic measures for clusterings comparison: Is a correction for chance necessary?" in Proc. 26th Annu. Int. Conf. Mach. Learn., 2009, pp. 1073-1080.
36. Z.-Y. Zhang, "Community structure detection in complex networks with partial background information," Europhys. Lett., vol. 101, no. 4, p. 48005, 2013.