A new information theoretic analysis of sum-of-squared-error kernel clustering

Neurocomputing

Volumn 72, Issue 1-3, 2008, Pages 23-31

  Jenssen, Robert ^a   Eltoft, Torbjørn ^a  

^a UNIVERSITY OF TROMSØ   (Norway)

Author keywords

Information theory; K means; Mercer kernels; Parzen windowing; Renyi entropy; Sum of squared error clustering

Indexed keywords

FACE RECOGNITION; FLOW OF SOLIDS; INFORMATION THEORY; LEARNING SYSTEMS; PROBABILITY DENSITY FUNCTION; SUPPORT VECTOR MACHINES;

K-MEANS; MERCER KERNELS; PARZEN WINDOWING; RENYI ENTROPY; SUM-OF-SQUARED-ERROR CLUSTERING;

CLUSTER ANALYSIS;

ARTICLE; BAYES THEOREM; CLUSTER ANALYSIS; CORRELATION ANALYSIS; DISCRIMINANT ANALYSIS; ENTROPY; INDEPENDENT COMPONENT ANALYSIS; INFORMATION PROCESSING; KERNEL METHOD; MACHINE LEARNING; MATHEMATICAL ANALYSIS; MATHEMATICAL COMPUTING; PRIORITY JOURNAL; PROBABILITY; SUPPORT VECTOR MACHINE; THEORY;

EID: 55949126917     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2008.03.017     Document Type: Article

References (22)

1. Bach F., and Jordan M.I. Kernel independent component analysis. J. Mach. Learn. Res. 2 (2003) 121-167
2. Y. Bengio, P. Vincent, J.-F. Paiement, Spectral Clustering and Kernel PCA are Learning Eigenfunctions, Département d'informatique et recherche opérationelle, université de Montréal, Montréal, Canada, 2003.
3. Cortes C., and Vapnik V. Support vector networks. Mach. Learn. 20 (1995) 273-297
4. Duda R.O., Hart P.E., and Stork D.G. Pattern Classification. second ed. (2001), Wiley, New York
5. Friedman J.H. On bias, variance, 0/1 loss, and the curse-of-dimensionality. Data Min. Knowl. Discovery 1 1 (1997) 55-77
6. Fyfe C., and Lai P.L. Kernel and nonlinear canonical correlation analysis. Int. J. Neural Syst. 10 (2001) 365-374
7. Girolami M. Mercer kernel-based clustering in feature space. IEEE Trans. Neural Networks 13 3 (2002) 780-784
8. R. Jenssen, D. Erdogmus, J.C. Principe, T. Eltoft, Information theoretic angle-based spectral clustering: a theoretical analysis and an algorithm, in: Proceedings of International Joint Conference on Neural Networks, Vancouver, Canada, 2006, pp. 4904-4911.
9. J. MacQueen, Some methods for classification and analysis of multivariate observations, in: Proceedings of Berkeley Symposium on Mathematical Statistics and Probability, University of California Press, Berkeley, pp. 281-297.
10. Mercer J. Functions of positive and negative type and their connection with the theory of integral equations. Philos. Trans. R. Soc. London A (1909) 415-446
11. S. Mika, G. Rätsch, J. Weston, B. Schölkopf, K.R. Müller, Fisher discriminant analysis with kernels, in: Proceedings of IEEE International Workshop on Neural Networks for Signal Processing, Madison, USA, August 23-25, 1999, pp. 41-48.
12. Müller K.R., Mika S., Rätsch G., Tsuda K., and Schölkopf B. An introduction to kernel-based learning algorithms. IEEE Trans. Neural Networks 12 2 (2001) 181-201
13. A.Y. Ng, M. Jordan, Y. Weiss, On spectral clustering: analysis and an algorithm, in: Advances in Neural Information Processing Systems, vol. 14, MIT Press, Cambridge MA, 2002, pp. 849-856.
14. Principe J., Xu D., and Fisher J. Information theoretic learning. In: Haykin S. (Ed). Unsupervised Adaptive Filtering vol. I (2002), Wiley, New York 265-319
15. A. Renyi, On measures of entropy and information, in: Fourth Berkeley Symposium on Mathematical Statistics and Probability, 1960, pp. 547-561.
16. Schölkopf B., and Smola A.J. Learning with Kernels (2002), MIT Press, Cambridge, MA
17. Schölkopf B., Smola A.J., and Müller K.R. Nonlinear component analysis as a kernel eigenvalue problem. Neural Comput. 10 (1998) 1299-1319
18. Shawe-Taylor J., and Cristianini N. Kernel Methods for Pattern Analysis (2004), Cambridge University Press, Cambridge, UK
19. Silverman B.W. Density Estimation for Statistics and Data Analysis (1986), Chapman & Hall, London
20. Wand M.P., and Jones M.C. Kernel Smoothing (1995), Chapman & Hall, London
21. C. Williams, M. Seeger, Using the Nyström method to speed up kernel machines, in: Advances in Neural Information Processing Systems, vol. 13, MIT Press, Cambridge MA, 2001, pp. 682-688.
22. H. Zha, X. He, C. Ding, H. Simon, M. Gu, Spectral relaxation for K-means clustering, in: Advances in Neural Information Processing Systems, vol. 14, MIT Press, Cambridge MA, 2002, pp. 1057-1064.