Kernel principal components are maximum entropy projections

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 3889 LNCS, Issue , 2006, Pages 846-853

  Paiva, António R C ^a   Xu, Jian Wu ^a   Príncipe, José C ^a  

^a University of Florida   (United States)

Author keywords

Entropy projections; Information theoretic learning; Kernel PCA

Indexed keywords

INDEPENDENT COMPONENT ANALYSIS; INFORMATION ANALYSIS; MATHEMATICAL TRANSFORMATIONS; PRINCIPAL COMPONENT ANALYSIS;

ENTROPY PROJECTIONS; INFORMATION-THEORETIC LEARNING; KERNEL PCA;

BLIND SOURCE SEPARATION;

EID: 33745711479     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/11679363_105     Document Type: Conference Paper

References (12)

1. Diamantaras, K.I., Kung, S.Y.: Principal Component Neural Networks: Theory and Applications. John Wiley & Sons (1996)
2. Schölkopf, B., Smola, A., Müller, K.R.: Nonlinear component analysis as a kernel eigenvalue problem. Neural Computation 10(5) (1998) 1299-1319
3. Schölkopf, B., Smola, A., Müller, K.R.: Kernel principal component analysis. In Gerstner, W., Germond, A., Hasler, M., Nicoud, J.D., eds.: Proc. Artificial Neural Networks ICANN'97, Berlin, Springer Lecture Notes in Computer Science, Vol. 1327 (1997) 583-588
4. Williams, C.K.I.: On a connection between kernel pea and metric multidimensional scaling. Machine Learning 46(1-3) (2002) 11-19
5. Bengio, Y., Delalleau, O., Roux, N.L., Paiement, J.F., Vincent, P., Ouimet, M.: Learning eigenfunctions links spectral embedding and kernel pea. Neural Computation 16(10) (2004) 2197-2219
6. Bach, F.R., Jordan, M.I.: Kernel independent component analysis. Journal of Machine Learning Research 3 (2002) 1-48
7. Rényi, A.: On measures of entropy and information. In: Selected paper of Alfred Rényi. Volume 2. Akademiai Kiado, Budapest, Hungary (1976) 565-580
8. Príncipe, J.C., Xu, D., Fisher, J.W.: Information theoretic learning. In Haykin, S., ed.: Unsupervised Adaptive Filtering. Volume 2. John Wiley & Sons (2000) 265-319
9. Parzen, E.: On the estimation of a probability density function and the mode. The Annals of Mathematical Statistics 33(2) (1962) 1065-1076
10. Jenssen, R., Erdogmus, D., Principe, J.C., Eltoft, T.: Towards a unification of information theoretic learning and kernel methods. In: Proc. MLSP'04, São Luís, Brazil (2004)
11. Shannon, C.E.: A mathematical theory of communication. The Bell System Technical Journal 27 (1948) 379-423, 623-656
12. Sanger, T.D.: Optimal unsupervised learning in a single layer linear feedforward neural network. Neural Networks 2(7) (1989) 459-473