Towards a unification of information theoretic learning and Kernel methods

Machine Learning for Signal Processing XIV - Proceedings of the 2004 IEEE Signal Processing Society Workshop

Volumn , Issue , 2004, Pages 93-102

  Jenssen, Robert ^a   Erdogmus, Deniz ^b   Principe, Jose C ^b   Eltoft, Torbjørn ^a  

^a UNIVERSITY OF TROMSØ   (Norway)

^b UNIVERSITY OF FLORIDA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ESTIMATION; INFORMATION ANALYSIS; LEARNING ALGORITHMS; PRINCIPAL COMPONENT ANALYSIS; PROBABILITY DENSITY FUNCTION; PROBLEM SOLVING; RADIAL BASIS FUNCTION NETWORKS; VECTORS;

KERNEL PRINCIPAL COMPONENT ANALYSIS (KPCA); RADIAL-BASIS-FUNCTIONS (RBF); SUPPORT VECTOR MACHINES (SVM); THEORITIC LEARNING;

LEARNING SYSTEMS;

EID: 17644422252     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (16)

1. V. N. Vapnik, The Nature of Statistical Learning Theory, Springer-Verlag, New York, 1995.
2. C. J. C. Burges, "A Tutorial on Support Vector Machines for Pattern Recognition," Knowledge Discovery and Data Mining, vol. 2, no. 2, pp. 121-167, 1998.
3. S. Mika, G. Rãtsch, J. Weston, B. Schölkopf, and K. R. Müller, "Fisher Discriminant Aanalysis with Kernels," in IEEE Workshop on Neural Networks for Signal Processing, Piscataway, NJ, USA, 1999, pp. 41-48.
4. B. Schölkopf, A. J. Smola, and K. R. Müller, "Nonlinear Component Analysis as a Kernel Eigenvalue Problem," Neural Computation, vol. 10, pp. 1299-1319, 1998.
5. Y. A. LeCun, L. D. Jackel, L. Bottou, A. Brunot, C. Cortes, J.S. Denker, H. Drucker, I. Guyon, U. A. Müller, E. Säckinger, P. Y. Simard, and V. N. Vapnik, "Learning Algorithms for Classification: A Comparison on Handwritten Digit Reconstruction," Neural Networks, pp. 261-276, 1995.
6. K. R. Müller, A. J. Smola, G. Rätsch B. Schölkopf, J. Kohlmorgen, and V. N. Vapnik, "Predicting Time Series with Support Vector Machines," in Artificial Neural Networks - Springer Lecture Notes in Computer Science, W. Gerstner and A. Germond and M. Hasler and J.-D. Nicoud (Eds.), Springer-Verlag, Berlin, Germany, 1997, vol. 1327, pp. 999-1004.
7. A. Zien, G. Rätsch, S. Mika, B. Schölkopf, T. Lengauer, and K. R. Müller, "Engineering Support Vector Machine Kernels that Recognize Translation Invariant Sites in DNA," Bioinformatics, vol. 16, pp. 906-914, 2000.
8. J. Principe, D. Xu, and J. Fisher, "Information Theoretic Learning," in Unsupervised Adaptive Filtering, S. Haykin (Ed.), John Wiley & Sons, 2000, vol. I, Chapter 7.
9. D. Erdogmus and J. C. Principe, "Generalized Information Potential Criterion for Adaptive System Training," IEEE Transactions on Neural Networks, vol. 13, no. 5, pp. 1035-1044, 2002.
10. M. Lazaro, I. Santamaria, D. Erdogmus, K. E. Hild II, C. Pantaleon, and J. C. Principe, "Stochastic Blind Equalization Based on PDF Fitting using Parzen Estimator," To appear in IEEE Transactions on Signal Processing, 2004.
11. K. E. Hild II, D. Erdogmus, and J. C. Principe, "Blind Source Separation using Renyi's Mutual Information," IEEE Signal Processing Letters, vol. 8, no. 6, pp. 174-176, 2001.
12. R. Jenssen, D. Erdogmus, K. E. Hild II, J. C. Principe, and T. Eltoft, "Efficient Information Theoretic Clustering using Stochastic Approximation," in Submitted to IEEE International Workshop on Machine Learning for Signal Processing, Sao Luis, Brazil, 2004.
13. J. Mercer, "Functions of Positive and Negative Type and their Connection with the Theory of Integral Equations," Philos. Trans. Roy. Soc. London, vol. A, pp. 415-446, 1909.
14. E. Parzen, "On the Estimation of a Probability Density Function and the Mode," Ann. Math. Stat., vol. 32, pp. 1065-1076, 1962.
15. M. Girolami, "Orthogonal Series Density Estimation and the Kernel Eigenvalue Problem," Neural Computation, vol. 14, no. 3, pp. 669-688, 2002.
16. R. Jenssen, J. C. Principe, and T. Eltoft, "Information Cut and Information Forces for Clustering," in IEEE International Workshop on Neural Networks for Signal Processing, Toulouse, France, 2003, pp. 459-468.