A closed-form solution for the pre-image problem in Kernel-based machines

Journal of Signal Processing Systems

Volumn 65, Issue 3, 2011, Pages 289-299

  Honeine, Paul ^a   Richard, Cédric ^b  

^a UNIVERSITÉ DE TECHNOLOGIE DE TROYES   (France)

^b UNIVERSITÉ DE NICE SOPHIA ANTIPOLIS   (France)

Author keywords

Kernel based machines; Kernel PCA; Linear algebra; Nonlinear denoising; Pre image problem

Indexed keywords

CLOSED FORM SOLUTIONS; CO-ORDINATE SYSTEM; DE-NOISING; GIVEN FEATURES; HANDWRITTEN DIGIT; INNER PRODUCT; INPUT SPACE; ITERATIVE OPTIMIZATION; KERNEL-BASED MACHINES; KERNEL-PCA; LINEAR ALGEBRA OPERATIONS; MULTI-DIMENSIONAL SCALING; NONLINEAR DENOISING; PRE-IMAGE PROBLEM; PRIOR KNOWLEDGE; REPRODUCING KERNEL HILBERT SPACES; RESEARCH SUBJECTS; STATE-OF-THE-ART METHODS; SYNTHETIC DATASETS; TRAINING DATA;

LEARNING ALGORITHMS; LEARNING SYSTEMS; LINEAR ALGEBRA; OPTIMIZATION; SIGNAL PROCESSING;

NOISE POLLUTION CONTROL;

EID: 81855227167     PISSN: 19398018     EISSN: 19398115     Source Type: Journal    
DOI: 10.1007/s11265-010-0482-9     Document Type: Article

References (21)

1. M Aizerman E Braverman L Rozonoer 1964 Theoretical foundations of the potential function method in pattern recognition learning Automation and Remote Control 25 821 837 172768
2. Arias, P., Randall, G., & Sapiro, G. (2007). Connecting the out-of-sample and pre-image problems in kernel methods. In IEEE Computer Society conference on computer vision and pattern recognition. http://ampere.iie.edu. uy/publicaciones/2007/ARS07.
3. N Aronszajn 1950 Theory of reproducing kernels Transactions of the American Mathematical Society 68 337 404 51437 0037.20701 10.1090/S0002-9947- 1950-0051437-7
4. Bakir, G., Weston, J., & Schölkopf, B. (2004). Learning to find pre-images. In S. Thrun, L. Saul, & B. Schölkopf (Eds.), NIPS 2003 (Vol. 16, pp. 449-456). Cambridge, MA: MIT Press.
5. Bengio, Y., Paiement, J., Vincent, P., Delalleau, O., Roux, N. L., & Ouimet, M. (2004). Out-of-sample extensions for lle, isomap, mds, eigenmaps, and spectral clustering. In S. Thrun, L. Saul, & B. Schölkopf (Eds.), Advances in neural information processing systems (Vol. 16). Cambridge, MA: MIT Press.
6. Etyngier, P., SÈgonne, F., & Keriven, R. (2007). Shape priors using manifold learning techniques. In 11th IEEE international conference on computer vision. Rio de Janeiro, Brazil.
7. H Hoffmann 2007 Kernel PCA for novelty detection Pattern Recognition 40 863 874 1118.68140 10.1016/j.patcog.2006.07.009 (Pubitemid 44667761)
8. Honeine, P., & Richard, C. (2009). Solving the pre-image problem in kernel machines: A direct method. In IEEE workshop on machine learning for signal processing. Grenoble, France.
9. Honeine, P., Richard, C., Essoloh, M., & Snoussi, H. (2008). Localization in sensor networks-A matrix regression approach. In 5th IEEE sensor array and multichannel signal processing workshop (SAM ). Darmstadt, Germany.
10. G Kimeldorf G Wahba 1971 Some results on tchebycheffian spline functions Journal of Mathematical Analysis and Applications 33 82 95 290013 0201.39702 10.1016/0022-247X(71)90184-3
11. Kwok, J. T., & Tsang, I. W. (2003). The pre-image problem in kernel methods. In Machine learning, proceedings of the twentieth international conference (ICML 2003) (pp. 408-415). Washington, DC: AAAI Press.
12. Lecun, Y., & Cortes, C. (1998). The mnist database of handwritten digits. http://yann.lecun.com/exdb/mnist/.
13. Mika, S. (2002). Kernel fisher discriminants. Ph.D. thesis, University of Technology, Berlin.
14. Mika, S., Schölkopf, B., Smola, A., Müller, K., Scholz, M., & Rätsch, G. (1999). Kernel pca and de-noising in feature spaces. In Proceedings of the 1998 conference on advances in neural information processing systems II (pp. 536-542). Cambridge, MA: MIT Press.
15. Rathi, Y., Dambreville, S., & Tannenbaum, A. (2006). Statistical shape analysis using kernel pca. In IS&T/SPIE symposium on electronic imaging.
16. Schölkopf, B., Herbrich, R., & Williamson, R. (2000). A generalized representer theorem. Tech. rep. NC2-TR-2000-81, Royal Holloway College, Univ. of London, UK.
17. B Schölkopf A Smola K Müller 1998 Nonlinear component analysis as a kernel eigenvalue problem Neural Computation 10 5 1299 1319 10.1162/089976698300017467 (Pubitemid 128463674)
18. Suykens, J., Gestel, T. V., Brabanter, J. D., Moor, B. D., & Vandewalle, J. (2002). Least squares support vector machines. Singapore: World Scientific.
19. Tax, D. (2001). One-class classification; concept-learning in the absence of counter-examples. Ph.D. thesis, Advanced School for Computing and Imaging-Delft University of Technology.
20. Vapnik, V. (1998). Statistical learning theory. New York: Wiley.
21. Yamanishi, Y., & Vert, J. P. (2007). Kernel matrix regression. Tech. rep. http://arxiv.org/abs/q-bio/0702054v1.