Regularized Pre-image estimation for kernel PCA de-noising : Input space regularization and sparse reconstruction

Journal of Signal Processing Systems

Volumn 65, Issue 3, 2011, Pages 403-412

  Abrahamsen, Trine Julie ^a   Hansen, Lars Kai ^a  

^a TECHNICAL UNIVERSITY OF DENMARK   (Denmark)

Author keywords

De noising; Kernel PCA; Pre image; Regularization; Sparsity

Indexed keywords

DE-NOISING; KERNEL PCA; PRE-IMAGE; REGULARIZATION; SPARSITY;

ESTIMATION; SIGNAL PROCESSING;

PRINCIPAL COMPONENT ANALYSIS;

EID: 81855177251     PISSN: 19398018     EISSN: 19398115     Source Type: Journal    
DOI: 10.1007/s11265-010-0515-4     Document Type: Article

References (20)

1. Arias, P., Randall, G., & Sapiro, G. (2007). Connecting the out-of-sample and pre-image problems in kernel methods. In IEEE computer society conference on computer vision and pattern recognition (pp. 1-8). Minneapolis, MN.
2. Bakir, G. H., Weston, J., & Schölkopf, B. (2004). Learning to find pre-images. In S. L. Thrun, & B. Schölkopf (Eds.), Advances in neural information processing systems (Vol. 16, pp. 449-456). Cambridge: MIT.
3. CJC Burges 1998 A tutorial on support vector machines for pattern recognition Data Mining and Knowledge Discovery 2 121 167 10.1023/A: 1009715923555 (Pubitemid 128126769)
4. Dambreville, S., Rathi, Y., & Tannenbaum, A. (2006). Statistical shape analysis using kernel PCA. In IS&T/SPIE symposium on electrical imaging.
5. Friedman, J. H. (2008). Fast sparse regression and classification. Tech. rep., Department of Statistics, Stanford University.
6. JJ Hull 1994 A database for handwritten text recognition research IEEE Transactions on Pattern Analysis and Machine Intelligence 16 5 550 554 10.1109/34.291440
7. KI Kim MO Franz B Schölkopf 2005 Iterative kernel principal component analysis for image modeling IEEE Transactions on Pattern Analysis and Machine Intelligence 27 9 1351 1366 10.1109/TPAMI.2005.181 (Pubitemid 41387769)
8. JTY Kwok IWH Tsang 2004 The pre-image problem in kernel methods IEEE Transactions on Neural Networks 15 6 1517 1525 10.1109/TNN.2004.837781
9. Mika, S., Schölkopf, B., Smola, A., Müller, K. R., Scholz, M., & Rätsch, G. (1999). Kernel PCA and de-noising in feature spaces. In M. S. Kearns, S. A. Solla, & D. A. Cohn (Eds.), Advances in neural information processing systems (Vol. 11, pp. 536-542). Cambridge: MIT.
10. MH Nguyen FD la Torre 2009 Robust kernel principal component analysis Advances in Neural Information Processing Systems 21 1185 1192
11. JR Rice JS White 1964 Norms for smoothing and estimation SIAM Review 6 243 256 168069 0121.34102 10.1137/1006061
12. B Schölkopf S Mika CJC Burges P Knirsch KR Müller G Rätsch, et al. 1999 Input space versus feature space in kernel-based methods IEEE Transactions On Neural Networks 10 5 1000 1017 10.1109/72.788641
13. B Schölkopf A Smola KR Müller 1998 Nonlinear component analysis as a kernel eigenvalue problem Neural Computation 10 5 1299 1319 10.1162/089976698300017467
14. Schölkopf, B., Smola, A. J., Knirsch, P., & Burges, C. J. C. (1998). Fast approximation of support vector kernel expansions, and an interpretation of clustering as approximation in feature spaces. In P. Levi, M. Schanz, R.-J. Ahlers, & F. May (Eds.), Mustererkennung 1998, 20. DAGM-Symposium (pp. 125-132). Berlin: Springer.
15. Takahashi,T., & Kurita, T. (2002). Robust de-noising by kernel PCA. In ICANN '02: Proceedings of the international conference on artificial neural networks (pp. 739-744). Berlin: Springer.
16. AR Teixeira AM Tomé K Stadlthanner EW Lang 2008 KPCA denoising and the pre-image problem revisited Digital Signal Processing 18 4 568 580 10.1016/j.dsp.2007.08.001 (Pubitemid 351759156)
17. Thorstensen, N., Segonne, F., & Keriven, R. (2008). Normalization and preimage problem in gaussian kernel PCA. In 2008 15th IEEE international conference on image processing-ICIP 2008, (pp. 741-744). San Diego, California.
18. R Tibshirani 1994 Regression shrinkage and selection via the Lasso Journal of the Royal Statistical Society, Series B 58 267 288 1379242
19. Tikhonov, A. N., & Arsenin, V. Y. (1977). Solution of ill-posed problems. New York: Wiley.
20. WS Zheng JH Lai 2006 Regularized locality preserving learning of pre-image problem in kernel principal component analysis International Conference on Pattern Recognition 2 456 459