Non-negativity constraints on the pre-image for pattern recognition with kernel machines

Pattern Recognition

Volumn 46, Issue 11, 2013, Pages 3066-3080

  Kallas, Maya ^a,c   Honeine, Paul ^a   Richard, Cédric ^b   Francis, Clovis ^c   Amoud, Hassan ^c  

^a UNIVERSITÉ DE TECHNOLOGIE DE TROYES   (France)

^b UNIVERSITÉ DE NICE SOPHIA ANTIPOLIS   (France)

^c LEBANESE UNIVERSITY   (Lebanon)

Author keywords

Kernel; Kernel machines; Machine learning; Non negativity constraints; Nonlinear denoising; Pattern recognition; PCA; Pre image problem; SVM

Indexed keywords

KERNEL; KERNEL MACHINE; NON-NEGATIVITY CONSTRAINTS; NONLINEAR DENOISING; PCA; PRE-IMAGE PROBLEM; SVM;

CONSTRAINT THEORY; FEATURE EXTRACTION; IMAGE PROCESSING; ITERATIVE METHODS; LEARNING SYSTEMS; PATTERN RECOGNITION; PRINCIPAL COMPONENT ANALYSIS;

IMAGE DENOISING;

EID: 84878879981     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2013.03.021     Document Type: Article

References (39)

1. G. Chen, and B. Kégl Image denoising with complex ridgelets Pattern Recognition 40 2 2007 578 585
2. W.-S. Zheng, J. Lai, S. Liao, and R. He Extracting non-negative basis images using pixel dispersion penalty Pattern Recognition 2012
3. C. Twining, and C. Taylor The use of kernel principal component analysis to model data distributions Pattern Recognition 36 1 2003 217 227
4. Z. Yang, and E. Oja Quadratic nonnegative matrix factorization Pattern Recognition 45 4 2012 1500 1510
5. G. Thomas A positive optimal deconvolution procedure IEEE International Conference on Acoustics, Speech, and Signal Processing ICASSP 8 April 1983 651 654
6. R. Prost, and R. Goutte Discrete constrained iterative deconvolution algorithms with optimized rate of convergence Signal Processing 7 December (3) 1984 209 230
7. G. Thomas, N. Souilah, Utilisation des multiplicateurs de lagrange pour la restauration d'image AVEC contraintes, Colloques sur le Traitement du Signal et des Images, 1991.
8. D. Snyder, T. Schulz, and J. O'Sullivan Deblurring subject to nonnegativity constraints IEEE Transactions on Signal Processing 40 May 1992 1143 1150
9. H. Lantéri, M. Roche, O. Cuevas, and C. Aime A general method to devise maximum-likelihood signal restoration multiplicative algorithms with non-negativity constraints Signal Processing 81 May (5) 2001 945 974
10. J. Chen, C. Richard, P. Honeine, H. Snoussi, H. Lantéri, C. Theys, Techniques d'apprentissage non-linéaires en ligne avec contraintes de positivite, in: Actes de la VIème Conférence Internationale Francophone d'Automatique, Nancy, France, 2-4 June 2010.
11. J. Chen, C. Richard, P. Honeine, H. Lantéri, C. Theys, System identification under non-negativity constraints, in: Proceedings of European Conference on Signal Processing (EUSIPCO), Aalborg, Denmark, Eurasip, 2010.
12. J. Chen, C. Richard, P. Honeine, J.C.M. Bermudez, Non-negative distributed regression for data inference in wireless sensor networks, in: Proceedings of the 44th Asilomar Conference on Signals, Systems, and Computers, Pacific Grove (CA), USA, 2010.
13. M. Kallas, P. Honeine, C. Richard, H. Amoud, C. Francis, Nonlinear feature extraction using kernel principal component analysis with non-negative pre-image, in: Proceedings of the 32nd Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Buenos Aires, Argentina, 31 August-4 September, 2010.
14. M. Kallas, P. Honeine, C. Richard, C. Francis, H. Amoud, Non-negative pre-image in machine learning for pattern recognition, in: Proceedings of the 19th European Signal Processing Conference, Barcelona, Spain, 29 August-2.
15. M. Kallas, H. Amoud, P. Honeine, C. Francis, Sur le problème de la pré-image en reconnaissance des formes avec contraintes de non-négativité, in: Colloque GRETSI'2011, Bordeaux, France, 5-8 Septembre 2011.
16. H. Han Nonnegative principal component analysis for mass spectral serum profiles and biomarker discovery BMC Bioinformatics 2010
17. R. Zass, A. Shashua, Nonnegative sparse PCA, in: Neural Information Processing Systems, 2007.
18. B. Moghaddam, Y. Weiss, S. Avidan, Spectral bounds for sparse PCA: exact and greedy algorithms, in: Advances in Neural Information Processing Systems, MIT Press, 2006, pp. 915-922.
19. C.D. Sigg, J.M. Buhmann, Expectation-maximization for sparse and non-negative PCA, in: 25th International Conference on Machine Learning (ICML), ACM, 2008.
20. V.N. Vapnik, Statistical Learning Theory, Wiley-Interscience, September 1998.
21. B. Schölkopf, A. Smola, and K.-R. Müller Nonlinear component analysis as a kernel eigenvalue problem Neural Computation 10 July 1998 1299 1319
22. S. Mika, B. Schölkopf, A. Smola, K.-R. Müller, M. Scholz, G. Rätsch, Kernel PCA and de-noising in feature spaces, in: Proceedings of the 1998 Conference on Advances in Neural Information Processing Systems II, MIT Press, Cambridge, MA, USA, 1999, pp. 536-542.
23. J.T. Kwok, and I.W. Tsang The pre-image problem in kernel methods T. Fawcett, N. Mishra, Proceedings of the 20th International Conference on Machine Learning 2003 AAAI Press 408 415
24. T.J. Abrahamsen, and L.K. Hansen Regularized pre-image estimation for kernel PCA de-noising input space regularization and sparse reconstruction Journal of Signal Processing Systems 65 3 2011 403 412
25. P. Honeine, C. Richard, Solving the pre-image problem in kernel machines: a direct method, in: Proceedings of the IEEE Workshop on Machine Learning for Signal Processing (MLSP), Grenoble, France, September 2009.
26. P. Honeine, and C. Richard A closed-form solution for the pre-image problem in kernel-based machines Journal of Signal Processing Systems 65 December 2011 289 299
27. P. Honeine, and C. Richard Preimage problem in kernel-based machine learning IEEE Signal Processing Magazine 28 2 2011 77 88
28. W. Zheng, J. Lai, and P.C. Yuen Penalized preimage learning in kernel principal component analysis IEEE Transaction Neural Networks 21 April 2010 551 570
29. E.J. Candes, and M.B. Wakin An introduction to compressive sampling IEEE Signal Processing Magazine 25 March (2) 2008 21 30
30. N. Aronszajn Theory of reproducing kernels Transactions of the American Mathematical Society 68 1950 337 404
31. F. Cucker, and S. Smale On the mathematical foundations of learning Bulletin of the American Mathematical Society 39 2002 1 49
32. C.J.C. Burges Geometry and invariance in kernel based methods B. Schölkopf, C.J.C. Burges, A.J. Smola, Advances in Kernel Methods 1999 MIT Press Cambridge, MA, USA 89 116
33. B. Schölkopf, A. Smola, and K.-R. Müller Nonlinear component analysis as a kernel eigenvalue problem Neural Computation 10 5 1998 1299 1319
34. R. Rosipal, M. Girolami, and L.J. Trejo Kernel PCA for feature extraction and de-noising in non-linear regression Neural Computing and Applications 10 2000 231 243
35. G.S. Kimeldorf, and G. Wahba Some results on Tchebycheffian spline functions Journal of Mathematical Analysis and Applications 33 1 1971 82 95
36. B. Schölkopf, R. Herbrich, A.J. Smola, A generalized representer theorem, in: Proceedings of the 14th Annual Conference on Computational Learning Theory and Fifth European Conference on Computational Learning Theory (COLT '01/EuroCOLT '01), Springer-Verlag, London, UK, 2001, pp. 416-426.
37. S.T. Roweis, L.K. Saul, Nonlinear dimensionality reduction by locally linear embedding, in: SCIENCE, vol. 290, 2000, pp. 2323-2326.
38. S.D. Georgiadis, State-Space Modeling and Bayesian Methods for Evoked Potential Estimation, Ph.D. Dissertation, Department of Applied Physics, University of Kuopio, Finland, May 2007.
39. M.P. Tarvainen, Estimation Methods for Nonstationary Biosignals, Ph.D. Dissertation, Department of Applied Physics, University of Kuopio, Finland, June 2004.