Detecting influential observations in Kernel PCA

Computational Statistics and Data Analysis

Volumn 54, Issue 12, 2010, Pages 3007-3019

  Debruyne, Michiel ^a   Hubert, Mia ^b   Van Horebeek, Johan ^c  

^a UNIVERSITY OF ANTWERP   (Belgium)

^b UNIVERSITY OF LEUVEN   (Belgium)

^c CENTRO DE INVESTIGACIÓN EN MATEMÁTICAS   (Mexico)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL METHODS; DATA HANDLING;

EUCLIDEAN SPACES; GRAPHICAL DIAGNOSTICS; INFLUENCE FUNCTIONS; INFLUENTIAL OBSERVATIONS; KERNEL PRINCIPAL COMPONENT ANALYSES (KPCA); PCA ALGORITHMS; REPRODUCING KERNEL HILBERT SPACES; ROBUSTNESS ISSUES;

PRINCIPAL COMPONENT ANALYSIS;

EID: 77955357021     PISSN: 01679473     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.csda.2009.08.018     Document Type: Article

References (37)

1. Alzate, C., Suykens, J.A.K., 2008. Kernel component analysis using an epsilon insensitive robust loss function. IEEE Trans. Neural Netw. 19, 1583-1598.
2. Blanchard, G., Bousquet, O., Zwald, L., 2007. Statistical properties of kernel principal component analysis. Mach. Learn. 33, 259-294.
3. Chen, T., Martin, M., Montague, G., 2009. Robust probabilistic PCA with missing data and contribution analysis for outlier detection. Comput. Stat. Dat. An. 53, 3706-3716.
4. Christmann, A., Steinwart, I., 2007. Consistency and robustness of kernel based regression. Bernoulli 13, 799-819.
5. Christmann, A., Steinwart, I., 2004. On robustness properties of convex risk minimization methods for pattern recognition. J. Mach. Learn. Res. 5, 1007-1034.
6. Critchley, F., 1985. Influence in principal component analysis. Biometrika 72, 627-636.
7. Croux, C., Ruiz-Gazen, A., 2005. High breakdown estimators for principal components: The projection-pursuit approach revisited. J.Multivariate.Anal. 95, 206-226. (Pubitemid 40669260)
8. Croux, C., Ollila, E., Oja, H., 2002. Sign and rank covariance matrices: Statistical properties and application to principal components analysis. In: Statistical Data Analysis Based on the L1-Norm and Related Methods. Birkhauser, Basel, pp. 257-271.
9. Debruyne, M., Hubert, M., Suykens, J.A.K., 2008. Model selection for kernel based regression using the influence function. J. Mach. Learn. Res. 9, 2377-2400.
10. Esbensen, K.H., Schönkopf, S., Midtgaard, T., 1994. Multivariate Analysis in Practice. Camo, Trondheim.
11. Gervini, D., 2008. Robust functional estimation using the spatial median and spherical principal components. Biometrika 95, 587-600.
12. Gower, J.C., 1974. The mediancentre. Appl. Stat. 23, 466-470.
13. Haldane, J.B.S., 1948. Note on the median of a multivariate distribution. Biometrika 35, 414-415.
14. Hampel, F.R., Ronchetti, E.M., Rousseeuw, P.J., Stahel, W.A., 1986. Robust Statistics: The Approach Based on Influence Functions. Wiley, New York.
15. Hössjer, O., Croux, C., 1995. Generalizing univariate signed rank statistics for testing and estimating a multivariate location parameter. In: Non-parametric statistics, vol. 4. pp. 293-308.
16. Huber, P.J., 1981. Robust Statistics. Wiley, New York.
17. Hubert, M., Rousseeuw, P.J., Verboven, S., 2002. A fast robust method for principal components with applications to chemometrics. Chemometr. Intell. Lab. 60, 101-111.
18. Hubert, M., Rousseeuw, P.J., Vanden Branden, K., 2005. ROBPCA: A new approach to robust principal components analysis. Technometrics 47, 64-79.
19. Hubert, M., Rousseeuw, P.J., Verdonck, T., 2009. Robust PCA for skewed data and its outlier map. Comput. Stat. Dat. An. 53, 2264-2274.
20. Kuhn, H.W., 1973. A note on Ferniat's problem. Math. Program. 4, 98-107.
21. Liu, Z., Chen, D., Bensmail, H., 2005. Gene expression data classification with kernel principal component analysis. J. Biomed. Biotechnol. 2, 155-169.
22. Liu, Z., Chen, D., Bensmail, H., Xu, Y., 2005. Clustering gene expression data with kernel principal components. J. Bioinf. Comput. Biol. 3, 303-316.
23. Locantore, N., Marron, J.S., Simpson, D.G., Tripoli, N., Zhang, J.T., Cohen, K.L., 1999. Robust principal component analysis for functional data. Test 8, 1-73.
24. Marden, J.I., 1999. Some robust estimates of principal components. Statist. Probab. Lett. 43, 349-359.
25. Maronna, R.A., 2005. Principal components and orthogonal regression based on robust scales. Technometrics 47, 264-273.
26. Mika, S., Schölkopf, B., Smola, A., Müller, K.R., Scholz, M., Rätsch, G., 1999. Kernel PCA and denoising in feature spaces. In: Advances in Neural Information Processing Systems, 11. MIT Press, Cambridge, MA, pp. 536-542.
27. Phelps, R., 1986. Convex Functions, Monotone Operators and Differentiability. In: Lecture Notes in Math., vol. 1364. Springer.
28. Pison, G., Van Aelst, S., 2004. Diagnostic plots for robust multivariate methods. J. Comput. Graph. Stat. 13, 310-329.
29. Pochet, N., De Smet, F., Suykens, J.A.K., De Moor, B., 2004. Systematic benchmarking of microarray data classification: Assessing the role of non-linearity and dimensionality reduction. Bioinformatics 20, 3185-3195. (Pubitemid 39619208)
30. Rousseeuw, P.J., Croux, C., 1993. Alternatives to the median absolute deviation. J. Amer. Statist. Assoc. 88, 1273-1283.
31. Schölkopf, B., Smola, A., 2002. Learning with Kernels. MIT Press, Cambridge, MA.
32. Schölkopf, B., Smola, A., Müller, K.R., 1998. Nonlinear component analysis as a kernel eigenvalue problem. Neural Comput. 10, 1299-1319. (Pubitemid 128463674)
33. Serneels, S., Verdonck, T., 2008. Principal component analysis for data containing outliers and missing elements. Comput. Stat. Dat. An. 52, 1712-1727.
34. Shawe-Taylor, J., Cristianini, N., 2004. Kernel Methods for Pattern Analysis. Cambridge University Press, Cambridge.
35. Steinwart, I., Christmann, A., 2008. Support Vector Machines. Springer, New York.
36. Vardi, Y., Zhang, C.H., 2000. The multivariate L1-median and associated data depth. Proc. Natl. Acad. Sci. USA 97, 1423-1426.
37. Yang, J., Frangi, A.F., Yang, J.Y., Zhang, D., Jin, Z., 2005. KPCA plus LDA: A complete kernel Fisher discriminant framework for feature extraction and recognition. IEEE Trans. Pattern Anal. 27, 230-244.