Model selection of Gaussian kernel PCA for novelty detection

Chemometrics and Intelligent Laboratory Systems

Volumn 136, Issue , 2014, Pages 164-172

  Xiao, Yingchao ^a   Wang, Huangang ^a   Xu, Wenli ^a  

^a TSINGHUA UNIVERSITY   (China)

Author keywords

Fault detection; Gaussian kernel PCA; Model selection; Novelty detection

Indexed keywords

ARTICLE; CALCULATION; CLASSIFICATION ALGORITHM; CONTROLLED STUDY; GEOMETRY; INTERMETHOD COMPARISON; K NEAREST NEIGHBOR; KERNEL METHOD; MATHEMATICAL COMPUTING; MATHEMATICAL MODEL; PRINCIPAL COMPONENT ANALYSIS; PRIORITY JOURNAL;

EID: 84904614407     PISSN: 01697439     EISSN: 18733239     Source Type: Journal    
DOI: 10.1016/j.chemolab.2014.05.015     Document Type: Article

References (24)

1. Cao L.J., Chua K.S., Chong W.K., Lee H.P., Gu Q.M. A comparison of PCA, KPCA and ICA for dimensionality reduction in support vector machine. Neurocomputing 2003, 55:321-336.
2. Pan Y.Z., Ge S.S., Al Mamun A. Weighted locally linear embedding for dimension reduction. Pattern Recogn. 2009, 42:798-811.
3. Kwok J.T.Y., Tsang I.W.H. The pre-image problem in kernel methods. IEEE Trans. Neural Networks 2004, 15:1517-1525.
4. Abrahamsen T.J., Hansen L.K. Regularized pre-image estimation for kernel PCA de-noising input space regularization and sparse reconstruction. J. Signal Process. Syst. 2011, 65:403-412.
5. Saerens M., Fouss F., Yen L., Dupont P. The principal components analysis of a graph, and its relationships to spectral clustering. Machine Learning: Ecml 2004, Proceedings, volume 3201 of Lecture Notes in Computer Science 2004, 371-383. Springer-Verlag Berlin, Berlin. J.F. Boulicaut, F. Esposito, F. Giannoti, D. Pedreschi (Eds.).
6. Qiu H.J., Hancock E.R. Clustering and embedding using commute times. IEEE Trans. Pattern Anal. Mach. Intell. 2007, 29:1873-1890.
7. Hoffmann H. Kernel PCA for novelty detection. Pattern Recogn. 2007, 40:863-874.
8. Xiao Y., Wang H., Xu W., Zhou J. L1 norm based KPCA for novelty detection. Pattern Recogn. 2013, 46:389-396.
9. Markou M., Singh S. Novelty detection: a review - part 1: statistical approaches. Signal Process. 2003, 83:2481-2497.
10. Markou M., Singh S. Novelty detection: a review - part 2: neural network based approaches. Signal Process. 2003, 83:2499-2521.
11. Tax D.M.J., Duin R.P.W. Support vector domain description. Pattern Recogn. Lett. 1999, 20:1191-1199.
12. Schölkopf B., Platt J.C., Shawe-Taylor J., Smola A.J., Williamson R.C. Estimating the support of a high-dimensional distribution. Neural Comput. 2001, 13:1443-1471.
13. Braun M.L., Buhmann J.M., Muller K.R. On relevant dimensions in kernel feature spaces. J. Mach. Learn. Res. 2008, 9:1875-1908.
14. Alzate C., Suykens J.A.K. Multiway spectral clustering with out-of-sample extensions through weighted kernel PCA. IEEE Trans. Pattern Anal. Mach. Intell. 2010, 32:335-347.
15. Jørgensen K.W., Hansen L.K. Model selection for Gaussian kernel PCA denoising. IEEE Trans. Neural Networks Learn. Syst. 2012, 23:163-168.
16. Schölkopf B., Smola A., Muller K.R. Nonlinear component analysis as a kernel eigenvalue problem. Neural Comput. 1998, 10:1299-1319.
17. Li Y.H., Maguire L. Selecting critical patterns based on local geometrical and statistical information. IEEE Trans. Pattern Anal. Mach. Intell. 2011, 33:1189-1201.
18. Wilson D.R., Martinez T.R. Reduction techniques for instance-based learning algorithms. Mach. Learn. 2000, 38:257-286.
19. Chen Y., Dang X., Peng H., Bart J., Henry L. Outlier detection with the kernelized spatial depth function. IEEE Trans. Pattern Anal. Mach. Intell. 2009, 31:288-305.
20. Duin R., Juszczak P., Paclik P., Pekalska E., De Ridder D., Tax D., Verzakov S. A MATLAB toolbox for pattern recognition http://www.prtools.org/.
21. Godoy J.L., Zumoffen D.A., Vega J.R., Marchetti J.L. New contributions to non-linear process monitoring through kernel partial least squares. Chemom. Intell. Lab. Syst. 2014, 135:76-89.
22. Fawcett T. An introduction to ROC analysis. Pattern Recogn. Lett. 2006, 27:861-874.
23. Demsar J. Statistical comparisons of classifiers over multiple data sets. J. Mach. Learn. Res. 2006, 7:1-30.
24. Prez-Garrido A., Helguera A.M., Borges F., Cordeiro M.N.D., Rivero V., Escudero A.G. Two new parameters based on distances in a receiver operating characteristic chart for the selection of classification models. J. Chem. Inf. Model. 2011, 51:2746-2759.