Kernel discriminant analysis for regression problems

Pattern Recognition

Volumn 45, Issue 5, 2012, Pages 2019-2031

  Kwak, Nojun ^a  

^a Ajou University   (South Korea)

Author keywords

Dimensionality reduction; Discriminant analysis; Feature extraction; KDAr; Kernel trick; Regression

Indexed keywords

DIMENSIONALITY REDUCTION; FACE ALIGNMENT; FACE IMAGES; FEATURE EXTRACTION METHODS; FEATURE SPACE; HIGH-DIMENSIONAL FEATURE SPACE; HIGHLY NONLINEAR; INPUT SPACE; INPUT VARIABLES; KDAR; KERNEL DISCRIMINANT ANALYSIS; KERNEL TRICK; LINEAR DISCRIMINANT ANALYSIS; LINEAR FEATURE EXTRACTION; NON-LINEAR TRANSFORMATIONS; NONLINEAR DISCRIMINANT ANALYSIS; NONLINEAR FEATURE EXTRACTION METHOD; REGRESSION; REGRESSION PROBLEM; TARGET VALUES;

ALIGNMENT; DISCRIMINANT ANALYSIS; FACE RECOGNITION; FEATURE EXTRACTION; REGRESSION ANALYSIS;

NONLINEAR ANALYSIS;

EID: 84855888827     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2011.11.006     Document Type: Article

References (45)

1. R.O. Duda, P.E. Hart, and D.G. Stork Pattern Classification 2nd ed. 2001 Wiley
2. P.A. Devijver, and J. Kittler Pattern Recognition: A Statistical Approach 1982 Prentice Hall London
3. V. Cherkassky, and F. Mulier Learning from Data: Concept, Theory, and Methods 1998 John Wiley & Sons
4. H. Liu, and H. Motoda Feature Extraction, Construction and Selection: A Data Mining Perspective 1998 Springer
5. I.T. Joliffe Principal Component Analysis 1986 Springer-Verlag
6. A.J. Bell, and T.J. Sejnowski An information-maximization approach to blind separation and blind deconvolution Neural Computation 7 6 1995 1129 1159
7. K. Fukunaga Introduction to Statistical Pattern Recognition 2nd ed. 1990 Academic Press
8. M. Turk, and A. Pentland Face recognition using eigenfaces Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 1991 586 591
9. P.N. Belhumeur, J.P. Hespanha, and D.J. Kriegman Eigenfaces vs. fisherfaces: recognition using class specific linear projection IEEE Transactions on Pattern Analysis and Machine Intelligence 19 7 1997 711 720
10. G. Donato, M.S. Bartlett, J.C. Hager, P. Ekman, and T.J. Sejnowski Classifying facial actions IEEE Transactions on Pattern Analysis and Machine Intelligence 21 10 1999 974 989
11. X. Wang, and X. Tang A unified framework for subspace face recognition IEEE Transactions on Pattern Analysis and Machine Intelligence 26 9 2004 40 51
12. D. Xu, S. Yan, D. Tao, S. Lin, and H.J. Zhang Marginal fisher analysis and its variants for human gait recognition and content-based image retrieval IEEE Transactions on Image Processing 16 11 2007 2811 2812
13. T. Okada, and S. Tomita An optimal orthonormal system for discriminant analysis Pattern Recognition 18 2 1985 139 144
14. M. Loog, and R.P.W. Duin Linear dimensionality reduction via a heteroscedastic extension of LDA: the Chernoff criterion IEEE Transactions on Pattern Analysis and Machine Intelligence 26 6 2004 732 739
15. M. Li, and B.Z. Yuan 2d-LDA: a statistical linear discriminant analysis for image matrix Pattern Recognition Letters 26 5 2005 527 532
16. N. Kwak, and C.-H. Choi Feature extraction based on ICA for binary classification problems IEEE Transactions on Knowledge and Data Engineering 15 6 2003 1374 1388
17. S. Weisberg Applied Linear Regression 2nd ed. 1985 John Wiley New York p. 324 (Chapter 3)
18. M. Loog Supervised Dimensionality Reduction and Contextual Pattern Recognition in Medical Image Processing 2004 Ponsen & Looijen Wageningen, The Netherlands (Chapter 3)
19. K.C. Li Sliced inverse regression for dimension reduction (with discussion) Journal of the American Statistical Association 86 1991 316 342
20. K.C. Li On principal hessian directions for data visualization and dimension reduction: another application of Steins lemma Journal of the American Statistical Association 87 1992 1025 1039
21. C.E. Rasmussen, and C.K.I. Williams Gaussian Processes for Machine Learning 1st ed. 2006 The MIT Press
22. N. Kwak, and J.-W. Lee Feature extraction based on subspace methods for regression problems Neurocomputing 73 June 2010 1740 1751
23. N. Kwak, C. Kim, and H. Kim Dimensionality reduction based on ICA for regression problems Neurocomputing 71 August 2008 2596 2603
24. J.B. Tenembaum, V. de Silva, and J.C. Langford A global geometric framework for nonlinear dimensionality reduction Science 290 December 2000 2319 2323
25. S.T. Roweis, and L.K. Saul Nonlinear dimensionality reduction by locally linear embedding Science 290 December 2000 2323 2326
26. M. Belkin, and P. Niyogi Laplacian eigenmaps for dimensionality reduction and data representation Neural Computation 15 6 2003 1373 1396
27. L. Cayton, Algorithms for Manifold Learning, Technical Report, UCSD, 2005.
28. X. He, and P. Niyogi Locality preserving projections S. Thrun, L. Saul, B. Schölkopf, Advances in Neural Information Processing Systems vol. 16 2004 MIT Press Cambridge, MA
29. H. Abdi, Encyclopedia of Measurement and Statistics, Thousand Oaks, 2007, pp. 598605.
30. B. Schölkopf, and A.J. Smola Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond 2002 The MIT Press
31. B. Schölkopf, A.J. Somla, and K.R. Müller Nonlinear component analysis as a kernel eigenvalue problem Neural Computation 10 5 1998 1299 1319
32. S. Mika, G. Ratsch, J. Weston, B. Schölkopf, and K.R. Müller Fisher discriminant analysis with kernels Proceedings of the 1999 IEEE Signal Processing Society Workshop on Neural Networks for Signal Processing vol. IX 1999 41 48
33. G. Baudat, and R. Anouar Generalized discriminant analysis using a kernel approach Neural Computation 12 10 2000 2385 2404
34. R. Rosipal, M. Girolami, and L.J. Trejo Kernel PCA for feature extraction and de-noising in non-linear regression Neural Computing & Applications 10 2001 231 243
35. P. Jain, B. Kulis, and I. Dhillon Inductive regularized learning of kernel function Proceedings of the 24th Annual Conference on Neural Information Processing Systems (NIPS 2010), December 2010
36. S. Yan, D. Xu, B. Zhang, Q. Yang, and S. Lin Graph embedding and extensions: a general framework for dimensionality reduction IEEE Transactions on Pattern Analysis and Machine Intelligence 29 1 2007 40 51
37. P. Vincent, and Y. Bengio Kernel matching pursuit Machine Learning 48 2002 169 191
38. J. Yang, A.F. Frangi, J.-Y. Yang, D. Zhang, and Z. Jin KPCA plus LDA: a complete kernel fisher discriminant framework for feature extraction and recognition IEEE Transactions on Pattern Analysis and Machine Intelligence 27 2 2005 230 244
39. E.A. Narayada On estimating regression Theory of Probability and Its Applications 9 1964 141 142
40. S. Canu, Y. Grandvalet, V. Guigue, A. Rakotomamonjy, SVM and kernel methods Matlab toolbox, Perception Systemes et Information, INSA de Rouen, Rouen, France, 2005.
41. D.J. Newman, S. Hettich, C.L. Blake, C.J. Merz, UCI Repository of Machine Learning Databases, 1998, 〈 http://www.ics.uci.edu/∼mlearn/ MLRepository.html 〉.
42. B.L. Welch Biometrika 34 12 1947 28 35
43. T. Bertin-Mahieux, D.P.W. Ellis, B. Whitman, and P. Lamere The million song dataset Proceedings of the 12th International Society for Music Information Retrieval Conference (ISMIR 2011) 2011
44. M. Meurens, Orange Juice Data, 〈 http://www.dice.ucl.ac.be/mlg/ DataBases/ORANGE-JUICE/ 〉.
45. S. Vijayakumar, A. DSouza, and S. Schaal Incremental online learning in high dimensions Neural Computation 17 12 2005 2602 2634