Feature vector selection and projection using kernels

Neurocomputing

Volumn 55, Issue 1-2, 2003, Pages 21-38

  Baudat, Gaston ^a   Anouar, Fatiha ^a  

^a MEI   (United States)

Author keywords

Data selection; Discriminant analysis; Feature space; Kernel methods; Principal component analysis

Indexed keywords

ALGORITHMS; APPROXIMATION THEORY; COMPUTATIONAL COMPLEXITY; MATHEMATICAL MODELS; PRINCIPAL COMPONENT ANALYSIS; REGRESSION ANALYSIS; SET THEORY;

KERNEL METHODS;

NEURAL NETWORKS;

ALGORITHM; ARTICLE; CLASSIFICATION; CONTROLLED STUDY; DISCRIMINANT ANALYSIS; INFORMATION PROCESSING; LEARNING; MATHEMATICAL ANALYSIS; MATHEMATICAL MODEL; METHODOLOGY; PRINCIPAL COMPONENT ANALYSIS; PRIORITY JOURNAL; REGRESSION ANALYSIS;

EID: 0242383468     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0925-2312(03)00429-6     Document Type: Article

References (25)

1. M.A. Aizerman, E.M. Braverman, L.I. Rozonocer, Theoretical foundations of the potential function method in pattern recognition learning, Automat. Remote Control 25 (1964) 821-837.
2. A. Albert, Regression and the Moore-Penrose Pseudo-Inverse, Academic Press, New York, 1972.
3. F. Anouar, F. Badran, S. Thiria, Probabilistic self organizing map and radial basis function, J. Neurocomput. 20 (1998) 83-96.
4. G. Baudat, F. Anouar, Generalized discriminant analysis using a kernel approach, Neural Comput. 12 (2000) 2385-2404.
5. G. Baudat, F. Anouar, Kernel based methods and function approximation, International Joint Conference on Neural Network, IJCNN 2001, Washington, DC, pp. 1244-1249.
6. B.E. Boser, I.M. Guyon, V.N. Vapnik, A training algorithm for optimal margin classifiers, in: D. Haussler (Ed.), Fifth Annual ACM Workshop on COLT, Pittsburgh, PA, ACM Press, New York, 1992, pp. 144-152.
7. C.J.C. Burges, A tutorial on support vector machine for pattern recognition, support vector web page, http://svm.first.gmd.de, 1998.
8. C.J.C. Burges, B. Schölkopf, Improving the accuracy and speed of support vector machines, in: Neural Information Processing Systems, Vol. 9, MIT Press, Cambridge, MA, 1997.
9. R.O. Duda, P.E. Hart, Pattern Classification and Scene Analysis, Wiley, New York, 1973.
10. K. Fukunaga, Introduction to Statistical Pattern Recognition, 2nd Edition, Academic Press, New York, 1990.
11. IDA Benchmark repository, http://ida.first.gmd.de/~raetsch/data/benchmarks.htm.
12. J. Mercer, Functions of positive and negative type and their connection with the theory of integral equations, Philos. Trans. Roy. Soc. London A 209 (1909) 415-446.
13. S. Mika, G. Rätsch, J. Weston, B. Schölkopf, K.R. Muller, Fisher discriminant analysis with kernels, in: Y.-H. Hu, J. Larsen, E. Wilson, S. Douglas (Eds.), Neural Networks for Signal Processing IX, IEEE, New York, 1999, pp. 41-48.
14. K.R. Müller, S. Mika, G. Rätsch, K. Tsuda, B. Schölkopf, An introduction to kernel-based learning algorithms, IEEE Trans. Neural Networks 12 (2) (2001) 181-201.
15. T. Poggio, On optimal nonlinear associative recall, Biol. Cybernet. 19 (1975) 201-209.
16. L.L. Scharf, Statistical Signal Processing: Detection, Estimation and Times Series Analysis, Addison-Wesley, Reading, MA, 1991.
17. B. Schölkopf, S. Mika, C.J.C. Burges, P. Knirsch, K.R. Müller, A.J. Smola, Input space vs. feature space in kernel-based methods, IEEE Trans. Neural Networks 10 (5) (1999) 1000-1017.
18. A.J. Smola, B. Schölkopf, Sparse greedy matrix approximation for machine learning, International Conference on Machine Learning, ICML 2000, Stanford, CA, 2000.
19. B. Schölkopf, A.J. Smola, K.R. Müller, Nonlinear component analysis as a kernel eigenvalue problem, Neural Comput. 10 (1998) 1299-1319.
20. B. Schölkopf, A.J. Smola, Learning with Kernels, MIT Press, Cambridge, MA, 2002, pp. 443-445.
21. A.J. Smola, B. Schölkopf, Sparse greedy matrix approximation for machine learning, in: International Conference on Machine Learning, 2000.
22. M.E. Tipping, The relevance vector machine, in: S.A. Solla, T.K. Leen, K.-R. Müller (Eds.), Advances in Neural Information Processing System, Vol. 12, MIT Press, Cambridge, MA, 2000.
23. V. Vapnik, The Nature of Statistical Learning Theory, Springer, Berlin, 1995.
24. V. Vapnik, Three remarks on support vector method of function estimation, in: B. Schölkopf, C.J.C. Burges, A.J. Smola (Eds.), Advances in Kernel Methods, MIT Press, Cambridge, MA, 2000.
25. V. Vapnik, S.E. Golowich, A. Smola, Support vector method for function approximation, regression estimation, and signal processing, in: Neural Information Processing Systems, Vol. 9, MIT Press, Cambridge, MA, 1997.