A review of kernel Fisher discriminant analysis for statistical classification

South African Statistical Journal

Volumn 39, Issue 1, 2005, Pages 1-21

  Louw, N ^a   Steel, S J ^a  

^a STELLENBOSCH UNIVERSITY   (South Africa)

Author keywords

Feature space; Generalization error; Input space; Kernel methods; Linear discriminant analysis

Indexed keywords

EID: 20444485094     PISSN: 0038271X     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (20)

1. BOSER, B.E., GUYON, I.M. and VAPNIK, V.N. (1992). A training algorithm for optimal margin classifiers. In D. Haussier (Ed.), 5th Annual ACM Workshop on COLT. Pittsburg, PA, ACM Press.
2. CRISTIANINI, N., KANDOLA, J., ELISSEEFF, A. and SHAWE-TAYLOR, J. (2002). On kernel-target alignment. In T. Dietterich, S. Becker and D. Cohn, (Eds.), Advances in Neural Information Processing Systems, 14, MIT Press, Cambridge.
3. GRANDVALET, Y. and CANU, S. (2003). Adaptive scaling for feature selection in SVMs. Advances in Neural Information Processing Systems, 15, MIT Press, London.
4. HARMSEN, J.J. and PEARLMAN, W.A. (2003). Steganalysis of additive noise modelable information hiding. In B. Vasudev, T. R. Hsing, A.G. Tescher, T. Ebrahimi, (Eds.), Proceedings of SPIE/IS&T Electronic Imaging, 5022, IS&T, Santa Clara, California.
5. HASTIE, T., TIBSHIRANI, R. and FRIEDMAN, J. (2001). The elements of statistical learning: data mining, inference, and prediction. Springer, New York.
6. HERBRICH, R. (2001). Learning kernel classifiers. MIT Press, London.
7. KROON, S. and OMLIN, C.W. (2004a). Getting to grips with support vector machines: theory. Accepted for publication in the South African Statistical Journal.
8. KROON, S. and OMLIN, C.W. (2004b). Getting to grips with support vector machines: application. Accepted for publication in the South African Statistical Journal.
9. LIU, Q., LU, H. and MA, S. (2004). Improving kernel Fisher discriminant analysis for face recognition. IEEE Transactions on Circuits and Systems for Video Technology, 14, 42-49.
10. MIKA, S., RÄTSCH, G., WESTON, J., SCHÖLKOPF, B. and MÜLLER, K.-R. (1999). Fisher discriminant analysis with kernels. In Y.-H. Hu, J. Larsen, E. Wilson and S. Douglas (Eds.), Neural Networks for Signal Processing, IX, 41-48, IEEE Press, New York.
11. MIKA, S., RÄTSCH, G. and MÜLLER, K.-R. (2001). A mathematical programming approach to the kernel Fisher algorithm. In T.K. Leen, T.G. Dietterich and V. Tresp (Eds.), Advances in Neural Information Processing Systems, 13, 591-597, MIT Press, London.
12. PELCKMANS, K., SUYKENS, J.A.K. and DE MOOR, B. (2004). Regularization constants in LS-SVMs: a fast estimate via convex optimization. Accepted for publication in the Proceedings of the International Joint Conference on Neural Networks.
13. R: Software developed as part of the R Project for Statistical Computing. Available from the website http://www.r-project.org/
14. SCHÖLKOPF, B. and SMOLA, A.J. (2002). Learning with kernels: support vector machines, regularization, optimization, and beyond. MIT Press, London.
15. SHAWE-TAYLOR, J. and CRISTIANINI, N. (2004). Kernel methods for pattern analysis. Cambridge University Press, Cambridge.
16. STEEL, S.J. and LOUW, N. (2004). Simple and fast model selection for the Gaussian kernel. Submitted for publication to Neurocomputing.
17. SUYKENS, J.A.K., VAN GESTEL, T., DE BRABANTER, J., DE MOOR, B. and VANDEWALLE, J. (2002). Least squares support vector machines. World Scientific Press, London.
18. SUYKENS, J.A.K., DE MOOR, B. and VANDEWALLE, J. (2004). LS-SVMlab: a toolbox for least squares support vector machines. http://www.esat.kuleuven.ac.be/sista/lssvmlab.
19. VAN GESTEL, T., SUYKENS, J.A.K., LANCKRIET, G., LAMBRECHTS, A., DE MOOR, B. and VANDEWALLE, J. (2002). Bayesian framework for least squares support vector machine classifiers, Gaussian processes and kernel Fisher discriminant analysis. Neural Computation, 14, 1115-1147.
20. VAN GESTEL, T., SUYKENS, J.A.K., BAESENS, B., VIAENE, S., VANTHIENEN, J., DEDENE, G., DE MOOR, B. and VANDEWALLE, J. (2004). Benchmarking least squares support vector machine classifiers. Machine Learning, 54, 5-32.