Optimizing the data-dependent kernel under a unified kernel optimization framework

Pattern Recognition

Volumn 41, Issue 6, 2008, Pages 2107-2119

  Chen, Bo ^a   Liu, Hongwei ^a   Bao, Zheng ^a  

^a XIDIAN UNIVERSITY   (China)

Author keywords

Fisher criteria; Kernel induced feature space; Kernel machine; Kernel optimization

Indexed keywords

CLUSTER ANALYSIS; COVARIANCE MATRIX; FEATURE EXTRACTION; OPTIMIZATION; PROBLEM SOLVING;

KERNEL INDUCED FEATURE SPACE; KERNEL MACHINE;

DATA ACQUISITION;

EID: 38849204864     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2007.10.006     Document Type: Article

References (40)

1. Cristianini N., and Shawe-Taylor J. An Introduction to Support Vector Machines (2000), Cambridge University Press, Cambridge
2. Scholkopf B., and Smola A.J. Learning with Kernels (2002), MIT Press, Cambridge, MA
3. Vapnik V. Statistical Learning Theory (1998), Wiley, New York
4. Chapelle O., Vapnik V., Bousquet O., and Mukherjee S. Choosing multiple parameters for support vector machines. Mach. Learn. 46 1 (2002) 131-159
5. Kwok J.T. The evidence framework applied to support vector machines. IEEE Trans. Neural Networks 11 5 (2000) 1162-1173
6. Sollich P. Bayesian methods for support vector machines: evidence and predictive class probabilities. Mach. Learn. 46 1-3 (2002) 21-52
7. Lee M.M.S., Keerthi S.S., Ong C.J., and DeCoste D. An efficient method for computing leave-one-out error in support vector machines with Gaussian kernels. IEEE Trans. Neural Networks 15 3 (2004) 750-757
8. Zhang D., Chen S., and Zhou Z.-H. Learning the kernel parameters in kernel minimum distance classifier. Pattern Recognition 39 1 (2006) 133-135
9. Cristianini N., Kandola J., Elisseeff A., and Shawe-Taylor J. On kernel target alignment. Advances in Neural Information Processing Systems (NIPS'01) (2001), MIT Press, Cambridge, MA 367-373
10. Lanckriet G., Cristianini N., Bartlett P., Ghaoui L.E., and Jordan M.I. Learning the kernel matrix with semidefinite programming. J. Mach. Learn. Res. 5 (2004) 27-72
11. Bousquet O., and Herrmann D. On the complexity of learning the kernel matrix. Advances in Neural Information Processing Systems (NIPS'03) (2003), MIT Press, Cambridge, MA
12. Ong C.S., Smola A.J., and Williamson R.C. Learning the kernel with hyperkernels. J. Mach. Learn. Res. 3 (2003) 1001-1030
13. Crammer K., Keshet J., and Singer Y. Kernel design using boosting. Advances in Neural Information Processing Systems (NIPS'03) (2003), MIT Press, Cambridge, MA
14. Hertz T., Hillel A.B., and Weinshall D. Learning a kernel function for classification with small training samples. Proceedings of the International Conference on Machine Learning (2006), Pittsburgh, PA, USA
15. Kwok J.T., and Tsang I.W. Learning with idealized kernels. Proceedings of the International Conference on Machine Learning (2003), Washington DC, USA
16. Amari S., and Wu S. Improving support vector machine classifiers by modifying kernel functions. Neural Networks 12 6 (1999) 783-789
17. Xiong H.L., Swamy M.N.S., and Omair Ahmad M. Optimizing the kernel in the empirical feature space. IEEE Trans. Neural Networks 16 2 (2005) 460-474
18. Fukunaga K. Introduction to Statistical Pattern Recognition (1990), Academic Press, San Diego
19. Sugiyama M. Local Fisher discriminant analysis for supervised dimensionality reduction. Proceedings of the International Conference on Machine Learning (2006), Pittsburgh, PA
20. Zhu M., and Martinez A.M. Subclass discriminant analysis. IEEE Trans. Pattern Anal. Mach. Intell. 28 8 (2006) 1274-1286
21. Yan S., Xu D., Zhang B., Zhang H., Yang Q., and Lin S. Graph embedding and extensions: a general framework for dimensionality reduction. IEEE Trans. Pattern Anal. Mach. Intell. 29 1 (2007) 40-51
22. Chen B., Liu H., and Bao Z. A kernel optimization method based on the localized kernel Fisher criterion. Pattern Recognition 41 3 (2008) 1098-1109
23. Xiong H.L., and Chen X.-w. Kernel-based distance metric learning for microarray data classification. BMC Bioinformatics 7 (2006) 299
24. C. Blake, E. Keogh, C.J. Merz, UCI Repository of Machine Learning Databases, Department of Information and Computer Science, University of California, Irvine, CA, 1998 [Online], available from〈http://www.ics.uci.edu/mlearn〉.
25. D. Michie, D.J. Spiegelhalter, C.C. Taylor (Eds.), Machine Learning, Neural and Statistical Classification, Ellis Horwood, 1994, data sets available from 〈http://www.liacc.up.pt/ML/statlog/datasets.html〉.
26. S. Roweis, Finding the first few eigenvectors in a large space, Individual Research Note, available from 〈http://www.cs.toronto.edu/∼roweis/〉 .
27. Dai J., Yan S., Tang X., and Kwok J.T. Locally adaptive classification piloted by uncertainty. Proceedings of the International Conference on Machine Learning (2006), Pittsburgh, PA
28. Du L., Liu H., Bao Z., and Xing M. Radar HRRP target recognition based on higher order spectra. IEEE Trans. Signal Process. 53 7 (2005) 2359-2368
29. Du L., Liu H., Bao Z., and Zhang J. A two-distribution compounded statistical model for radar HRRP target recognition. IEEE Trans. Signal Process. 54 6 (2006) 2226-2238
30. Pei B., and Bao Z. Bispectrum based approach to high radar range profile for automatic target recognition. Pattern Recognition 35 11 (2002) 2643-2651
31. Mengdao X., Zheng B., and Pei B. Properties of high-resolution range profiles. Opt. Eng. 41 2 (2002) 493-504
32. H. Liu, Z. Bao, Radar HRR profiles recognition based on SVM with power-transformed-correlation kernel, Lecture Notes in Computer Science, vol. 3174, no. (I), 2004, pp. 531-536.
33. Heiden R., and Groen F.C.A. The Box-Cox metric for nearest neighbor classification improvement. Pattern Recognition 30 (1997) 273-279
34. Loog M., and Duin R.P.W. Linear dimensionality reduction via a heteroscedastic extension of LDA: the Chernoff criterion. IEEE Trans. Pattern Anal. Mach. Intelli. 26 6 (2004) 732-739
35. G. Dai, D.-Y. Yeung, H. Chang, Extending kernel Fisher discriminant analysis with the weighted pairwise Chernoff criterion, in: Proceedings of ECCV 2006, Springer, Berlin, Heidelberg, 2006, pp. 308-320.
36. Joliffe I. Principal Component Analysis (1986), Springer, Berlin
37. He X., Yan S., Hu Y., Niyogi P., and Zhang H. Face recognition using laplacianfaces. IEEE Trans. Pattern Anal. Mach. Intell. 27 3 (2005) 328-340
38. Tenenbaum J., Silva V., and Langford J. A global geometric framework for nonlinear dimensionality reduction. Science 290 22 (2000) 2319-2323
39. Roweis S., and Saul L. Nonlinear dimensionality reduction by locally linear embedding. Science 290 22 (2000) 2323-2326
40. Yang J., Zhang D., Yang J.-y., and Niu B. Globally maximizing, locally minimizing: unsupervised discriminant projection with applications to face and palm biometrics. IEEE Trans. Pattern Anal. Mach. Intell. 29 4 (2007) 650-664