Optimizing the Gaussian kernel function with the formulated kernel target alignment criterion for two-class pattern classification

Pattern Recognition

Volumn 46, Issue 7, 2013, Pages 2045-2054

  Zhong, Shangping ^a,b   Chen, Daya ^a   Xu, Qiaofen ^a   Chen, Tianshun ^a  

^a FUZHOU UNIVERSITY   (China)

^b INSTITUTE OF COMPUTING TECHNOLOGY   (China)

Author keywords

Determined global minimum point; Euler Maclaurin formula; Fast kernel learning method; Formulated kernel target alignment criterion; Gaussian kernel function; High time efficiency; Two class pattern classification

Indexed keywords

EULER-MACLAURIN FORMULA; GAUSSIAN KERNEL FUNCTIONS; GLOBAL MINIMA; HIGH TIME EFFICIENCY; KERNEL LEARNING METHODS; KERNEL TARGET ALIGNMENT;

ALIGNMENT; APPROXIMATION ALGORITHMS; GAUSSIAN DISTRIBUTION; LEARNING ALGORITHMS; OPTIMIZATION;

CLASSIFICATION (OF INFORMATION);

EID: 84875243866     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2012.12.012     Document Type: Article

References (35)

1. N. Cristianini, and J. Shawe-Taylor An Introduction to Support Vector Machines, Cambridge 2000 Cambridge Univ. Press U.K
2. Sebastian Klaus-Robert Müller, Gunnar Mika, Koji Rätsch, Tsuda, and Bernhard Schölkopf An introduction to kernel-based learning algorithms IEEE Transactions on Neural Networks 12 2 2001 181 201
3. Alexander Bernhard Schölkopf, Smola, and Klaus-Robert Müller Nonlinear component analysis as a kernel eigenvalue problem Neural Computation 10 1999 1299 1319
4. J. Shawe-Taylor, and N. Cristianini Kernel Methods for Pattern Analysis 2004 Cambridge University Press New York, NY, USA
5. H. Xiong, M.N.S. Swamy, and M. Omair Optimizing the kernel in the empirical feature space IEEE Transactions on Neural Networks 16 2 2005 460 474
6. M. Stone Cross-validatory choice and assessment of statistical predictors Journal of the Royal Statistical Society B36 1974 111 147
7. G.R.G. Lanckriet, N. Cristianini, P. Bartlett, L.E. Ghaoui, and M.I. Jordan Learning the kernel matrix with semidefinite programming Journal of Machine Learning Research 5 2004 27 72
8. N.Cristianini, J.Kandola, A.Elissee, J.Shawe-Taylor, On kernel target alignment, in:Proceedings of the Neural Information Processing Systems, 2001, pp. 367-373.
9. Jie Wang, Haiping Lu, K.N. Plataniotis, and Juwei Lu Gaussian kernel optimization for pattern classification Pattern Recognition 42 7 2009 1237 1247
10. T. Glasmachers, and C. Igel Gradient-based adaptation of general gaussian kernels Neural Computation 17 10 2005 2099 2105
11. K. Fukunaga Introduction to Statistical Pattern Recognition second ed. 1990 Academic Press Boston
12. P.N. Belhumeur, J.P. Hespanha, and D.J. Kriegman Eigenfaces vs. Fisherfaces: recognition using class specific linear projection IEEE Transactions on Pattern Analysis and Machine Intelligence 19 7 1997 711 720
13. A.M. Martinez, and M. Zhu Where are linear feature extraction methods applicable? IEEE Transactions on Pattern Analysis and Machine Intelligence 27 12 2005 1934 1944
14. M.Ehsan Abbasnejad, Dhanesh Ramachandram, and Rajeswari Mandava A survey of the state of the art in learning the kernels Knowledge and Information Systems 31 2 2012 193 221
15. C. Nguyen, T. Ho, Kernel matrix evaluation, In: Proceedings of the 20th International Joint Conference on Artificial Intelligence, 2007, pp. 6-12.
16. Christoph Julia Neumann Schnorr,Gabriele Steidl, Combined svm-based feature selection and classification Machine Learning 61 2005 129 150
17. V.S. Vardarajan Euler and his work on infinite series Bulltin(New Series)of the American Mathematical Socity 4 4 2007 515 539
18. Ed Sandifer, Euler's solution of the Basel problem-the longer story, 〈http://www.wcsu.ctstateu.edu〉 /∼Sandifer, 2011.
19. Ed Sandifer, Divergent series- how Euler do it, 〈http://www.maa.org/ editorial/euler/How%20Euler%20Did%20It%2032%20divergent%20series.pdf〉, 2011.
20. Nello John Shawe-Taylor Cristianini, Kernel Methods for Pattern Analysis 2004 Cambridge University Press
21. R. Tyrrell Rockafellar,Convex Analysis 2011 Princeton University Press
22. S. Boyd, and L. Vandenberghe Convex Optimization 2004 Cambridge University Press
23. R. Fletcher, Pratical Methods of Optimization,second ed., John Wiley and Sons, Inc.,1987.
24. David Newman, Arthur Asuncion, (2012) UCI Machine Learning Repository, University of Massachusetts Amherst, 〈http://archive.ics.uci.edu/ml〉 datasets.html.
25. Delve, (2012) Delve Datasets, 〈http://www.cs.toronto.edu/~delve/ data/datasets.html〉,2012.
26. Chih-Jen Lin, (2012) LIBSVM Data: Classification, Regression, and Multi-label, 〈http://www.csie.ntu.edu.tw/~cjlin/libsvmtools/datasets〉.
27. Chih-Chung Chang, Chih-Jen Lin, (2012) LIBSVM-A Library for Support Vector Machines, 〈http://www.csie.ntu.edu.tw/~cjlin/libsvm〉.
28. J. Lu, K.N. Plataniotis, and A.N. Venetsanopoulos Face recognition using kernel direct discriminant analysis algorithms IEEE Transactions on Neural Networks 14 1 2003 117 126
29. G. Baudat, and F. Anouar Generalized discriminant analysis using a kernel approach Neural Computation 12 2000 2385 2404
30. S. Theodoridis, and K. Koutronumbas Pattern Recognition 2006 Elsevier(Singapore) Pte Ltd.
31. N. Le, K.P. Dabke, and G.K. Egan The hyperbolic kernel for time-frequency power spectrum Optical Engineering 42 8 2003 2400 2415
32. N. Le, K.P. Dabke, and G.K. Egan On mathematical derivations of auto-term functions and signal-to-noise ratios of Choi-Williams, first- and nth-order hyperbolic kernels Digital Signal Processing 16 1 2006 84 104
33. N. Khoa, and Le Lower-bound on SNR of the nth-order hyperbolic time-frequency kernel Journal of Sound and Vibration 321 1 2009 405 415
34. N. Le A mathematical approach to edge detection in hyperbolic-distributed and Gaussian-distributed pixel-intensity images using hyperbolic and Gaussian masks Digital Signal Processing 21 1 2011 162 181
35. N. Le, K.P. Dabke, and G.K. Egan Hyperbolic wavelet family Review of Scientific Instruments 75 11 2004 4678 4693