Evolutionary combination of kernels for nonlinear feature transformation

Information Sciences

Volumn 274, Issue , 2014, Pages 95-107

  Zamani, Behzad ^a   Akbari, Ahmad ^a   Nasersharif, Babak ^a,b  

^a IRAN UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Iran)

^b K N TOOSI UNIVERSITY OF TECHNOLOGY   (Iran)

Author keywords

Genetic algorithm; Genetic programming; Kernel combination; Kernel linear discriminant analysis (KLDA); Kernel principal component analysis (KPCA)

Indexed keywords

FACE RECOGNITION; GENETIC ALGORITHMS; GENETIC PROGRAMMING; MATHEMATICAL TRANSFORMATIONS; PRINCIPAL COMPONENT ANALYSIS;

CLASSIFICATION INFORMATIONS; CLUSTERING VALIDITY INDEX; FEATURE TRANSFORMATIONS; KERNEL COMBINATION; KERNEL LINEAR DISCRIMINANT ANALYSES (KLDA); KERNEL PRINCIPAL COMPONENT; KERNEL PRINCIPAL COMPONENT ANALYSES (KPCA); UNIVERSITY OF CALIFORNIA;

CLASSIFICATION (OF INFORMATION);

EID: 84899994283     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2014.02.140     Document Type: Article

References (43)

1. H. Abbasian, B. Nasersharif, and A. Akbari Class Dependent LDA Optimization Using Genetic Algorithm for Robust MFCC Extraction vol. 6 2008 Springer Berlin, Heidelberg pp. 807-810
2. L.A. Belanche, and A. Tosi Averaging of kernel functions Neurocomputing 112 2013 19 25
3. W. Bing, Z. Wen-qiong, C. Ling, L. Jia-hong, A GP-based kernel construction and optimization method for RVM, in: The 2nd International Conference on Computer and Automation Engineering (ICCAE), vol. 4, 2010, pp. 419-423.
4. C. Blake, E. Keogh, C.J. Merz, UCI Repository of Machine Learning Databases, 1998. < www.ics.uci.edu/mlearn/MLRepository.html >.
5. M. Cuturi, and J.P. Vert A mutual information kernel for sequence IEEE Int. Joint Conf. Neural Netw. 3 2004 1905 1910
6. L. Davie, and D W Bouldin A cluster separation measure IEEE Trans. Pattern Anal. Mach. Intell. 1 4 1979 224 227
7. K. Deb Multi-Objective Optimization using Evolutionary Algorithms 2001 John Wiley & Sons Publication Company
8. R.O. Duda, P.E. Hart, and D.G. Stork Pattern Classification 2001 John Wiley & Sons New York
9. K. Dunn, and J. Dunn Well separated clusters and optimal fuzzy partitions J. Cybern. 4 1974 95 104
10. C. Gagne, M. Schoenauer, M. Sebag, and M. Tomassini Genetic programming for kernel-based learning with co-evolving subsets selection PPSN 4193 2006 1008 1017
11. M. Gonen, and E. Alpaydm Multiple kernel learning algorithms J. Mach. Learn. Res. 12 2011 2211 2268
12. M. Gönen, and E. AlpaydIn Localized algorithms for multiple kernel learning Pattern Recogn. 46 3 2013 795 807
13. M. Halkidi, M. Vazirgiannis, Y. Batistakis, Quality scheme assessment in the clustering process, in: Proceeding the 4th European Conference on Principles of, Data Mining and Knowledge Discovery, 2000, pp. 265-276.
14. T. Howley, and M.G. Madden The genetic kernel support vector machine: description and evaluation Artif. Intell. Rev. 24 2005 379 395
15. M. Jia, H. Xu, X. Liu, and N. Wang The optimization of the kind and parameters of kernel function in KPCA for process monitoring Comput. Chem. Eng. 46 2012 94 104
16. S.J. Kim, A. Zymnis, A. Magnani, K. Koh, S. Boyd, Learning the kernel via convex optimization, in: Proceedings International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2008, pp. 1997-2000.
17. A. Kocsar, Kernel-based Feature Extraction and Speech Technology Applications, PhD Thesis, 2003.
18. A. Kocsor, and L. Toth Kernel-based feature extraction with a speech technology application IEEE Trans. Signal Process. 52 8 2004 2250 2263
19. X.B. Li, J.Y. Li, and R.H. Wang Dimensionality reduction using MCE-optimized LDA transformation IEEE Int. Conf. Acoust. Speech Sig. Process. 2004 137 140
20. J.B. Lia, J. Panb, and S. Chuc Kernel class-wise locality preserving projection Inform. Sci. 178 7 2008 1825 1835
21. J. Liua, F. Zhaob, and Y. Liuc Learning kernel parameters for kernel Fisher discriminant analysis Pattern Recogn. Lett. 34 9 2013 1026 1031
22. M. Loog, and R.P.W. Duin Linear dimensionality reduction via heteroscedastic extension of LDA: the Chernoff criterion IEEE Trans. Pattern Anal. Mach. Intell. 26 6 2004 732 739
23. M. Loog, R.P.W. Duin, and R. Haeb-Umbach Multiclass linear dimension reduction by weighted pairwise Fisher criteria IEEE Trans. Pattern Anal. Mach. Intell. 23 7 2001 762 766
24. G. Lu, and Y. Wang Feature extraction using a fast null space based linear discriminant analysis algorithm Inform. Sci. 193 2012 72 80
25. E.C. Malthouse Limitations of nonlinear PCA as performed with generic neural networks IEEE Trans. Neural Networks 9 1 1998 165 173
26. Y.Y. Meng Parameters selection of hybrid kernel-based on GA Intell. Syst. Appl. 2009 1 4
27. S. Mika, G. Ratsch, J. Weston, B. Scholkopf, K.R. Mullers, Fisher discriminant analysis with kernels, in: IEEE Neural Networks for Signal Processing Workshop, 1999, pp. 41-48.
28. M. Mohammadi, B. Raahemi, A. Akbari, B. Nassersharif, and H. Moeinzadeh Improving linear discriminant analysis with artificial immune system-based evolutionary algorithms Inform. Sci. 189 2012 219 232
29. D.J. Montana Strongly typed genetic programming Evolut. Comput. 1995 199 230
30. A.T. Quang, Q.L. Zhang, and X. Li Evolving support vector machine parameters Proc. First Int. Conf. Mach. Learn. Cybern. 2002 548 551
31. S.A. Rojas, and D. Fernandez-Reyes Adapting multiple kernel parameters for support vector machines using genetic algorithms Proc. IEEE Congr. Evolut. Comput. 1 2005 626 631
32. B. Schölkopf, R. Herbrich, A.J. Smola, A generalized representer theorem, in: Proceedings of the 14th Annual Conference on Computational Learning Theory and 5th European Conference on Computational Learning Theory, 2001, pp. 416-426.
33. J. Shawe-Taylor, and N. Cristianini Kernel Methods for Pattern Analysis 2004 Cambridge University
34. K. Sullivan, S. Luke, Evolving kernels for support vector machine classification, in: Annual Conference Companion on Genetic and Evolutionary Computation Conference (GECCO), 2007, pp. 1702-1707.
35. T. Takiguchi, Y.A. Loog, Robust feature extraction using kernel PCA, in: IEEE International Conference on Acoustics, Speech, Signal Processing, 2006, pp. 509-512.
36. M. Wang, X.S. Hua, T. Mei, R. Hong, G. Qi, Y. Song, and L.R. Dai Semi-supervised kernel density estimation for video annotation Comput. Vis. Image Underst. 113 3 2009 384 396
37. X. Wang, and K.K. Paliwal Feature extraction and dimensionality reduction algorithms and their applications in vowel recognition Pattern Recogn. 36 10 2003 2429 2439
38. D. Yeung, H. Chang, and G. Dai Learning the kernel matrix by maximizing a KFD-based class separability criterion Pattern Recogn. 40 7 2007 2021 2028
39. S. Yoshizawa, N. Hayasaka, N. Wada, Y. Miyanaga, Cepstral gain normalization for noise robust speech recognition, in IEEE International Conference on Acoustics, Speech, Signal Processing, 2004, pp. 209-212.
40. B. Zamani, A. Akbari, B. Nasersharif, and A. Jalalvand Optimized discriminative transformations for speech features based on minimum classification error Pattern Recogn. Lett. 32 7 2011 948 955
41. B. Zamani, A. Akbari, B. Nasersharif, M. Mohammadi, and A. Jalalvand Discriminative transformation for speech features based on genetic algorithm and HMM likelihoods IEICE Electron. Exp. 7 4 2010 247 253
42. J. Zhuang, J. Wang, S.C.H. Hoi, and X. Lan Unsupervised multiple kernel learning J. Mach. Learn. Res.: Workshop Conf. Proc. 20 2011 129 144
43. S. Zhonga, D. Chena, Q. Xua, and T. Chena Optimizing the Gaussian kernel function with the formulated kernel target alignment criterion for two-class pattern classification Pattern Recogn. 46 7 2013 2045 2054