Learning the kernel matrix in discriminant analysis via quadratically constrained quadratic programming

Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining

Volumn , Issue , 2007, Pages 854-863

  Ye, Jieping ^a   Ji, Shuiwang ^a   Chen, Jianhui ^a  

^a ARIZONA STATE UNIVERSITY   (United States)

Author keywords

Convex optimization; Kernel discriminant analysis; Kernel learning; Model selection; Quadratically constrained quadratic programming

Indexed keywords

CONVEX OPTIMIZATION; KERNEL DISCRIMINANT ANALYSIS; KERNEL LEARNING; MODEL SELECTION; QUADRATICALLY CONSTRAINED QUADRATIC PROGRAMMING;

DATA STRUCTURES; LEARNING SYSTEMS; MATRIX ALGEBRA; PROBLEM SOLVING;

QUADRATIC PROGRAMMING;

EID: 36849008168     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1281192.1281283     Document Type: Conference Paper

References (30)

1. E. D. Andersen and K. D. Andersen. The MOSEK interior point optimizer for linear programming: an implementation of the homogeneous algorithm. In T. T. H. Frenk, K. Roos and S. Zhang, editors, High Performance Optimization, pages 197-232. Kluwer Academic Publishers, 2000.
2. A. Argyriou, R. Hauser, C. Micchelli, and M. Pontil. A DC-programming algorithm for kernel selection. In Proceedings of the International Conference on Machine Learning, pages 41-48, 2006.
3. F. R. Bach, G. R. G. Lanckriet, and M. I. Jordan. Multiple kernel learning, conic duality, and the SMO algorithm. In Proceedings of the International Conference on Machine Learning, 2004.
4. S. Boyd and L. Vandenberghe. Convex Optimization. Cambridge University Press, 2004.
5. N. Cristianini and J. Taylor. An Introduction to Support Vector Machines and other Kernel-based Learning Methods. Cambridge University Press, 2000.
6. G. Fung, M. Dundar, J. Bi, and B. Rao. A fast iterative algorithm for Fisher discriminant using heterogeneous kernels. In Proceedings of the International Conference on Machine Learning, 2004.
7. G. H. Golub and C. F. Van Loan. Matrix Computations. The Johns Hopkins University Press, third edition, 1996.
8. J. J. Hull. A database for handwritten text recognition research. IEEE Trans. Pattern Analysis Machine Intelligence, 16(5):550-554, 1994.
9. T. Jebara. Multi-task feature and kernel selection for SVMs. In Proceedings of the International Conference on Machine Learning, 2004.
10. S.-J. Kim, A. Magnani, and S. Boyd. Optimal kernel selection in kernel Fisher discriminant analysis. In Proceedings of the International Conference on Machine Learning, pages 465-472, 2006.
11. G. Lanckriet, T. D. Bie, N. Cristianini, M. Jordan, and W. Noble. A statistical framework for genomic data fusion. Bioinformatics, 20(16):2626-2635, 2004.
12. G. Lanckriet, N. Cristianini, P. Bartlett, L. E. Ghaoui, and M. I. Jordan. Learning the kernel matrix with semidefinite programming. Journal of Machine Learning Research, 5:27-72, 2004.
13. D. Lewis, T. Jebara, and W. S. Noble. Nonstationary kernel combination. In Proceedings of the International Conference on Machine Learning, pages 553-560, 2006.
14. M. S. Lobo, L. Vandenberghe, S. Boyd, and H. Lebret. Applications of second-order cone programming. Linear Algebra and its Applications, 284:193-228, 1998.
15. S. Mika. Kernel Fisher Discriminants. PhD thesis, University of Technology, Berlin, Oct. 2002.
16. S. Mika, G. Ratsch, and K.-R,. Müller. A mathematical programming approach to the kernel fisher algorithm. In T. K. Leen, T. G. Dietterich, and V. Tresp, editors, Proceedings of the Annual Conference on Neural Information Processing Systems, pages 591-597. MIT Press, 2001.
17. S. Mika, G. Rätsch, J. Weston, B. Schölkopf, and K.-R. Müller. Fisher discriminant analysis with kernels. In Y.-H. Hu, J. Larsen, E. Wilson, and S. Douglas, editors, Neural Networks for Signal Processing IX, pages 41-48. IEEE, 1999.
18. Y. Nesterov and A. Nemirovskii. Interior-point polynomial algorithms in convex programming. SIAM Studies in Applied Mathematics. SIAM, 1994.
19. D. Newman, S. Hettich, C. Blake, and C. Merz. UCI repository of machine learning databases, 1998.
20. J. C. Platt. Fast training of support vector machines using sequential minimal optimization. In Advances in kernel methods: support vector learning, pages 185-208. MIT Press, Cambridge, MA, USA, 1999.
21. S. Schölkopf and A. Smola. Learning with Kernels: Support Vector Machines, Regularization, Optimization and Beyond. MIT Press, 2002.
22. J. Shawe-Taylor and N. Cristianini. Kernel Methods for Pattern Analysis. Cambridge University Press, 2004.
23. S. Sonnenburg, G. Rätsch, C. Schäfer, and B. Schölkopf. Large Scale Multiple Kernel Learning. Journal of Machine Learning Research, 7:1531-1565, July 2006.
24. J. F. Sturm. Using SeDuMi 1.02, a MATLAB toolbox for optimization over symmetric cones. Optimization Methods and Software, 11-12:625-653, 1999.
25. L. Vandenberghe and S. Boyd. Semidefinite programming. SIAM Review, 38:49-95, 1996.
26. V. Vapnik. Statistical learning theory. Wiley, New York, 1998.
27. J. Ye. Characterization of a family of algorithms for generalized discriminant analysis on undersampled problems. Journal of Machine Learning Research, 6:483-502, 2005.
28. J. Ye, J. Chen, and S. Ji. Discriminant kernel and regularization parameter learning via semidefinite programming. In Proceedings of the International Conference on Machine Learning, 2007.
29. J. Ye, J. Chen, Q. Li, and S. Kumar. Classification of drosophila embryonic developmental stage range based on gene expression pattern images. In Proceedings of the Computational Systems Bioinformatics Conference, pages 293-298, 2006.
30. A. Zien and C. Ong. Multiclass multiple kernel learning. In Proceedings of the International Conference on Machine Learning, 2007.