Learning translation invariant kernels for classification

Journal of Machine Learning Research

Volumn 11, Issue , 2010, Pages 1353-1390

  Ghiasi Shirazi, Kamaledin ^a   Safabakhsh, Reza ^a   Shamsi, Mostafa ^a  

^a AMIRKABIR UNIVERSITY OF TECHNOLOGY   (Iran)

Author keywords

Capacity control; Classification; Kernel learning; Semi infinite programming; Support vector machines; Translation invariant kernels

Indexed keywords

BENCHMARK DATA; BINARY CLASSIFICATION; CAPACITY CONTROL; CLASS-BASED; CONSTRAINED QUADRATIC PROGRAMMING; COSINE FUNCTIONS; DATA SETS; DIGIT RECOGNITION; FEATURE SPACE; FINITE MIXTURES; FUNCTIONAL FORMULATION; GAUSSIAN KERNELS; KERNEL FUNCTION; KERNEL LEARNING; KERNEL MATRICES; KERNEL METHODS; KERNEL TRICK; LARGE-SCALE PROBLEM; LEARNING CAPACITY; LEARNING PROCESS; OPTIMAL CLASSIFIERS; REAL-WORLD; RUNTIMES; SEMI INFINITE PROGRAMMING; SUB-PROBLEMS; SUPPORT VECTOR; TRANSLATION INVARIANTS;

FEATURE EXTRACTION; OPTIMIZATION; QUADRATIC PROGRAMMING; SUPPORT VECTOR MACHINES;

PROGRAM TRANSLATORS;

EID: 77951970597     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Article

References (47)

1. S. Amari and S. Wu. Improving support vector machine classifiers by modifying kernel functions. Neural Networks, 12 (6): 783-789, 1999.
2. E.D. Andersen and K.D. Andersen. The MOSEK interior point optimizer for linear programming: an implementation of the homogeneous algorithm. In T. Terlaky H. Frenk, K. Roos and S. Zhang, editors, High Performance Optimization, pages 197-232. Kluwer Academic Publishers, 2000.
3. A. Argyriou, C.A. Micchelli, and M. Pontil. Learning convex combinations of continuously parameterized basic kernels. In Proceedings of the 18th Conference on Learning Theory, volume 18, pages 338-352, 2005.
4. rd International Conference on Machine Learning, volume 23, pages 338-352, Pittsburgh, PA, 2006.
5. F.R. Bach, G.R.G. Lanckriet, and M.I. Jordan. Multiple kernel learning, conic duality, and the SMO algorithm. In Proceedings of the 21st International Conference on Machine Learning, volume 21, pages 41-48, Banff, Canada, 2004. Omnipress.
6. S. Bochner. Monotone functions, Stieltjessche integrale und harmonische analyse. Mathematische Annalen, 108: 378-410, 1933.
7. S. Bochner. Harmonie Analysis and the Theory of Probability. University of California Press, Los Angeles, California, 1955.
8. S. Boyd and L. Vandenberghe. Convex Optimization. Cambridge University Press, Cambridge, UK, 2004.
9. O. Chapelle, V. Vapnik, O. Bousquet, and S. Mukherjee. Choosing multiple parameters for support vector machines. Machine Learning, 46 (1-3): 131-159, 2002.
10. D.J. Crisp and C.J.C. Burges. A geometric interpretation of v-svm classifiers. In Advances in Neural Information Processing Systems, volume 12, pages 244-250, Cambridge, MA.; 1999. MIT Press.
11. N. Cristianini and J. Shawe-Taylor. An Introduction to Support Vector Machines. Cambridge University Press, 2000.
12. Nello Cristianini, Colin Campbell, and John Shawe-taylor. Dynamically adapting kernels in support vector machines. In Advances in Neural Information Processing Systems 11, pages 204-210. MIT Press, 1998.
13. E Cucker and D.X. Zhou. Learning Theory: An Approximation Theory Viewpoint. Cambridge University Press, Cambridge, UK, 2007.
14. J. M. Danskin. The theory of max-min, with applications. SIAM Journal on Applied Mathematics, 14 (4): 641-664, 1966.
15. P. V. Gehler and S. Nowozin. Infinite kernel learning. In Proceedings of the NIPS 2008 Workshop on "Kernel Learning: Automatic Selection of Optimal Kernels", pages 1-4, 2008.
16. M.G. Genton. Classes of kernels for machine learning: A statistics perspective. Journal of Machine Learning Research, 2: 299-312, 2001.
17. E Girosi, M. Jones, and T. Poggio. Priors, stabilizers and basis functions: from regularization to radial, tensor and additive splines. A.I. Memo 1430, Artificial Intelligence Labratory, Massachusetts Institute of Technology, June 1993.
18. T. Glasmachers and C. Igel. Gradient-based adaptation of general Gaussian kernels. Neural Computation, 17: 2099-2105, 2005.
19. R. Hettich and K.O. Kortanek. Semi-infinite programming: theory, methods, and applications. SIAMReview, 35 (3): 380-429, 1993.
20. T. Joachims. Making large-scale support vector machine learning practical. In B. Schölkopf, C.J.C. Burges, and A.J. Smola, editors, Advances in Kernel Methods- Support Vector Learning, pages 169-184. MIT Press, 1999.
21. E. Kreyszig. Introductory Functional Analysis with Applications. Wiley, New York, 1989.
22. G.R.G. Lanckriet, N. Cristianini, P. Bartlett, L. El Ghaoui, and M.I. Jordan. Learning the kernel matrix with semidefinite programming. Journal of Machine Learning Research, 5: 27-72, 2004.
23. D.C. Liu and J. Nocedal. On the limited memory BFGS method for large scale optimization. Mathematical Programming B, 45 (3): 503-528, 1989.
24. M.E. Mavroforakis and S. Theodorodis. A geometric approach to support vector machine (SVM) classification. IEEE Transactions on Neural Networks, 17 (3): 671-682, 2006.
25. C.A. Micchelli and M. Pontil. Learning the kernel function via regularization. Journal of Machine Learning Research, 6: 1099-1125, 2005.
26. C.A. Micchelli, M. Pontil, Q. Wu, and D.X. Zhou. Error bounds for learning the kernel. Research Note RN/05/09, Department of Computer Science, University College London, June 2005b.
27. J. Nocedal. Updating quasi-newton matrices with limited storage. Mathematics of Computation, 35 (151): 773-782, 1980.
28. J. Nocedal and S.J. Wright. Numerical Optimization, second edition. Springer Science+Business Media, LLC, New York, USA, 2006.
29. C.S. Ong, A.J. Smola, and R.C. Williamson. Learning the kernel with hyperkernels. Journal of Machine Learning Research, 6: 1043-1071, 2005.
30. J.C. Piatt. Fast training of support vector machines using sequential minimal optimization. In B. Schölkopf, C.J.C. Burges, and A.J. Smola, editors, Advances in Kernel Methods- Support Vector Learning, pages 185-208. MIT Press, 1999.
31. A. Rakotomamonjy, ER. Bach, S. Canu, and V. Grandvalet. SimpleMKL. Journal of Machine Learning Research, 9: 2491-2521, 2008.
32. G. Rätsch, T. Onoda, an K.R. Müller. Soft margins for AdaBoost. Machine Learning, 42 (3): 287-320, 2001.
33. R. Reemtsen and S. Görner. Numerical methods for semi-infinite programming: A survey. In R. Reemtsen and Rückmann, editors, Semi-infinite Programming, pages 195-275. Kluwer Academic Publishers, 1998.
34. R.T. Rockafellar. Convex Analysis. Princeton University Press, Princeton, New Jersey, 1970.
35. H.L. Royden. Real Analysis, 3rd edition. Macmillan Publishing Company, New York, 1988.
36. W. Rudin. Functional Analysis, 2nd edition. McGraw-Hill, New York, 1991.
37. W. Rudin. Real & Complex Analysis, 3rd edition. McGraw-Hill, New York, 1987.
38. I.J. Schoenberg. Metric spaces and completely monotone functions. Annals of Mathematics, 39 (4): 811-841, 1938.
39. B. Schölkopf and A. Smola. Learning with Kernels- Support Vector Machines, Regularization, Optimization and Beyond. MIT Press, Cambridge, MA, 2002.
40. B. Schölkopf, P. Knirsch, A. Smola, and C. Burges. Fast approximation of support vector kernel expansions, and an interpretation of clustering as approximation in feature spaces. In DAGM Symposium Mustererkennung. Springer Lecture Notes in Computer Science, 1998.
41. S. Sonnenburg, G. Rätsch, and C. Schafer. A general and efficient multiple kernel learning algorithm. In Advances in Neural Information Processing Systems, volume 18, pages 1275-1282, Cambridge MA, 2005. MIT Press.
42. S. Sonnenburg, G. Rätsch, C Schafer, and B. Schölkopf. Large scale multiple kernel learning. Journal of Machine Learning Research, 7: 1531-1567, 2006.
43. V. Vapnik. Statistical Learning Theory. John Wiley & Sons, 1998.
44. V.N. Vapnik. An overview of statistical learning theory. IEEE Transactions on Neural Networks, 10 (5): 988-999, 1999.
45. H. Xiong, M.N.S. Swamy, and M.O. Ahmad. Optimizing the kernel in the empirical feature space. IEEE Transactions on Neural Networks, 16 (2): 460-474, 2005.
46. Z. Xu, R. Jin, I. King, and M.R. Lyu. An extended level method for efficient multiple kernel learning. In Advances in Neural Information Processing Systems, volume 21, pages 1825-1832, British Columbia, Canada, 2008. MIT Press.
47. Y. Yiming and D.X. Zhou. Learnability of Gaussians with flexible variances. Journal of Machine Learning Research, 8: 249-276, 2007.