Local deep kernel learning for efficient non-linear SVM prediction

30th International Conference on Machine Learning, ICML 2013

Volumn , Issue PART 2, 2013, Pages 1523-1531

  Jose, Cijo ^a   Goyal, Prasoon ^a   Aggrwal, Parv ^a   Varma, Manik ^b  

^a INDIAN INSTITUTE OF TECHNOLOGY DELHI   (India)

^b MICROSOFT RESEARCH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CLASSIFICATION (OF INFORMATION); SUPPORT VECTOR MACHINES;

ACCEPTABLE LIMIT; CLASSIFICATION ACCURACY; FEATURE EMBEDDING; HIGH-DIMENSIONAL; KERNEL LEARNING; MULTIPLE KERNEL LEARNING; THREE ORDERS OF MAGNITUDE; TRAINING POINTS;

FORECASTING;

EID: 84897556730     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (41)

1. Aflalo, J., Ben-Tal, A., Bhattacharyya, C., Nath, J. Saketha, and Raman, S. Variable sparsity kernel learning. JMLR, 12:565-592, 2011.
2. Bach, F. R. Exploring large feature spaces with hierarchical multiple kernel learning. In NIPS, pp. 105-112, 2008.
3. Bengio, Y., Delalleau, O., and Simard, C. Decision trees do not generalize to new variations. Compt. Intl., 26, 2010.
4. Bǎzǎvan, E. G., Li, F., and Sminchisescu, C. Fourier kernel learning. In Proc. ECCV, 2012.
5. Burges, C. J. C. and Schölkopf, B. Improving the accuracy and speed of support vector machines. In NIPS, 1997.
6. Chapelle, O., Vapnik, V., Bousquet, O., and Mukherjee, S. Choosing multiple parameters for Support Vector Machines. Machine Learning, 46:131-159, 2002. (Pubitemid 34129966)
7. Chen, J., Ji, S., Ceran, B., Li, Q., Wu, M., and Ye, J. Learning subspace kernels for classification. In KDD, 2008.
8. Cho, Y. and Saul, L. Kernel methods for deep learning. In NIPS, 2009.
9. Cortes, C., Mohri, M., and Rostamizadeh, A. L2 regularization for learning kernels. In UAI, 2009a.
10. Cortes, C., Mohri, M., and Rostamizadeh, A. Learning non-linear combinations of kernels. In NIPS, 2009b.
11. Cossalter, M., Yan, R., and Zheng, L. Adaptive kernel approximation for large-scale non-linear svm prediction. In ICML, 2011.
12. Gonen, M. and Alpaydin, E. Localized multiple kernel learning. In ICML, 2008.
13. Hsieh, C.-J., Chang, K.-W., Lin, C.-J., Keerthi, S. S., and Sundarajan, S. A dual coordinate descent method for large-scale linear svm. In ICML, 2008.
14. Jain, A., Vishwanathan, S. V. N., and Varma, M. Spg-gmkl: Generalized multiple kernel learning with a million kernels. In KDD, 2012.
15. Joachims, T. and Yu, C.-N. J. Sparse kernel SVMs via cutting-plane training. Machine Learning, 76, 2009.
16. Jose, C., Goyal, P., Aggrwal, P., and Varma, M. The LDKL code. http://research.microsoft.com/enus/um/people/manik/code/LDKL/download.html, 2013.
17. Kar, P. and Karnick, H. Random feature maps for dot product kernels. In AISTATS, 2012.
18. Keerthi, S. S., Chapelle, O., and DeCoste, D. Building support vector machines with reduced classifier complexity. JMLR, 7, 2006.
19. Kloft, M., Brefeld, U., Sonnenburg, S., Laskov, P., Muller, K.-R., and Zien, A. Efficient and accurate l-p-norm Multiple Kernel Learning. In NIPS, 2009.
20. Ladicky, L. and Torr, P. H. S. Locally linear support vector machines. In ICML, 2011.
21. Lanckriet, G. R. G., Cristianini, N., Bartlett, P., El Ghaoui, L., and Jordan, M. I. Learning the kernel matrix with semidefinite programming. JMLR, 5:27-72, 2004.
22. Maji, S., Berg, A. C., and Malik, J. Efficient classification for additive kernel SVMs. IEEE PAMI, 35(1), 2013.
23. Ong, C. S., Smola, A. J., and Williamson, R. C. Learning the kernel with hyperkernels. JMLR, 6:1043-1071, 2005.
24. Orabona, F. and Jie, L. Ultra-fast optimization algorithm for sparse multi kernel learning. In ICML, June 2011.
25. Orabona, F., Jie, L., and Caputo, B. Online-batch strongly convex multi kernel learning. In CVPR, pp. 787-794, San Francisco, California, June 2010.
26. Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Prettenhofer, P., Weiss, R., Dubourg, V., Vanderplas, J., Passos, A., Cournapeau, D., Brucher, M., Perrot, M., and Duchesnay, E. Scikit-learn: Machine learning in Python. JMLR, 12, 2011.
27. Rahimi, A. and Recht, B. Random features for large-scale kernel machines. In NIPS, 2007.
28. Rahimi, A. and Recht, B. Weighted sums of random kitchen sinks: Replacing minimization with randomization in learning. In NIPS, 2008.
29. Rakotomamonjy, A., Bach, F., Grandvalet, Y., and Canu, S. SimpleMKL. JMLR, 9:2491-2521, 2008.
30. Sindhwani, V. and Lozano, A. C. Non-parametric group orthogonal matching pursuit for sparse learning with multiple kernels. In NIPS, 2011.
31. Sonnenburg, S., Raetsch, G., Schaefer, C., and Schoelkopf, B. Large scale multiple kernel learning. JMLR, 7:1531-1565, 2006. (Pubitemid 44373694)
32. Tsang, I., Kwok, J. T., and Cheung, P. M. Core vector machines: Fast svm training on very large data sets. JMLR, 6, 2005.
33. Tsang, I., Kocsor, A., and Kwok, J. T. Simpler core vector machines with enclosing balls. In ICML, 2007.
34. Tsang, I. W. and Kwok, J. T. Efficient hyperkernel learning using second-order cone programming. IEEE Transactions on Neural Networks, 17(1):48-58, 2006. (Pubitemid 43263939)
35. Vedaldi, A. and Zisserman, A. Efficient additive kernels via explicit feature maps. IEEE PAMI, 34(3), 2011.
36. Vedaldi, A. and Zisserman, A. Sparse kernel approximations for efficient classification and detection. In CVPR, 2012.
37. Vinyals, O., Jia, Y., Deng, L., and Darrell, T. Learning with recursive perceptual representations. In NIPS, 2012.
38. Vishwanathan, S. V. N., Sun, Z., Theera-Ampornpunt, N., and Varma, M. Multiple kernel learning and the smo algorithm. In NIPS, 2010.
39. Williams, C. and Seeger, M. Using the Nyström method to speed up kernel machines. In NIPS, 2001.
40. Yang, T., Li, Y.-F., Mahdavi, M., Jin, R., and Zhou, Z.-H. Nyström method vs random fourier features: A theoretical and empirical comparison. In NIPS, 2012.
41. Ye, J., Ji, S., and Chen, J. Multi-class discriminant kernel learning via convex programming. JMLR, 9:719-758, 2008.