On p-norm path following in multiple kernel learning for non-linear feature selection

31st International Conference on Machine Learning, ICML 2014

Volumn 2, Issue , 2014, Pages 1310-1321

  Jawanpuria, Pratik ^a   Varma, Manik ^b   Nath, J Saketha ^a  

^a INDIAN INSTITUTE OF TECHNOLOGY BOMBAY   (India)

^b MICROSOFT RESEARCH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; APPROXIMATION ALGORITHMS; ARTIFICIAL INTELLIGENCE; CLASSIFICATION (OF INFORMATION); LEARNING SYSTEMS;

CLASSIFICATION ACCURACY; FEATURE SELECTION METHODS; KERNEL TARGET ALIGNMENT; MULTIPLE KERNEL LEARNING; NONLINEAR FEATURES; OPTIMAL FEATURE SETS; PATH-FOLLOWING ALGORITHM; SCALING CAPABILITY;

FEATURE EXTRACTION;

EID: 84919906567     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (49)

1. Aflalo, J., Ben-Tal, A., Bhattacharyya, C., Nath, J. Saketha, and Raman, S. Variable sparsity kernel learning. JMLR, 12:565- 592, 2011.
2. Allgower, E. L. and Georg, K. Continuation and path following. Acta Numer, 2:1-64, 1993.
3. Andrew, G. and Gao, J. Scalable training of L-l-regularized log- linear models. In ICML, pp. 33-40, 2007.
4. Bach, F. R. Exploring large feature spaces with hierarchical multiple kernel learning. In NIPS, pp. 105-112, 2008.
5. Bach, F. R., Thibaux, R., and Jordan, M. I. Computing regularization paths for learning multiple kernels. In NIPS, 2004.
6. Baluja, S. and Rowley, H. Boosting sex identification performance. IJCV, 71(1):111-119, 2007.
7. Baneijee, A., Merugu, S., Dhillon, I. S., and Ghosh, J. Clustering with bregman divergences. JMLR, 6:1705-1749, 2005.
8. Ben-Tal, A. and Nemirovski, A. Lectures on Modern Convex Optimization: Analysis, Algorithms and Engineering Applications. MPS/SIAM Series on Optimization, 1, 2001.
9. Bousquet, O. and Elisseeff, A. Stability and generalization. JMLR, 2:499-526, 2002.
10. Cao, B., Shen, D., Sun, J. T., Yang, Q., and Chen, Z. Feature selection in a kernel space. In ICML, 2007.
11. Chan, A. B., Vasconcelos, N., and Lanckriet, G. Direct convex relaxations of sparse SVM. In ICML, pp. 145-153, 2007.
12. Chen, J., Ji, S., Ceran, B., Li, Q., Wu, M., and Ye, J. Learning subspace kernels for classification. In KDD, 2008.
13. Cortes, C., Mohri, M., and Rostamizadeh, A. L2 regularization for learning kernels. In UAI, 2009a.
14. Cortes, C., Mohri, M., and Rostamizadeh, A. Learning non-linear combinations of kernels. In NIPS, 2009b.
15. Cortes, C., Mohri, M., and Rostamizadeh, A. Algorithms for learning kernels based on centered alignment. JMLR, 13:795- 828, 2012.
16. Cristianini, N., Lodhi, H., and Shawe-taylor, J. Latent semantic kernels for feature selection. Technical Report NC-TR-00-080, 2000.
17. Cristianini, N., Shawe-Taylor, J., Elisseeff, A., and Kandola, J. On kernel-target alignment. In NIPS, 2001.
18. Fung, G. and Mangasarian, O. L. A feature selection newton method for support vector machine classification. Technical Report 02-03, Univ. of Wisconsin, 2002.
19. Grandvalet, Y. and Canu, S. Adaptive scaling for feature selection in svms. In NIPS, 2002.
20. Gunter, L. and Zhu, J. Computing the solution path for the regularized support vector regression. In NIPS, 2005.
21. Guyon, I., Gunn, S., Nikravesh, M., and Zadeh, L. A. Feature Extraction: Foundations and Applications. Springer-Verlag New York, Inc., 2006.
22. Hastie, T., Rosset, S., Tibshirani, R., and Zhu, J. The entire regularization path for the support vector machine. JMLR, 5:1391- 1415, 2004.
23. Hwang, S. J., Sha, F., and Grauman, K. Sharing features between objects and their attributes. In CVPR, pp. 1761-1768, 2011.
24. Hwang, S. J., Grauman, K., and Sha, F. Semantic kernel forests from multiple taxonomies. In NIPS, 2012.
25. Jain, A., Vishwanathan, S. V. N., and Varma, M. Spg-gmkl: Generalized multiple kernel learning with a million kernels. In KDD, 2012.
26. Ji, S., Sun, L., Jin, R., and Ye, J. Multi-label multiple kernel learning. In NIPS, 2008.
27. Kivinen, J., Warmuth, M. K., and Hassibi, B. The p-norm generaliziation of the LMS algorithm for adaptive filtering. IEEE Trans. Signal Processing, 54(5): 1782-1793, 2006.
28. Kloft, M., Brefeld, U., Sonnenburg, S., and Zien, A. lp-norm multiple kernel learning. JMLR, 12:953-997, 2011.
29. Lanckriet, G. R. G., Cristianini, N., Bartlett, P., El Ghaoui, L., and Jordan, M. I. Learning the kernel matrix with semidefinite programming. JMLR, 5:27-72, 2004.
30. Levinboim, T. and Sha, F. Learning the kernel matrix with low- rank multiplicative shaping. In AAAI, 2012.
31. Li, F. and Sminchisescu, C. The feature selection path in kernel methods. In AISTATS, 2010.
32. Li, F., Yang, Y., and Xing, E. From lasso regression to feature vector machine. In NIPS, 2006.
33. Orabona, F. and Jie, L. Ultra-fast optimization algorithm for sparse multi kernel learning. In ICML, 2011.
34. Orabona, F., Luo, J., and Caputo, B. Multi kernel learning with online-batch optimization. JMLR, 13:227-253, 2012.
35. Rakotomamonjy, A., Bach, F., Grandvalet, Y., and Canu, S. Sim- pleMKL. JMLR, 9:2491-2521, 2008.
36. Rosset, S. Following curved regularized optimization solution paths. In NIPS, 2004.
37. Song, L., Smola, A., Gretton, A., Bedo, J., and Borgwardt, K. Feature selection via dependence maximization. JMLR, 13: 1393-1434, 2012.
38. Varma, M. and Babu, B. R. More generality in efficient multiple kernel learning. In ICML, 2009.
39. Vedaldi, A., Gulshan, V., Varma, M., and Zisserman, A. Multiple kernels for object detection. In ICCV, 2009.
40. Vishwanathan, S. V. N., Sun, Z., Theera-Ampornpunt, N., and Varma, M. Multiple kernel learning and the smo algorithm. In NIPS, 2010.
41. Wang, G., Yeung, D.-Y., and Lochovsky, F. H. Two-dimensional solution path for support vector regression. In ICML, 2006.
42. Wang, G., Yeung, D.-Y., and Lochovsky, F. H. A kernel path algorithm for support vector machines. In ICML, 2007.
43. Weston, J., Mukherjee, S., Chapelle, O., Pontil, M., Poggio, T., and Vapnik, V. Feature selection for svms. In NIPS, 2000.
44. Wu, M., Scholkopf, B., and Bakir, G. Building sparse large margin classifier. In ICML, 2005.
45. Ye, J.,, Ji, S., and Chen, J. Multi-class discriminant kernel learning via convex programming. JMLR, 9:719-758, 2008.
46. Zhao, P. and Yu, B. Stagewise lasso. JMLR, 8:2701-2726, 2007.
47. Zhao, Z., Morstatter, F., Sharma, S., Alelyani, S., Anand, A., and Liu, H. Advancing feature selection research. Technical report, Arizona State University, 2010.
48. Zhu, J., Rosset, S., Hastie, T., and Tibshirani, R. 1-norm Support Vector Machines. In NIPS, 2003.
49. Zou, H. and Hastie, T. Regularization and variable seclection via the elastic net. Journal of the Royal Statistical Society B, 67 (2):301-320, 2005.