Nonlinear regularization path for the modified Huber loss support vector machines

Proceedings of the International Joint Conference on Neural Networks

Volumn , Issue , 2010, Pages

  Karasuyama, Masayuki ^a   Takeuchi, Ichiro ^a  

^a NAGOYA INSTITUTE OF TECHNOLOGY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

APPROXIMATION ALGORITHMS; ITERATIVE METHODS; PIECEWISE LINEAR TECHNIQUES; RATIONAL FUNCTIONS;

BREAKPOINT; MACHINE LEARNING APPROACHES; MODEL SELECTION PROBLEM; NONLINEAR REGULARISATION; PATH ALGORITHM; RATIONAL EQUATIONS; REGULARIZATION PARAMETERS; REGULARIZATION PATHS; SOLUTION PATH; SUPPORT VECTORS MACHINE;

SUPPORT VECTOR MACHINES;

EID: 79959447411     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IJCNN.2010.5596869     Document Type: Conference Paper

References (28)

1. T. Hastie, S. Rosset, R. Tibshirani, and J. Zhu, "The entire regularization path for the support vector machine," Journal of Machine Learning Research, vol. 5, pp. 1391-1415, 2004.
2. E. L. Allgower and K. Georg, "Continuation and path following," Acta Numerica, vol. 2, pp. 1-64, 1993.
3. T. Gal, Postoptimal Analysis, Parametric Programming, and Related Topics. Walter de Gruyter, 1995.
4. V. N. Vapnik, The Nature of Statistical Learning Theory. Springer-Verlag, 1995.
5. S. Rosset and J. Zhu, "Piecewise linear regularized solution paths," Annals of Statistics, vol. 35, pp. 1012-1030, 2007.
6. R. Tibshirani, "Regression shrinkage and selection via the lasso," Journal of the Royal Statistical Society (Series B), vol. 58, no. 1, pp. 267-288, 1996.
7. K. Ritter, "On parametric linear and quadratic programming problems," in Mathematical programming: Proceedings of the International Congress on Mathematical Programming, R. W. Cottle, M. L. Kelmanson, and B. Korte, Eds. Elsevier Science Publishers, 1984, pp. 307-335.
8. F. R. Bach, R. Thibaux, and M. I. Jordan, "Computing regularization paths for learning multiple kernels," in Advances in Neural Information Processing Systems 17, L. K. Saul, Y. Weiss, and L. Bottou, Eds. Cambridge, MA: MIT Press, 2005, pp. 73-80.
9. M. Park and T. Hastie, "L1-regularization path algorithm for generalized linear models," Journal of the Royal Statistical Society. Series B: Statistical Methodology, vol. 69, no. 4, pp. 659-677, 2007.
10. V. Krishnamurthy, S. D. Ahipasaoglu, and A. d'Aspremont, "A pathwise algorithm for covariance selection," in NIPS 2009 Workshop on Optimization for Machine Learning, 2009.
11. S. Rosset, "Following curved regularized optimization solution paths," in Advances in Neural Information Processing Systems 17, L. K. Saul, Y. Weiss, and L. Bottou, Eds. Cambridge, MA: MIT Press, 2005, pp. 1153-1160.
12. G. Wang, D.-Y. Yeung, and F. H. Lochovsky, "A kernel path algorithm for support vector machines," in Twenty-fourth International Conference on Machine Learning, 2007, pp. 951-958.
13. T. Zhang, "Statistical behavior and consistency of classification methods based on convex risk minimization," Annals of Statistics, vol. 32, no. 1, pp. 56-134, 2004.
14. O. Chapelle, "Training a support vector machine in the primal," Neural Computation, vol. 19, no. 5, pp. 1155-1178, 2007.
15. P. L. Bartlett and A. Tewari, "Sparseness vs estimating conditional probabilities: Some asymptotic results," Journal of Machine Learning Research, vol. 8, pp. 775-790, 2007.
16. S. S. Keerthi and D. DeCoste, "A modified finite newton method for fast solution of large scale linear SVMs," Journal of Machine Learning Research, vol. 6, pp. 341-361, 2005.
17. L. Bo, L. Wang, and L. Jiao, "Recursive finite newton algorithm for support vector regression in the primal," Neural Comput., vol. 19, no. 4, pp. 1082-1096, 2007.
18. J. Bunch, C. Nielsen, and D. Sorensen, "Rank-one modification of the symmetric eigenproblem," Numerische Mathematik, vol. 31, no. 1, pp. 31-48, 1979.
19. W. Chu, S. S. Keerthi, and C. J. Ong, "Bayesian support vector regression using a unified loss function," IEEE Transaction on Neural Networks, vol. 15, no. 1, pp. 29-44, 2004.
20. G. H. Golub, "Some modified eigenvalue problems," Stanford University, Stanford, CA, USA, Tech. Rep., 1971.
21. G. H. Golub and C. F. V. Loan, Matrix computations. Baltimore, MD, USA: Johns Hopkins University Press, 1996.
22. E. Anderson, Z. Bai, C. Bischof, L. S. Blackford, J. Demmel, J. J. Dongarra, J. Du Croz, S. Hammarling, A. Greenbaum, A. McKenney, and D. Sorensen, LAPACK Users' guide (third ed.). Philadelphia, PA, USA: Society for Industrial and Applied Mathematics, 1999.
23. J. C. Platt, "Fast training of support vector machines using sequential minimal optimization," in Advances in Kernel Methods - Support Vector Learning, B. Schölkopf, C. J. C. Burges, and A. J. Smola, Eds. Cambridge, MA: MIT Press, 1999, pp. 185-208.
24. M. Vogt, "SMO algorithms for support vector machines without bias term," Technische Universität Darmstadt, Tech. Rep., 2002.
25. C.-C. Chang and C.-J. Lin, "LIBSVM: a library for support vector machines," 2001, software available at http://www.csie.ntu.edu.tw/ cjlin/libsvm.
26. L. Bottou and C.-J. Lin, "Support vector machine solvers," in Large Scale Kernel Machines, L. Bottou, O. Chapelle, D. DeCoste, and J. Weston, Eds. Cambridge, MA.: MIT Press, 2007, pp. 301-320.
27. L. Gunter and J. Zhu, "Computing the solution path for the regularized support vector regression," in Advances in Neural Information Processing Systems, vol. 18. Cambridge, Massachussetts: The MIT Press, 2005.
28. G. Wang, D.-Y. Yeung, and F. H. Lochovsky, "A new solution path algorithm in support vector regression," IEEE Transactions on Neural Networks, vol. 19, no. 10, pp. 1753-1767, 2008.