Finite Newton method for implicit Lagrangian support vector regression

International Journal of Knowledge-Based and Intelligent Engineering Systems

Volumn 15, Issue 4, 2011, Pages 203-214

  Balasundaram, S ^a   Kapil, ^a  

^a JAWAHARLAL NEHRU UNIVERSITY   (India)

Author keywords

Implicit Lagrangian support vector machines; Newton method; Support vector regression

Indexed keywords

FINITE NEWTON METHOD; FINITE TERMINATION; GENERALIZATION PERFORMANCE; IMPLICIT LAGRANGIAN SUPPORT VECTOR MACHINES; LAGRANGIAN; NEWTON ITERATIVE METHODS; NEWTON METHODS; OPTIMIZATION PACKAGES; QUADRATIC PROGRAMMING PROBLEMS; REAL-WORLD DATASETS; SUPPORT VECTOR REGRESSION; SUPPORT VECTOR REGRESSIONS; SYSTEM OF LINEAR EQUATIONS;

ALGORITHMS; LAGRANGE MULTIPLIERS; NEWTON-RAPHSON METHOD; OPTIMIZATION; REGRESSION ANALYSIS;

VECTORS;

EID: 80055066407     PISSN: 13272314     EISSN: 18758827     Source Type: Journal    
DOI: 10.3233/KES-2011-0222     Document Type: Article

References (32)

1. S. Balasundaram and Kapil, On Lagrangian Support Vector Regression, Expert Systems with Applications 37 (2010), 8784-8792.
2. S. Balasundaram and R. Singh, On finite Newton method for support vector regression, Neural Computing & Applications 19 (2010), 967-977.
3. G.E.P. Box and G.M. Jenkins, Time series analysis: Forecasting and Control, Holden-Day, San Francisco, 1976.
4. M.Casdagli, Nonlinear prediction of chaotic time series, Physica D 35 (1989), 335-356.
5. C.C. Chang and C.J. Lin, LIBSVM: A Library for Support Vector Machines, http://www.csie.ntu.edu.tw/̃cjlin/libsvm, 2001.
6. S. Chen and M. Wang, Seeking multi-threshold directly from support vectors for image segmentation, Neurocomputing 67 (2005), 335-344.
7. N. Cristianini and J. Shawe-Taylor, An Introduction to Support Vector Machines and Kernel based Learning Methods, Cambridge University Press, 2000.
8. DELVE, Data for Evaluating Learning in Valid Experiments, http://www.cs.toronto.edu/̃delve/data, 2005.
9. G. Fung and O.L.Mangasarian, Finite Newton method for Lagrangian support vector machine, Neurocomputing 55 (2003), 39-55.
10. G.H. Golub and C.F. Van Loan, Matrix Computations, 3rd Edition, The Johns Hopkins University Press, 1996.
11. I. Guyon, J. Weston, S. Barnhill and V. Vapnik, Gene selection for cancer classification using support vector machines, Machine Learning 46 (2002), 389-422.
12. L1 data, Applied Mathematics and Optimization 11 (1984), 43-56.
13. Y.J. Lee, W.-F. Hsieh and C.-M. Huang, e-SSVR: A smooth support vector machine for e-insensitive regression, IEEE Trans on Knowledge and Data Engineering 17(5) (2005), 678-685.
14. Y.J. Lee and O.L. Mangasarian, SSVM: A smooth support vectormachine for classification, Computational Optimization and Applications 20(1) (2001), 5-22.
15. G. Li, C. Wen, G.-B. Huang and Y. Chen, Error tolerance based support vector machine for regression, Neurocomputing 74(5) (2011), 771-782.
16. O.L. Mangasarian, A finite Newton method for classification, Optimization Methods and Software 17 (2002), 913-929.
17. O.L. Mangasarian, Parallel gradient distribution in unconstrained optimization, SIAMJournal of Control and Optimization 33(6) (1995), 1916-1925.
18. O.L. Mangasarian, Nonlinear Programming, SIAM Philadelphia, PA, 1994.
19. O.L. Mangasarian and D.R. Musicant, Lagrangian support vector machines, Journal of Machine Learning Research 1 (2001), 161-177.
20. O.L. Mangasarian and D.R.Musicant, Active set support vector machine classification, in: Advances in Neural Information Processing Systems 13, T.K. Leen, T.G. Dietterich and V. Tesp, eds, MIT Press, 2001, pp. 577-586.
21. O.L. Mangasarian and M.V. Solodov, Nonlinear complementarity as unconstrained and constrained minimization, Mathematical Programming, Series B 62 (1993), 277-297.
22. J.E. Min and Y.-C. Lee, Bankruptcy prediction using optimal choice of kernel function parameters, Expert Systems with Applications 28(4) (2005), 603-614.
23. S. Mukherjee, E. Osuna and F. Girosi, Nonlinear prediction of chaotic time series using support vector machines, in: NNSP'97: Neural Networks for Signal Processing VII: in Proc. of IEEE Signal Processing Society Workshop, Amelia Island, FL, USA, 1997, pp. 511-520.
24. K.R. Muller, A.J. Smola, G. Ratsch, B. Schölkopf and J. Kohlmorgen, Using support vector machines for time series prediction, in: Advances in Kernel Methods-Support Vector Learning, B. Schölkopf, C.J.C. Burges and A.J. Smola, eds, MIT Press, Cambridge, MA, 1999, pp. 243-254.
25. P.M. Murphy and D.W. Aha, UCI repository of machine learning databases. University of California, Irvine, http://www.ics.uci.edu/̃mlearn, 1992.
26. D.R. Musicant and A. Feinberg, Active set support vector regression, IEEE Trans on Neural Networks 15(2) (2004), 268-275.
27. E. Osuna, R. Freund and F.Girosi, Training support vector machines: An application to face detection, in Proceed Computer Vision and Pattern Recognition (1997), 130-136.
28. W.H. Press, S.A. Teukolsky,W.T.Vetterling and B.P. Flannery, Numerical Recipes in C, 2nd Edition, Cambridge University Press, 1994.
29. B. Ribeiro, Kernelized based functions with Minkovsky's norm for SVM regression, Proceedings of the International Joint Conference on Neural Networks (2002), IEEE press, 2198-2203.
30. J.A.K. Suykens, J. Vandewalle and B.D. Moor, Optimal control by least squares support vectormachines, Neural Networks 14(1) (2001), 23-25.
31. F.E.H. Tay and L.J. Cao, Application of support vector machines in financial time series with forecasting, Omega 29(4) (2001), 309-317.
32. V.N. Vapnik, The Nature of Statistical Learning Theory, 2nd Edition, Springer, New York, 2000.