Regularized least squares support vector regression for the simultaneous learning of a function and its derivatives

Information Sciences

Volumn 178, Issue 17, 2008, Pages 3402-3414

  Jayadeva, ^a   Khemchandani, Reshma ^b   Chandra, Suresh ^b  

^a IBM INDIA RESEARCH LAB   (India)

^b INDIAN INSTITUTE OF TECHNOLOGY DELHI   (India)

Author keywords

Function approximation; Machine learning; Regularized least squares; Support vector machines

Indexed keywords

ADAPTIVE FILTERING; COMPUTER NETWORKS; CURVE FITTING; FOOD PROCESSING; FUNCTION EVALUATION; GEODESY; INTEGER PROGRAMMING; LEAST SQUARES APPROXIMATIONS; MATHEMATICAL PROGRAMMING; NONLINEAR PROGRAMMING; NUMERICAL METHODS; QUADRATIC PROGRAMMING; SUPPORT VECTOR MACHINES; VECTORS;

REGULARIZED LEAST SQUARES; SYSTEM OF LINEAR EQUATIONS;

LINEAR EQUATIONS;

EID: 46049114855     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2008.04.007     Document Type: Article

References (27)

1. Aarts L.P., and Veer P.V.D. Neural network method for solving partial differential equations. Neural Processing Letters 14 3 (2001) 261-271
2. Burges C. A tutorial on support vector machines for pattern recognition. Data Mining and Knowledge Discovery 2 2 (1998) 121-167
3. Broersen P.M.T. How to select polynomial models with an accurate derivative. IEEE Transactions on Instrumentation and Measurement 49 5 (2000) 910-914
4. Cristianini N., and Shawe-Taylor J. An Introduction to Support Vector Machines and Other Kernel Based Learning Methods (2000), Cambridge University Press
5. G. Fung, O.L. Mangasarian, Proximal Support Vector Machines, in: Proceedings of the KID-2001, San Francisco, 2001, pp. 77-86.
6. Golub G.H., and Van Loan C.F. Matrix Computations. third ed. (1996), The John Hopkins University Press, Maryland
7. Joachims T. A statistical learning model of text classification with support vector machines. In: Bruce Croft W., Harper D.J., Kraft D.H., and Zobel J. (Eds). Proceedings of the SIGIR-01, 24th ACM International Conference on Research and Development in Information Retrieval (2001), ACM Press, New York, US 128-136
8. Khemchandani R., Jayadeva, and Chandra S. Regularized least squares fuzzy support vector regression for financial time series forecasting. Expert Systems with Applications (2007) 10.1016/j.eswa.2007.09.035
9. Lagaris I.E., Likas A., and Fotiadis D.I. Artificial neural networks for solving ordinary and partial differential equations. IEEE Transactions on Neural Networks 9 5 (1998) 987-1000
10. M.H. Lamers, J.N. Kok, A multilevel nonlinearity study design, in: IEEE International World Congress on Computational Intelligence, International Joint Conference on Neural Networks, Anchorage, Alaska, 1998, pp. 730-734.
11. Lázaro M., Santamaŕia I., Pérez-Cruz F., and Artés-Rodŕiguez A. Support vector regression for the simultaneous learning of a multivariate function and its derivative. Neurocomputing 69 1-3 (2005) 42-61
12. M. Lázaro, I. Santamaŕia a, F. Pérez-Cruz, A. Artés-Rodŕiguez, SVM for the simultaneous approximation of a function and its derivative, in: Proceedings of the 2003 IEEE International Workshop on Neural Networks for Signal Processing (NNSP), Toulouse, France, 2003, pp. 189-198.
13. Mangasarian O.L. Nonlinear Programming (1994), SIAM, Philadelphia, PA
14. Mees A.I., Jackson M.F., and Chua L.O. Device modeling by radial basis function. IEEE Transactions on Circuits ad Systems-I: Fundamental Theory and Applications 39 1 (1992) 19-27
15. Milligen B.P.V., Tribaldos V., and Jiménez J.A. Neural network differential equation and plasma equilibrium solver. Physical Review Letters 75 20 (1995) 3594-3597
16. Müller H.G., Stadmüller U., and Schmitt T. Bandwidth choice and confidence intervals for derivatives of noisy data. Biometrika 74 4 (1987) 743-749
17. Pérez-Cruz F., Bousońo-Calzón C., and Artés-Rodŕiguez A. Convergence of the IRWLS procedure to the support vector machine solution. Neural Computation 17 1 (2005) 7-18
18. Rutkowski L. A general approach for nonparametric fitting of functions and their derivatives with applications to linear circuits identification. IEEE Transactions on Circuits and Systems 33 8 (1986) 812-818
19. C. Saunders, A. Gammerman, V. Vovk, Ridge regression learning algorithm in dual variables, In: ICML'98, Proceedings of the 15th International Conference on Machine Learning, Madison, WI, 1998, pp. 515-521. .
20. Suykens J.A.K., and Vandewalle J. Least squares support vector machines classifiers. Neural Processing Letters 9 3 (1999) 293-300
21. Suykens J.A.K., Van Gestel T., De Brabanter J., De Moor B., and Vandewalle J. Least Squares Support Vector Machines (2002), World Scientific, Singapore
22. Suykens J.A.K., De Brabanter J., Lukas L., and Vandewalle J. Weighted least squares support vector machines: robustness and sparse approximation. Neurocomputing 48 1-4 (2002) 85-105
23. Vapnik V. The Nature of Statistical Learning Theory (1995), Springer-Verlag, NY
24. Williams C.K.I., and Seeger M. Using the Nystrom method to speed up kernel machines. In: Leen T.K., Dietterich T.G., and Tresp V. (Eds). Advances in Neural Information Processing Systems 13 (2001), MIT Press 682-688
25. Xiong H., Swamy M.N.S., and Ahmad M.O. Optimizing the kernel in the empirical feature space. IEEE Transaction on Neural Networks 16 2 (2005) 460-474
26. Wong W.T., Shih F.Y., and Liu J. Shape-based image retrieval using support vector machines, Fourier descriptors and self-organizing maps. Information Sciences 177 8 (2007) 1878-1891
27. .