Robust support vector regression for uncertain input and output data

IEEE Transactions on Neural Networks and Learning Systems

Volumn 23, Issue 11, 2012, Pages 1690-1700

  Huang, Gao ^a   Song, Shiji ^a   Wu, Cheng ^a   You, Keyou ^a  

^a TSINGHUA UNIVERSITY   (China)

Author keywords

Robust; second order cone programming; support vector regression; uncertain data

Indexed keywords

ELLIPSOIDAL UNCERTAINTIES; INTERIOR POINT METHODS; NONLINEAR FORMULATION; NONLINEAR REGRESSION PROBLEMS; ROBUST; SECOND-ORDER CONE PROGRAMMING; SUPPORT VECTOR REGRESSION (SVR); UNCERTAIN DATAS;

ARTIFICIAL INTELLIGENCE; COMPUTER NETWORKS;

REGRESSION ANALYSIS;

EID: 84876925191     PISSN: 2162237X     EISSN: 21622388     Source Type: Journal    
DOI: 10.1109/TNNLS.2012.2212456     Document Type: Article

References (45)

1. V. Vapnik, The Nature of Statistical Learning Theory. New York: Springer-Verlag, 1995.
2. C. Cortes and V. Vapnik, "Support vector networks," Mach. Learn., vol. 20, no. 3, pp. 273-297, 1995.
3. V. Vapnik, "An overview of statistical learning theory," IEEE Trans. Neural Netw., vol. 10, no. 5, pp. 988-999, Sep. 1999.
4. Y. Miche, A. Sorjamaa, P. Bas, O. Simula, C. Jutten, and A. Lendasse, "OP-ELM: Optimally pruned extreme learning machine," IEEE Trans. Neural Netw., vol. 21, no. 1, pp. 158-162, Jan. 2010.
5. E. J. Bayro-Corrochano and N. Arana-Daniel, "Clifford support vector machines for classification, regression, and recurrence," IEEE Trans. Neural Netw., vol. 21, no. 11, pp. 1731-1746, Nov. 2010.
6. L. Duan, D. Xu, and I. W. H. Tsang, "Domain adaptation from multiple sources: A domain-dependent regularization approach," IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 3, pp. 504-518, Mar. 2012.
7. J. B. Yang and C. J. Ong, "Feature selection using probabilistic prediction of support vector regression," IEEE Trans. Neural Netw., vol. 22, no. 6, pp. 954-962, Jun. 2011.
8. J. Lopez and J. R. Dorronsoro, "Simple proof of convergence of the SMO algorithm for different SVM variants," IEEE Trans. Neural Netw., vol. 23, no. 7, pp. 1142-1147, Jul. 2012.
9. V. Vapnik, S. E. Golowich, and A. Smola, "Support vector method for function approximation, regression estimation, and signal processing," in Advances in Neural Information Processing Systems 9. Cambridge, MA: MIT Press, 1996, pp. 281-287.
10. H. Drucker, C. J. C. Burges, L. Kaufman, A. J. Smola, and V. Vapnik, "Support vector regression machines," in Advances in Neural Information Processing Systems, vol. 9. Cambridge, MA: MIT Press, 1997, pp. 155-161.
11. A. J. Smola and B. Scholkopf, "A tutorial on support vector regression," Stat. Comput., vol. 14, no. 3, pp. 199-222, 2004.
12. D. H. Hong and C. Hwang, "Support vector fuzzy regression machines," Fuzzy Sets Syst., vol. 138, no. 2, pp. 271-281, 2003.
13. T. B. Trafalis and R. C. Gilbert, "Robust classification and regression using support vector machines," Eur. J. Oper. Res., vol. 173, no. 3, pp. 893-909, Jul. 2006.
14. T. B. Trafalis and S. A. Alwazzi, "Support vector regression with noisy data: A second order cone programming approach," Int. J. General Syst., vol. 36, no. 2, pp. 237-250, Apr. 2007.
15. P. K. Shivaswamy, C. Bhattacharyya, and A. J. Smola, "Second order cone programming approaches for handling missing and uncertain data," J. Mach. Learn. Res., vol. 7, pp. 1283-1314, Dec. 2006.
16. E. Carrizosa, J. E. Gordillo, and F. Plastria, "Support vector regression for imprecise data," Dept. MOSI, Vrije Univ. Brussel, Belgium, Tech. Rep., 2007.
17. C. Chuang, S. Su, J. Jeng, and C. Hsiao, "Robust support vector regression networks for function approximation with outliers," IEEE Trans. Neural Netw., vol. 13, no. 6, pp. 1322-1330, Nov. 2002.
18. G. Camps-Valls, L. Bruzzone, J. Rojo-Álvarez, and F. Melgani, "Robust support vector regression for biophysical variable estimation from remotely sensed images," IEEE, Geosci. Remote Sensing Lett., vol. 3, no. 3, pp. 339-343, Jul. 2006.
19. C. Bhattacharyya, K. Pannagadatta, and A. Smola, "A second order cone programming formulation for classifying missing data," in Advances in Neural Information Processing Systems. Cambridge, MA: MIT Press, 2004.
20. E. Carrizosa, J. E. Gordillo, and F. Plastria, "Kernel support vector regression with imprecise output," Dept. MOSI, Vrije Univ. Brussel, Brussel, Belgium, Tech. Rep., 2008.
21. J. Jeng, C. Chuang, and S. Su, "Support vector interval regression networks for interval regression analysis," Fuzzy Sets Syst., vol. 138, no. 2, pp. 283-300, 2003.
22. C. Hwang, D. Hong, and K. H. Seok, "Support vector interval regression machine for crisp input and output data," Fuzzy Sets Syst., vol. 157, no. 8, pp. 1114-1125, 2006.
23. D. H. Hong and C. Hwang, "Extended fuzzy regression models using regularization method," Inf. Sci., vol. 164, nos. 1-4, pp. 31-36, Aug. 2004.
24. C.-F. Lin and S.-D. Wang, "Training algorithms for fuzzy support vector machines with noisy data," Pattern Recognit. Lett., vol. 25, no. 14, pp. 1647-1656, Oct. 2004.
25. A. Ben-Tal, S. Bhadra, C. Bhattacharyya, and J. S. Nath, "Chance constrained uncertain classification via robust optimization," Math. Program., vol. 127, no. 1, pp. 145-173, Mar. 2011.
26. G. Golub, "Some modified matrix eigenvalue problems," SIAM Rev., vol. 15, no. 2, pp. 318-344, 1973.
27. G. Golub and C. V. Loan, "An analysis of the total least squares problem," SIAM J. Numer. Anal., vol. 17, pp. 883-893, Dec. 1973.
28. J. Connor, R. Martin, and L. Atlas, "Recurrent neural networks and robust time series prediction," IEEE Trans. Neural Netw., vol. 5, no. 2, pp. 240-254, Mar. 1994.
29. D. S. Chen and R. C. Jain, "A robust backpropagation learning algorithm for function approximation," IEEE Trans. Neural Netw., vol. 5, no. 3, pp. 467-479, May 1994.
30. E. Hoerl and R. W. Kennard, "Ridge regression: Biased estimation for nonorthogonal problems," Technometrics, vol. 12, no. 1, pp. 55-67, 1970.
31. H. Tanaka, S. Uejima, and K. Asai, "Linear regression analysis with fuzzy model," IEEE Trans. Syst. Man Cybern., vol. 12, no. 6, pp. 903-907, Nov. 1982.
32. P. Diamond, "Fuzzy least squares," Inf. Sci., vol. 46, pp. 141-157, Dec. 1988.
33. A. W. Marshall and I. Olkin, "Multivariate Chebyshev inequality," Ann. Math. Stat., vol. 31, no. 4, pp. 1001-1014, Dec. 1960.
34. M. Lobo, L. Vandenberghe, S. Boyd, and H. Lebret, "Applications of second-order cone programming," Linear Algebra Its Appl., vol. 284, pp. 193-228, Nov. 1998.
35. S. Mehrotra, "On the implementation of a primal-dual interior point method," SIAM J. Opt., vol. 2, no. 4, pp. 575-601, 1992.
36. T. B. Trafalis and R. C. Gilbert, "Robust support vector machines for classification and computational issues," Optim. Methods Softw., vol. 22, no. 1, pp. 187-198, Feb. 2007.
37. B. Schölkopf, A. Smola, and K. R. Muller, "Nonlinear component analysis as a kernel eigenvalue problem," Neural Comput., vol. 10, no. 5, pp. 1299-1319, 1998.
38. M. S. Lobo, L. Vandenberghe, S. Boyd, and H. Lebret, "Applications of second-order cone programming," Linear Algebra Its Appl., vol. 284, nos. 1-3, pp. 193-228, 1998.
39. Y. Nesterov and A. Nemirovskii, Interior-Point Polynomial Algorithms in Convex Programming, vol. 13. Philadelphia, PA: SIAM, 1987.
40. I. Polik. (2010). SeDuMi [Online]. Available: http://sedumi.ie.lehigh.edu
41. J. F. Sturm, "Using SeDuMi 1.02, a MATLAB toolbox for optimization over symmetric cones," Optim. Methods Softw., vol. 11, nos. 1-4, pp. 625-653, 1999.
42. C. Chang and C. Lin, "LIBSVM: A library for support vector machines," ACM Trans. Intell. Syst. Technol., vol. 2, no. 3, pp. 1-27, 2011.
43. C. Hsu, C. Chang, and C. Lin. (2003). A Practical Guide to Support Vector Classification [Online]. Available: http://www.csie.ntu.edu.tw/∼cjlin/ papers/guide/guide.pdf
44. A. Frank and A. Asuncion. (2011). UCI Machine Learning Repository [Online]. Available: http://archive.ics.uci.edu/ml
45. D. Michie, D. J. Spiegelhalter, and C. Taylor, Machine Learning, Neural and Statistical Classification. New York: Ellis Horwood, 1994.