Robust regularized kernel regression

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 38, Issue 6, 2008, Pages 1639-1644

  Zhu, Jianke ^a   Hoi, Steven C H ^b   Lyu, Michael Rung Tsong ^a  

^a CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

^b NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

Author keywords

Kernel regression; Regularized least squares (RLS); Robust estimator; Support vector machine (SVM)

Indexed keywords

CURVE FITTING; PROBABILITY DENSITY FUNCTION; SUPPORT VECTOR MACHINES;

APPLICATIONS.; DUAL FORMS; KERNEL REGRESSION; KERNEL REGRESSIONS; LOSS FUNCTIONS; OPTIMIZATION PROBLEMS; QUADRATIC PROGRAMS; REAL DATA SETS; REGULARIZATION NETWORKS; REGULARIZED LEAST SQUARES (RLS); ROBUST ESTIMATOR; ROBUST REGRESSIONS; SUPPORT VECTOR MACHINE (SVM);

REGRESSION ANALYSIS;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; COMPUTER SIMULATION; METHODOLOGY; REGRESSION ANALYSIS; STATISTICAL ANALYSIS; STATISTICAL MODEL;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; COMPUTER SIMULATION; DATA INTERPRETATION, STATISTICAL; MODELS, STATISTICAL; PATTERN RECOGNITION, AUTOMATED; REGRESSION ANALYSIS;

EID: 57049181420     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2008.927279     Document Type: Article

References (22)

1. W. Chu, S. S. Keerthi, and C. J. Ong, "Bayesian support vector regression using a unified loss function," IEEE Trans. Neural Netw. vol. 15, no. 1, pp. 29-44, Jan. 2004.
2. 1 regularized logistic regression," in Proc. AAAI, 2006, pp. 401-408.
3. Y-J. Lee, W.-F. Hsieh, and C.-M. Huang, "c-SSVR: A smooth support vector machine for ∈-insensitive regression," IEEE Trans. Knowl. Data Eng., vol. 17, no. 5, pp. 678-685, May 2005.
4. O. L. Mangasarian and D. R. Musicant, "Robust linear and support vector regression," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 9, pp. 950-955, Sep. 2000.
5. C. E. Rasmussen and C. K. I. Williams, Gaussian Processes for Machine Learning. Cambridge, MA: MIT Press, 2006.
6. P. J. Huber, "Robust estimation of a location parameter," Ann. Math. Stat., vol. 35, no. 1, pp. 73-101, 1964.
7. T. Evgeniou, M. Pontil, and T. Poggio, "Regularization networks and support vector machines," Adv. Comput. Math., vol. 13, no. 1, pp. 1-50, Apr. 2000.
8. V. Vapnik, Statistical Learning Theory. New York: Wiley, 1998.
9. O. Mangasarian, "Generalized support vector machines," Comput. Sci. Dept., Univ. Wisconsin, Madison, WI, Tech. Rep. 98-14, 1998.
10. A. Smola and B. Schölkopf, "A tutorial on support vector regression," Stat. Comput., vol. 14, no. 3, pp. 199-222, Aug. 2004.
11. J. C. Platt, "Fast training of support vector machines using sequential minimal optimization," in Advances in Kernel Methods: Support Vector Learning. Cambridge, MA: MIT Press, 1999, pp. 185-208.
12. S. Keerthi, O. Chapelle, and D. DeCoste, "Building support vector machines with reduced classifier complexity," J. Mach. Learn. Res. vol. 7, pp. 1493-1515, Dec. 2006.
13. O. L. Mangasarian, "A finite Newton method for classification," Optim. Methods Softw., vol. 17, no. 5, pp. 913-929, Jan. 2002.
14. O. Chapelle, "Training a support vector machine in the primal," Neural. Comput., vol. 19, no. 5, pp. 1155-1178, 2007.
15. P. J. Huber, "The 1972 Wald lecture robust statistics: A review," Ann. Math. Stat., vol. 43, no. 4, pp. 1041-1067, Aug. 1972.
16. C.-C. Chuang, S.-F. Su, J.-T. Jeng, and C.-C. Hsiao, "Robust support vector regression networks for function approximation with outliers," IEEE Trans. Neural Netw., vol. 13, no. 6, pp. 1322-1330, Nov. 2002.
17. L. Xu, K. Crammer, and D. Schuurmans, "Robust support vector machine training via convex outlier ablation," in Proc. AAAI, 2006, pp. 536-542.
18. J. Zhu, S. C. Hoi, and M. R. Lyu, "A multi-scale Tikhonov regularization scheme for implicit surface modelling," in Proc. Conf. Comput. Vis. Pattern Recog., 2007, pp. 1-7.
19. B. Schölkopf, R. Herbrich, and A. Smola, "A generalized representer theorem," in Proc. NeuroCOLT, 2001, pp. 416-426.
20. C. Saunders, A. Gammerman, and V. Vovk, "Ridge regression learning algorithm in dual variables," in Proc. ICML, 1998, pp. 515-521.
21. S. Boyd and L. Vandenberghe, Convex Optimization. Cambridge, U.K.: Cambridge Univ. Press, 2004.
22. R. M. Neal, "Bayesian learning for neural networks," Ph.D. dissertation, Dept. Comput. Sci., Univ. Toronto, Toronto, ON, Canada, 1995.