Robust support vector regression networks for function approximation with outliers

IEEE Transactions on Neural Networks

Volumn 13, Issue 6, 2002, Pages 1322-1330

  Chuang, Chen Chia ^a   Su, Shun Feng ^b   Jeng, Jin Tsong ^c   Hsiao, Chih Ching ^b  

^a HWA HSIA INSTITUTE OF TECHNOLOGY   (Taiwan)

^b NATIONAL TAIWAN UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Taiwan)

^c NATIONAL FORMOSA UNIVERSITY   (Taiwan)

Author keywords

Outliers; Robust learning; Support vector regression (SVR)

Indexed keywords

COMPUTER SIMULATION; ERROR ANALYSIS; ESTIMATION; LEARNING SYSTEMS; PATTERN RECOGNITION; PROBLEM SOLVING;

SUPPORT VECTOR MACHINES (SVM);

NEURAL NETWORKS;

EID: 0036856978     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2002.804227     Document Type: Article

References (36)

1. C. Cortes and V. Vapnik, "Support vector networks," Machine Learning, vol. 20, pp. 273-297, 1995.
2. V. Vapnik, The Nature of Statistical Learning Theory. New York: Springer-Verlag, 1995.
3. C.J.C. Burges, "A tutorial on support vector machines for pattern recognition," Data Mining Knowledge Discovery, vol. 2, no. 2, 1996.
4. B. Schölkopf et al., "Comparing support vector machines with Gaussian kernels to radial basis function classifiers," IEEE Trans. Signal Processing, vol. 45, pp. 2758-2765, Nov. 1997.
5. B. Boser, I. Guyon, and V. Vapnik, "A training algorithm for optimal margin classifiers," presented at the 5th Annu. Workshop Comput. Learning Theory, 1992.
6. S. Mukherjee, E. Osuna, and F. Girosi, "Nonlinear prediction of chaotic time series using a support vector machine," in Proc. NNSP, 1997, pp. 24-26.
7. H. Drucker et al., "Support vector regression machines," in Neural Information Processing Systems. Cambridge, MA: MIT Press, 1997, vol. 9.
8. V. Vapnik, S. Gotowich, and A.J. Smola, "Support vector method for function approximation, regression estimation, and signal processing," in Neural Information Processing Systems. Cambridge, MA: MIT Press, 1997, vol. 9.
9. A.J. Smola and B. Schölkopf, "A tutorial on support vector regression," Royal Holloway College, London, U.K., Neuro COLT Tech. Rep. TR-1998-030, 1998.
10. A.J. Smola, B. Schölkopf, and K.R. Müller, "General cost functions for support vector regression," presented at the ACNN, Australian Congr. Neural Networks, 1998.
11. A.J. Smola, "Regression estimation with support vector learning machines," Master's thesis, Technical Univ. Munchen, Munich, Germany, 1998.
12. D.M. Hawkins, Identification of Outliers. London, U.K.: Chapman and Hall, 1980.
13. D.S. Chen and R.C. Jain, "A robust back-propagation learning algorithm for function approximation," IEEE Trans. Neural Networks, vol. 5, pp. 467-479, May 1994.
14. C.-C. Chuang, S.-F. Su, and C.-C. Hsiao, "The annealing robust backpropagation (ARBP) learning algorithm," IEEE Trans. Neural Networks, vol. 11, pp. 1067-1077, Sept. 2000.
15. F.E.H. Tay and L. Cao, "Application of support vector machines in financial time series forecasting," in Int. J. Manage. Sci., 2001, pp. 309-317.
16. J.A.K. Suykens, J. De Brabanter, L. Lukas, and J. Vandewalle, "Weighted least squares support vector machines: Robustness and sparse approximation," Neurocomput., 2001, to be published.
17. J.T. Connor, R.D. Martin, and L.E. Atlas, "Recurrent neural networks and robust time series prediction," IEEE Trans. Neural Networks, vol. 5, pp. 240-254, Mar. 1994.
18. K. Liano, "Robust error measure for supervised neural network learning with outliers," IEEE Trans. Neural Networks, vol. 7, pp. 246-250, Jan. 1996.
19. V. David and A. Sanchez, "Robustization of learning method for RBF networks," Neurocomput., vol. 9, pp. 85-94, 1995.
20. C. Wang, H.C. Wu, and J.C. Principe, "A cost function for robust estimation of PCA," Proc. SPIE, vol. 2760, pp. 120-127, 1996.
21. L. Huang, B.L. Zhang, and Q. Huang, "Robust interval regression analysis using neural network," Fuzzy Sets Syst., pp. 337-347, 1998.
22. P.J. Rousseeuw and M.A. Leroy, Robust Regression and Outlier Detection. New York: Wiley, 1987.
23. P.J. Huber, Robust Statistics. New York: Wiley, 1981.
24. C. GriffinM. Kendall and A. Stuart, The Advanced Theory of Statistics, A. Stuart, Ed., 1977.
25. P.L. Bartlett, "For valid generalization, the size of the weights is more important than the size of the network," in Advances in Neural Information Processing Systems, -AUTHOR, PLEASE LIST FIRST INITIALS-Mozer, Jordan, and Petshe, Eds. Cambridge, MA: MIT Press, 1997, vol. 9, pp. 134-140.
26. S. Lawrence, C.L. Giles, and A.C. Tsoi. (1996) What size neural network gives optimal generalization? Convergence properties of backpropagation. Univ. Maryland, College Park. [Online]UMIACS-TR-96-22, Tech. Rep. Available: http://www, neci.nj.com/homepages/lawrence/papers/minima-tr96/minima-tr96.html.
27. M. Smith, Neural Networks for Statistical Modeling. New York: Van Nostrand Reinhold, 1993.
28. W.S. Sarle, "Stopped training and other remedies for overfitting," in Proc. 27th Symp. Interface Comput. Sci. Statist., 1995, pp. 352-360.
29. V. Vapnik, Estimation of Dependences Based on Empirical Data. New York: Springer-Verlag, 1982.
30. R.O. Duda and P.E. Hart, Pattern Classification and Scene Analysis. New York: Wiley, 1973.
31. A.J. Smola and B. Schölkopf, "From regularization operators to support vector kernels," in Neural Information Processing Systems. Cambridge, MA: MIT Press, 1997, vol. 9.
32. _, (1988) On a kernel-based method for pattern recognition, regression, approximation and operator inversion. Algorithmica [Online]. Available: http://svm.first.gmd.de/papers.html.
33. M.A. Aizerman, E.M. Braverman, and L.I. Rozonoér, "Theoretical foundations of the potential function method in pattern recognition learning," Automat. Remote Contr., pp. 821-837, 1964.
34. K. Duan, S.S. Keerthi, and A.N. Poo, "Evaluation of simple performance measures for tuning SVM hyperparameters," Nat. Univ. Singapore, Tech. Rep. CD-01-11, 2001.
35. S.R. Gunn. (1999) Support vector regression-Matlab toolbox. Univ. Southampton, Southampton, U.K. [Online]. Available: http://kernel-machines.org.
36. C.-C. Chuang, "Robust modeling for function approximation under outliers," Ph.D. dissertation, Dept. Electr. Eng., Nat. Taiwan Univ. Sci. Technol., Taipei, 2000.