Robust linear and support vector regression

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 22, Issue 9, 2000, Pages 950-955

  Mangasarian, Olvi L ^a   Musicant, David R ^a  

^a University of Wisconsin Madison   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; LEAST SQUARES APPROXIMATIONS; LINEAR PROGRAMMING; MATHEMATICAL MODELS; MATRIX ALGEBRA; MAXIMUM LIKELIHOOD ESTIMATION; PERTURBATION TECHNIQUES; QUADRATIC PROGRAMMING; VECTOR QUANTIZATION;

HUBER M-ESTIMATOR; KERNEL METHODS; REGRESSION; SUPPORT VECTOR MACHINES;

PATTERN RECOGNITION;

EID: 0034266838     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/34.877518     Document Type: Article

References (35)

1. "Adult Dataset," U.S. Census Bureau, publicly available from: www. sgi. com/Technology/mlc/dbJ.
2. V. Cherkassky and F. Mulier, Learning from Data-Concepts, Theory, and Methods. New York: John Wiley & Sons, 1998.
3. D.I. Clark and M.R. Osborne"Finite Algorithms for Huber's M-Estimator," SIAM ]. Scientific and Statistical Computing, vol. 7, pp. 72-85, 1986.
4. N. Cristianini and J. Shawe-Taylor, An Introduction to Support Vector Machines. Cambridge: Cambridge Univ. Press, 2000.
5. "Delve Data for Evaluating Learning in Valid Experiments," http://www. cs. utoronto. ca/~delveJ.
6. H. Ekblom"A New Algorithm for the Huber Estimator in Linear Models," BIT, vol. 28, pp. 123-132, 1988.
7. D. Gale, The Theory of Linear Economic Models. New York: McGrawHill, 1960.
8. P.W. Holland and R.E. Welsch"Robust Regression Using Iteratively Reweighted Least Squares," Comm. Statistics-Theory and Methods, vol. A6, pp. 813-827, 1977.
9. P.J. Huber, Robust Statistics. New York: John Wiley, 1981.
10. P.J. Huber and R. Dutter"Numerical Solution of Robust Regression Problems," Proc. Symp. Computational Statistics, G. Brushmann, éd., pp. 165-172, 1974.
11. /LOG CPLEX 6. 5 Reference Manual, ILOG CPLEX Division, Incline Village, Nev., 1999
12. W. Li"Numerical Estimates for the Huber M-Estimator Problem," Approximation Theory VIII, C.K. Chui and L.L. Schumaker, eds., pp. 325-334, New York: World Scientific Publishing, 1995.
13. W. Li and J.J. Swetits"The Linear i Estimator and the Huber MEstimator," SIAM J. Optimization, vol. 8, pp. 457-475, 1998.
14. K. Madsen and H.B. Nielsen"Finite Algorithms for Robust Linear Regression," BIT, vol. 30, pp. 682-699, 1990.
15. O.L. Mangasarian, Nonlinear Programming. Philadelphia: SIAM, 1994.
16. O.L. Mangasarian"Generalized Support Vector Machines," Advances in Large Margin Classifiers, A. Smola, P. Bartlett, B. Schölkopf, and D. Schuurmans, eds., pp. 135-146, Cambridge, Mass: MIT Press, 2000. ftp://ftp.cs.wisc.edu/math-prog/tech-reports/98-14.ps.
17. O.L. Mangasarian and R.R. Meyer"Nonlinear Perturbation of Linear Programs," SIAM J. Control and Optimization, vol. 17, 6, pp. 745-752, Nov. 1979.
18. O.L. Mangasarian and D.R. Musicant"Data Discrimination via Nonlinear Generalized Support Vector Machines," Technical Report 99-03, Computer Sciences Dept., Univ. Wisconsin, Madison, Mar. 1999. To appear in: Applications and Algorithms of Complementarity, M.C. Ferris, O.L. Mangasarian, and J.-S. Pang, eds., Boston: Kluwer Academic Publishers, 2000. ftp://ftp.cs.wisc.edu/ math-prog/tech-reports/99-03. ps.
19. O.L. Mangasarian and D.R. Musicant"Massive Support Vector Regression," Technical Report 99-02, Data Mining Institute, Computer Sciences Dept., Univ. Wisconsin, Madison, July 1999. ftp://ftp.cs.wisc.edu/pub/dmi/tech-reports/99-02.ps.
20. O.L. Mangasarian and T.-H. Shiau"Lipschitz Continuity of Solutions of Linear Inequalities, Programs and Complementarity Problems," SIAM J. Control and Optimization, vol. 25, 3, pp. 583595, May 1987.
21. "MATLAB," User's Guide, Natick, Mass.: The Math Works, Inc., 1992.
22. "MATLAB," Application Program Interface Guide, Natick, Mass.: The MathWorks, Inc., 1997.
23. C. Michelot and M.L. Bougeard"Duality Results and Proximal Solutions of the Huber M-Estimator Problem," Applied Math, and Optimization, vol. 30, pp. 203-221, 1994.
24. P.M. Murphy and D.W. Aha"UCI Repository of Machine Learning Databases," 1992. www.ics.uci.edu/~mlearn/MLRepository.html.
25. B.T. Polyak, Introduction to Optimization, Optimization Software, Inc., New York: Publications Division, 1987.
26. B. Schölkopf, P. Bartlett, A. Smola, and R. Williamson"Support Vector Regression with Automatic Accuracy Control," Proc. Eighth Int'l Conf. Artificial Neural Networks, L. Niklasson, M. Boden, and T. Ziemke, eds., pp. 111-116, 1998. http://svm.first.gmd.de.
27. B. Schölkopf, P. Bartlett, A. Smola, and R. Williamson"Shrinking the Tube: A New Support Vector Regression Algorithm," technical report, GMD FIRST, Berlin, Germany, 1999. http://svm.first.gmd.de.
28. D.F. Shanno and D.M. Rocke"Numerical Methods for Robust Regression: Linear Models." SIAM ]. Scientific and Statistical Computing, vol. 7, pp. 86-97, 1986.
29. A. Smola"Regression Estimation with Support Vector Learning Machines," master's thesis, Technische Universität München, München, Germany, 1996.
30. A. Smola, B. Schölkopf, and G. Ratsch"Linear Programs for Automatic Accuracy Control in Regression," technical report, GMD FIRST, Berlin, Germany, 1999. http://svm.first.gmd.deJ.
31. A.J. Smola"Learning with Kernels," PhD thesis, Technische Universität Berlin, Germany, 1998.
32. W.N. Street and O.L. Mangasarian"Improved Generalization via Tolerant Training," J. Optimization Theory and Applications, vol. 96, 2, pp. 259-279, Feb. 1998. ftp://ftp.cs.wisc.edu/math-prog/tech-reports/95-ll.ps.
33. V.N. Vapnik, The Nature of Statistical Learning Theory. New York: Springer, 1995.
34. S.J. Wright"Using Complementarity and Optimization Methods in Statistics," Proc. Int'l Conf. Complementarity Problems, June 1999.
35. S.J. Wright"On Reduced Convex QP Formulations of Monotone LCP Problems," Technical Report ANL/MCS-P808-0400, Argonne Nat'1 Laboratory, Apr. 2000.