Relaxed clipping: A global training method for robust regression and classification

Advances in Neural Information Processing Systems 23: 24th Annual Conference on Neural Information Processing Systems 2010, NIPS 2010

Volumn , Issue , 2010, Pages

  Yu, Yaoliang ^a   Yang, Min ^a   Xu, Linli ^a   White, Martha ^a   Schuurmans, Dale ^a  

^a UNIVERSITY OF ALBERTA   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; REGRESSION ANALYSIS;

GENERIC PROCEDURES; LOSS FUNCTIONS; NON-CONVEX LOSS FUNCTION; ROBUST CLASSIFICATION; ROBUST REGRESSIONS; TRAINING METHODS;

STATISTICS;

EID: 85162048991     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (31)

1. A. Banerjee, S. Merugu, I. Dhillon, and J. Ghosh. Clustering with Bregman divergences. Journal of Machine Learning Research, 6:1705-1749, 2005.
2. M. Black and A. Rangarajan. On the unification of line processes, outlier rejection, and robust statistics with applications in early vision. International Journal of Computer Vision, 19(1):57-91, 1996.
3. O. Bousquet and A. Elisseeff. Stability and generalization. J. of Machine Learning Research, 2, 2002.
4. S. Boyd and L. Vandenberghe. Convex Optimization. Cambridge U. Press, 2004.
5. A. Christmann and I. Steinwart. On robustness properties of convex risk minimization methods for pattern recognition. Journal of Machine Learning Research, 5:1007-1034, 2004.
6. A. Christmann and I. Steinwart. Consistency and robustness of kernel-based regression in convex risk minimization. Bernoulli, 13(3):799-819, 2007.
7. M. Collins, R. Schapire, and Y. Singer. Logistic regression, AdaBoost and Bregman distances. Machine Learning, 48, 2002.
8. Y. Freund. A more robust boosting algorithm, 2009. arXiv.org:0905.2138.
9. Y. Freund and R. Schapire. A decision-theoretic generalization of on-line learning and an application to boosting. Journal of Computer and Systems Sciences, 55(1):119-139, 1997.
10. G. Golub and C. Van Loan. Matrix Computations. Johns Hopkins U. Press, 1996.
11. F. Hampel, E. Ronchetti, P. Rousseeuw, and W. Stahel. Robust Statistics: The Approach Based on Influence Functions. Wiley, 1986.
12. T. Hastie, R. Tibshirani, and J. Friedman. Elements of Statistical Learning. Springer, 2nd edition, 2009.
13. P. Huber and E. Ronchetti. Robust Statistics. Wiley, 2nd edition, 2009.
14. J. Kivinen and M. Warmuth. Relative loss bounds for multidimensional regression problems. Machine Learning, 45:301-329, 2001.
15. N. Krause and Y. Singer. Leveraging the margin more carefully. In Proceedings of the International Conference on Machine Learning (ICML), 2004.
16. P. Long and R. Servedio. Random classification noise defeats all convex potential boosters. Machine Learning, 78:287-304, 2010.
17. R. Maronna, R.D. Martin, and V. Yohai. Robust Statistics: Theory and Methods. Wiley, 2006.
18. H. Masnadi-Shirazi and N. Vasconcelos. On the design of loss functions for classification: theory, robustness to outliers, and SavageBoost. In Advances in Neural Information Processing Systems (NIPS), volume 21, pages 1049-1056, 2008.
19. L. Mason, J. Baxter, P. Bartlett, and M. Frean. Functional gradient techniques for combining hypotheses. In Advances in Large Margin Classifiers. MIT Press, 2000.
20. Y. Nesterov. Introductory Lectures on Convex Optimization. Kluwer, 1994.
21. M. Overton and R. Womersley. Optimality conditions and duality theory for minimizing sums of the largest eigenvalues of symmetric matrices. Mathematical Programming, 62(2):321-357, 1993.
22. R. Rockafellar. Convex Analysis. Princeton U. Press, 1970.
23. P. Rousseeuw and A. Leroy. Robust Regression and Outlier Detection. Wiley, 1987.
24. B. Schoelkopf and A. Smola. Learning with Kernels. MIT Press, 2002.
25. X. Shen, G. Tseng, X. Zhang, and W.-H. Wong. On -learning. Journal of the American Statistical Association, 98(463):724-734, 2003.
26. C. Stewart. Robust parameter estimation in computer vision. SIAM Review, 41(3), 1999.
27. Y. Wu and Y. Liu. Robust truncated hinge loss support vector machines. Journal of the American Statistical Association, 102(479):974-983, 2007.
28. H. Xu, C. Caramanis, and S. Mannor. Robust regression and Lasso. In Advances in Neural Information Processing Systems (NIPS), volume 21, pages 1801-1808, 2008.
29. H. Xu, C. Caramanis, and S. Mannor. Robustness and regularization of support vector machines. Journal of Machine Learning Research, 10:1485-1510, 2009.
30. L. Xu, K. Crammer, and D. Schuurmans. Robust support vector machine training via convex outlier ablation. In Proceedings of the National Conference on Artificial Intelligence (AAAI), 2006.
31. J. Yu, S. Vishwanathan, S. Günter, and N. Schraudolph. A quasi-Newton approach to nonsmooth convex optimization problems in machine learning. J. of Machine Learning Research, 11:1145-1200, 2010.