Optimization problems in statistical learning: Duality and optimality conditions

European Journal of Operational Research

Volumn 213, Issue 2, 2011, Pages 395-404

  Boţ, Radu Ioan ^a   Lorenz, Nicole ^a  

^a CHEMNITZ UNIVERSITY OF TECHNOLOGY   (Germany)

Author keywords

Convex duality theory; Machine learning; Optimality conditions; Tikhonov regularization

Indexed keywords

CONJUGATE DUALITY; CONVEX ANALYSIS; CONVEX DUALITY; CONVEX OPTIMIZATION PROBLEMS; GENERAL APPROACH; LEARNING FUNCTIONS; MACHINE-LEARNING; OBJECTIVE FUNCTIONS; OPTIMALITY CONDITIONS; OPTIMIZATION PROBLEMS; OVERFITTING; PREDICTION FUNCTION; REGULARIZATION METHODS; REGULARIZER; STATISTICAL LEARNING; SUFFICIENT OPTIMALITY CONDITIONS; SUPPORT VECTOR REGRESSIONS; TIKHONOV REGULARIZATION;

CONVEX OPTIMIZATION; OPTIMIZATION;

COST FUNCTIONS;

EID: 79955894377     PISSN: 03772217     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ejor.2011.03.021     Document Type: Article

References (25)

1. N. Aronszajn Theory of reproducing kernels Transactions of the American Mathematical Society 686 1950 337 404
2. M. Bertero Regularization methods for linear inverse problems C.G. Talenti, Inverse Problems vol. 1225 1986 Springer-Verlag Berlin 52 112
3. M. Bertero, T.A. Poggio, V. Torre, Ill-posed problems in early vision, in: Proceedings of the IEEE, 76(8) 1988, pp. 869-889.
4. R.I. Bo, S.M. Grad, and G. Wanka New constraint qualification and conjugate duality for composed convex optimization problems Journal of Optimization Theory and Applications 135 2007 241 255
5. O. Chapelle Training a support vector machine in the primal Neutral Computation 19 2007 1155 1178
6. F.H. Clarke, Optimization and Nonsmooth Analysis, Canadian Mathematical Society Series of Monographs and Advanced Texts, New York, 1983.
7. C. Cortes, and V.N. Vapnik Support vector networks Machine Learning 20 1995 1 25
8. T. Evgeniou, M. Pontil, and T. Poggio Regularization networks and support vector machines Advances in Computational Mathematics 13 1 1999 1 50
9. J.-B. Hiriart-Urruty, and C. Lemaréchal Fundamentals of Convex Analysis 2004 Springer-Verlag Berlin Heidelberg
10. B.S. Mordukhovich Variational analysis and generalized differentiation, I. Basic Theory and II. Applications Series of Comprehensive Studies in Mathematics vol. 1693 2006 Springer-Verlag Berlin Heidelberg
11. Y. Nesterov Smooth minimization of non-smooth functions Mathematical Programming 103 1 2005 127 152 (Pubitemid 40537674)
12. Y. Nesterov Primal-dual subgradient methods for convex problems Mathematical Programming 120 1 2009 221 259
13. R.M. Rifkin, Everything Old is New Again: A Fresh Look at Historical Approaches in Machine Learning. Ph.D. thesis, Massachusetts Institute of Technology, 2002.
14. R.M. Rifkin, and R.A. Lippert Value regularization and Fenchel duality Journal of Machine Learning Research 8 2007 441 479 (Pubitemid 46434119)
15. R.T. Rockafellar Convex Analysis 1970 Princeton University Press
16. B. Schölkopf, and A. Smola Learning with Kernels 2002 The MIT Press Cambridge
17. S. Simons From Hahn-Banach to monotonicity Lecture Notes in Mathematics vol. 1 2008 Springer-Verlag Berlin Heidelberg
18. A. Smola, B. Schölkopf, K.-R. Müller, General cost functions for support vector regression, in: T. Downs, M. Frean, M. Gallagher (Eds.), Proceedings of the Ninth Australian Conference on Neural Networks Series, Brisbane, Australia, 1998, pp. 79-83.
19. J. Shawe-Taylor, and N. Cristianini Kernel Methods for Pattern Analysis 2004 Cambridge University Press
20. A.N. Tikhonov, V.Y. Arsenin, Solutions of Ill-posed Problems, W.H. Winston, Washington, D.C.; 1977.
21. V.N. Vapnik Estimation of Dependences Based on Empirical Data 1982 Springer-Verlag Berlin
22. V.N. Vapnik The Nature of Statistical Learning Theory 1995 Springer-Verlag New York
23. V.N. Vapnik Statistical Learning Theory 1998 Wiley New York
24. M. Vogt, SMO Algorithms for Support Vector Machines without bias. Institute Report, Institute of Automatic Control, TU Darmstadt, Darmstadt, Germany, 2002.
25. G. Wahba, Spline models for observational data, Series in Applied Mathematics, vol. 59, SIAM, 1990.