The interplay of optimization and machine learning research

Journal of Machine Learning Research

Volumn 7, Issue , 2006, Pages 1265-1281

  Bennett, Kristin P ^a   Parrado Hernández, Emilio ^b  

^a Research Rensselaer Polytechnic Institute   (United States)

^b UNIVERSIDAD CARLOS III DE MADRID   (Spain)

Author keywords

Convex optimization; Machine learning; Mathematical programming

Indexed keywords

ALGORITHMS; MATHEMATICAL MODELS; MATHEMATICAL PROGRAMMING; OPTIMIZATION; PROBLEM SOLVING; QUADRATIC PROGRAMMING; RESEARCH; ROBUSTNESS (CONTROL SYSTEMS);

COMPUTATIONAL TIME; CONVEX OPTIMIZATION; LARGE SCALE OPTIMIZATION; OPTIMIZATION CODES;

LEARNING SYSTEMS;

EID: 33745780323     PISSN: 15337928     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Article

References (47)

1. F. R. Bach, G. R. Lanckriet, and M. I. Jordan. Multiple kernel learning, conic duality, and the SMO algorithm. In Proceedings of the Twenty-first International Conference on Machine Learning, 2004.
2. M. Bazaraa, H. Sherali, and C. Shetty. Nonlinear Programming Theory and Algorithms. Wiley, 2006.
3. K. P. Bennett and O. L. Mangasarian. Bilinear separation of two sets in n-space. Computational Optimization & Applications, 2:207-227, 1993.
4. A. Bergkvist, P. Damaschke, and M. Lüthi. Linear programs for hypotheses selection in probabilistic inference models. Journal of Machine Learning Research, 7:1339-1355, 2006.
5. D. P. Bertsekas. Nonlinear Programming. Athena Scientific, Cambridge, 2004.
6. C. Bishop. Neural Networks for Pattern Recognition. Oxford University Press, Oxford, 1996.
7. S. Boyd and L. Vandenberghe. Convex Optimization. Cambridge University Press, Cambridge, 2004.
8. P. S. Bradley and O. L. Mangasarian. Feature selection via concave minimization and support vector machines. In J. Shavlik, editor, Machine Learning Proceedings of the Fifteenth International Conference(ICML '98), pages 82-90, San Francisco, California, 1998. Morgan Kaufmann.
9. P. S. Bradley, O. L. Mangasarian, and W. N. Street. Clustering via concave minimization. In M. C. Mozer, M. I. Jordan, and T. Petsche, editors, Advances in Neural Information Processing Systems -9-, pages 368-374, Cambridge, MA, 1997. MIT Press.
10. C. Cortes and V. Vapnik. Support-vector networks. Machine Learning, 20(3):273-297, 1995.
11. T. De Bie and N. Cristianini. Fast SDP relaxations approaches of graph cut clustering, transduction and other combinatorial problems. Journal of Machine Learning Research, 7:1409-1436, 2006.
12. A. Dempster, N. Laird, and D. Rubin. Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society, Series B, 39(1): 1-38, 1977.
13. E. Dolan and J. Moré. Benchmarking optimization software with performance profiles. Mathematical Programming, 91(2):201-213, 2002.
14. R.-E. Fan, P.-H. Chen, and C.-J. Lin. Working set selection using second order information for training support vector machines. Journal of Machine Learning Research, 5(Dec): 1889-1918, 2005.
15. G. Fung and O. L. Mangasarian. A feature selection newton method for support vector machine classification. Computational Optimization and Applications, 28(2): 185-202, 2004.
16. T. Glasmachers and C. Igel. Maximum-gain working set selection for SVMs. Journal of Machine Learning Research, 7:1437-1466, 2006.
17. M. A. Goberna and M. A. López. Linear Semi-Infinite Optimization. John Wiley, New York, 1998.
18. G. H. Golub and U. von Matt. Generalized cross-validation for large scale problems. Journal of Computational and Graphical Statistics, 6(1): 1-34, 1997.
19. M. Heiler and C. Schnörr. Learning sparse representations by non-negative matrix factorization and sequential cone programming. Journal of Machine Learning Research, 7:1385-1407, 2006.
20. R. Hettich and K. O. Kortanek. Semi-infinite programming: theory, methods and application. SIAM Review, 3:380-429, 1993.
21. T. Joachims. Making large-scale SVM learning practical. In B. Schölkopf, C. Surges, and A. Smola, editors, Advances in Kernel Methods - Support Vector Learning, pages 169 -184. MIT Press, Cambridge, MA, 1999.
22. S. S. Keerthi, O. Chapelle, and D. DeCoste. Building support vector machines with reduced classifier complexity. Journal of Machine Learning Research, 7:1493-1515, 2006.
23. P. Laskov, C. Gehl, S. Krüger, and K.-R. Müller. Incremental support vector learning: Analysis, implementation and applications. Journal of Machine Learning Research, 1, 2006. To appear.
24. O. L. Mangasarian. Exact 1-norm support vector machines via unconstrained convex differentiable minimization. Journal of Machine Learning Research, 7:1517-1530, 2006.
25. O. L. Mangasarian and D. Musicant. Success overrelaxation for support vector machines. IEEE Transaction on Neural Networks, 10(5): 1032-1037, 1999.
26. O. L. Mangasarian and M. V. Solodov. Serial and parallel backpropagation convergence via non-monotone perturbed minimization. Optimization Methods and Software, 4(2): 103-116, 1994.
27. H.D. Mittelmann. An independent benchmarking of SDP and SOCP solvers. Mathematical Programming, 95(2):407-430, 2003.
28. G. Nemhauser and L. Wolsey. Integer and Combinatorial Optimization. Wiley, 1999.
29. Y. Nesterov. Dual extrapolation and its application to solving variational inequalities and related problems. Core, Catholic University of Louven, 2003.
30. R. S. Niculescu, T. M. Mitchell, and R. B. Rao. Bayesian network learning with parameter constraints. Journal of Machine Learning Research, 7:1357-1383, 2006.
31. J. Nocedal and S. J. Wright. Numerical Optimization. Springer, New York, 1999.
32. J. C. Platt. Fast training of support vector machines using sequential minimal optimization. In B. Schlkopf, C. Burges, and A. Smola, editors, Advances in Kernel Methods - Support Vector Learning, pages 185-208. MIT Press, Cambridge, MA, USA, 1999.
33. R. L. Radin. Optimization in Operations Research. Prentice-Hall, New Jersey, 1998.
34. R. Reemtsen and J. J. Ruckmann. Semi-infinite programming. Kluwer Academic, 1998.
35. R. Rifkin and A. Klautau. In defense of one-vs-all classification. Journal of Machine Learning Research, 5(Jan): 101-141, 2004.
36. J. Rousu, C. Saunders, S. Szedmak, and J. Shawe-Taylor. Kernel-based learning of hierarchical multilabel classification models. Journal of Machine Learning Research, 7:1601-1626, 2006.
37. D. Rummelhart, G. Hinton, and R. Williams. Learning internal representations by error propagation. In D. Rummelhart and J. McClelland, editors, Parallel Distributed Processing, pages 318-362, Cambridge, 1986. MIT Press.
38. K. Scheinberg. An efficient implementation of an active set method for SVM. Journal of Machine Learning Research, 7, 2006. To appear.
39. S. Shalev-Shwartz and Y Singer. Efficient learning of label ranking by soft projections onto polyhedra. Journal of Machine Learning Research, 7:1567-1599, 2006.
40. P. K. Shivaswamy, C. Bhattacharyya, and A. J. Smola. Second order cone programming approaches for handling missing and uncertain data. Journal of Machine Learning Research, 7:1283-1314, 2006.
41. S. Sonnenburg, G. Rätsch, C. Schäfer, and B. Schölkopf. Large scale multiple kernel learning. Journal of Machine Learning Research, 7:1531-1565, 2006.
42. B. Taskar, V. Chatalbashev, D. Koller, and C. Guestrin. Learning structured prediction models: a large margin approach. In International Conference on Machine Learning, 2005.
43. B. Taskar, C. Guestrin, V. Chatalbashev, and D. Koller. Max-margin markov networks. Journal of Machine Learning Research, 2006a. To appear.
44. B. Taskar, S. Lacoste-Julien, and M. Jordan. Structured prediction, dual extragradient and Bregman projections. Journal of Machine Learning Research, 7:1627-1653, 2006b.
45. C. Yanover, T. Meltzer, and Y. Weiss. Linear programming relaxations and belief propagation- an empirical study. Journal of Machine Learning Research, 1, 2006. To appear.
46. L. Zanni, T. Serafini, and G. Zanghirati. Parallel software for training large scale support vector machines on multiprocessor systems. Journal of Machine Learning Research, 7:1467-1492, 2006.
47. Y. Zhang, S. Burer, and W. N. Street. Ensemble pruning via semi-definite programming. Journal of Machine Learning Research, 7:1315-1338, 2006.