Value regularization and fenchel duality

Journal of Machine Learning Research

Volumn 8, Issue , 2007, Pages 441-479

  Rifkin, Ryan M ^a   Lippert, Ross A ^b  

^a Honda R&D Americas Inc   (United States)

^b MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Convex analysis; Duality; Kernel learning; Kernel machines; Optimization

Indexed keywords

ALGORITHMS; APPROXIMATION THEORY; FUNCTION EVALUATION; LOGIC PROGRAMMING; OPTIMIZATION; PROBLEM SOLVING;

CONVEX ANALYSIS; FUNCTION LEARNING; KERNEL LEARNING; KERNEL MACHINES; VALUE REGULARIZATION;

LEARNING SYSTEMS;

EID: 33947245952     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Article

References (35)

1. Yasemin Altun and Alex Smola. Unifying divergence minimization and statistical inference via convex duality. In Proceedings of the 19th Annual Conference on Lwearning Theory, 2006.
2. Yasemin Altun, David McAllester, and Mikhail Belkin. Maximum margin semi-supervised learning for structured variables. In Neural Information Processing Systems, 2005.
3. Andreas Argyriou, Charles A. Micchelli, and Massimiliano Pontil. Learning convex combinations of continuously parametrized basic kernels. In Proceedings of the 18th Annual Conference on Learning Theory, 2005.
4. Nachman Aronszajn. Theory of reproducing kernels. Transactions of the American Mathematical Society, 68:337-404, 1950.
5. Christopher T. H. Baker. The Numerical Treatment of Integral Equations. Clarendon press, 1977.
6. Mokhtar S. Bazaraa, Hanif D. Sherali, and C. M. Shetty. Nonlinear Programming: Theory and Algorithms. Wiley-Interscience, 2nd edition, 1993.
7. Mikhail Belkin and Partha Niyogi. Semi-supervised learning on riemannian manifolds. Machine Learning, 56:209-239, 2003.
8. Mikhail Belkin, Partha Niyogi, and Vikas Sindhwani. Manifold regularization: A geometric framework for learning from examples. Technical Report TR-2004-06, University of Chicago, 2004.
9. Yoshua Bengio, Jean-Francois Paiement, Pascal Vincent, Olivier Delalleau, Nicolas Le Roux, and Marie Ouimet. Out-of-sample extensions for LLE, Isomap, MDS, eigenmaps and spectral clustering. In Neural Information Processing Systems, 2003.
10. Jonathan M. Borwein and Adrian S. Lewis. Convex Analysis and Nonlinear Optimization. CMS Books in Mathematics. Springer, 2000.
11. Scott Shaobing Chen, David L. Donoho, and Michael A. Saunders. Atomic decomposition by basis pursuit. Technical Report 479, Stanford University Department of Statistics, 1995.
12. Corinna Cortes and Vladimir Vapnik. Support vector networks. Machine Learning, 20:1-25, 1995.
13. Nello Cristianini and John Shaw-Taylor. An Introduction To Support Vector Machines. Cambridge University Press, 2000.
14. Miroslav Dudík and Robert E. Schapire. Maximum entropy distribution estimation with generalized regularization. In Proceedings of the 19th Annual Conference on Lwearning Theory, pages 123-138, 2006.
15. Theodoras Evgeniou, Massimiliano Pontil, and Tomaso Poggio. Regularization networks and support vector machines. Advances In Computational Mathematics, 13(1):1-50, 2000.
16. Federico Girosi. An equivalence between sparse approximation and support vecto machines. Neural Computation, 10:1455-1480, 1998.
17. Tommi S. Jaakkola and David Haussler. Probabilistic kernel regression models. In Proceedings of the 1999 Conference on AI and Statistics. Morgan Kaufmann, 1999.
18. Gert R. G. Lanckriet, Nello Cristianini, Peter Bartlett, Laurent El Ghaoui, and Michael I. Jordan. Learning the kernel matrix with semidefinite programming. Journal of Machine Learning Research, 5:24-72, 2004.
19. Zhen Luo and Grace Wahba. Hybrid adaptive splines. Journal of the American Statistical Society, 92:107-116, 1997.
20. Charles A. Micchelli. Interpolation of scattered data: distance matrices and conditionally positive functions. Constructive Approximation, 2(1):11-22, 1986.
21. Tomaso Poggio and Federico Girosi. Networks for approximation and learning. Proceedings of the IEEE, 78(9): 1481-1497, September 1990.
22. Tomaso Poggio, Sayan Mukherjee, Ryan M. Rifkin, Alex Rakhlin, and Alessandro Verri. b. In Proceedings of the Conference on Uncertainty in Geometric Computations, 2001.
23. Ali Rahimi, Benjamin Recht, and Trevor Darrell. Learning appearance manifolds from video. In Computer Vision and Pattern Recognition, 2005.
24. Carl Edward Rasmusen and Chris Williams. Gaussian Processes for Machine Learning. MIT Press, 2006.
25. Ben Recht. Unpublished phd thesis. 2006.
26. Ryan M. Rifkin. Everything Old Is New Again: A Fresh Look at Historical Approaches to Machine Learning. PhD thesis, Massachusetts Institute of Technology, 2002.
27. R. Tyrrell Rockafellar and Roger J. B. Wets. Variational Analysis. Springer, Berlin, 2004.
28. Bernhard Schölkopf, Ralf Herbrich, and Alex J. Smola. A generalized representer theorem. In 14th Annual Conference on Computational Learning Theory, pages 416-426, 2001.
29. Vikas Sindhwani, Partha Niyogi, and Mikhail Belkin. Beyond the point cloud: from transductive to semi-supervised learning. In Proceedings of the 22nd International Conference on Machine Learning, 2005.
30. Johan A. K. Suykens, Tony Van Gestel, Jos De Brabanter, Bart De Moor, and Joos Vandewalle. Least Squares Support Vector Machines. World Scientific, 2002.
31. Andrei N. Tikhonov and Vasilii Y. Arsenin. Solutions of Ill-posed problems. W. H. Winston, Washington D.C., 1977.
32. Vladimir Vapnik. Statistical Learning Theory. John Wiley & Sons, 1998.
33. Grace Wahba. Spline Models for Observational Data, volume 59 of CBMS-NSF Regional Conference Series in Applied Mathematics. Society for Industrial & Applied Mathematics, 1990.
34. Christopher K. I. Willams and Matthias Seeger. Using the Nyström method to speed up kernel machines. In Advances in Neural Information Processing Systems, 2000.
35. Ji Zhu, Saharon Rosset, Trevor Hastie, and Rob Tibshirani. 1-norm support vector machines. In Neural Information Processing Systems, 2003.