Spectral algorithms for supervised learning

Neural Computation

Volumn 20, Issue 7, 2008, Pages 1873-1897

  Gerfon, Lo ^a   Rosasco, L ^b   Odone, F ^a   De Vito, E ^a   Verri, A ^a  

^a UNIVERSITY OF GENOA   (Italy)

^b Istituto Nazionale di Fisica Nucleare ^*

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; COMPARATIVE STUDY; DATA BASE; REGRESSION ANALYSIS; TIME;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; DATABASES AS TOPIC; LEAST-SQUARES ANALYSIS; REGRESSION ANALYSIS; TIME FACTORS;

EID: 47049125350     PISSN: 08997667     EISSN: 1530888X     Source Type: Journal    
DOI: 10.1162/neco.2008.05-07-517     Document Type: Article

References (40)

1. Aronszajn, N. (1950). Theory of reproducing kernels, Trans. Amer. Math. Soc, 68, 337-404.
2. Bartlett, P. L., Jordan, M. I., & McAuliffe, J. D. (2006). Convexity, classification, and risk bounds. J. Amer. Statist. Assoc, 101(473), 138-156.
3. Bauer, F., Pereverzev, S., & Rosasco, L. (2007). On regularization algorithms in learning theory, Journal of Complexity, 1, 52-72.
4. Bertero, M., & Boccacci, P. (1998). Introduction to inverse problems in imaging. Bristol: IOP Publishing.
5. Bousquet, O., & Elisseeff, A. (2002). Stability and generalization. Journal of Machine Learning Research, 2, 499-526.
6. 2-loss: Regression and classification. journal of American Statistical Association, 98, 324-340.
7. Caponnetto, A. (2006). Optimal rates for regularization operators in learning theory (Tech. Rep. CBCL Paper 264/CSAIL-TR 2006-062). Cambridge, MA: MIT. Available online at http://cbcl.mit.edu/projects/cbcl/publications/ps/ MIT-CSAIL-TR-2006-062.pdf.
8. Caponnetto, A., & De Vito, E. (2007). Optimal rates for regularized least-squares algorithm. Found. Comput. Math., 3, 331-368.
9. Chapelle, O., Weston, J., & Scholkopf, B. (2003). Cluster kernels for semisupervised learning. In S. Becker, S. Thrün, & K. Obermayer (Eds.), Neural information processing systems, 15 (pp. 585-592). Cambridge, MA: MIT Press.
10. De Vito, E., Caponnetto, A., & Rosasco, L. (2005). Model selection for regularized least-squares algorithm in learning theory. Found. Comput. Math., 5(1), 59-85.
11. De Vito, E., Rosasco, L., & Caponnetto, A. (2006). Discretization error analysis for Tikhonov regularization. Anal. Appl, 4(1), 81-99.
12. De Vito, E., Rosasco, L., Caponnetto, A., De Giovannini, U., & Odone, F. (2005). Learning from examples as an inverse problem. Journal of Machine Learning Research, 6, 883-904.
13. De Vito, E., Rosasco, L., & Verri, A. (2005). Spectral methods for regularization in learning theory (Tech. Rep.). DISI, Università degli Studi di Genova, Italy.
14. Engl, H. W., Hanke, M., & Neubauer, A. (1996). Regularization of inverse problems. Dordrecht: Kluwer Academic.
15. Evgeniou, T., Pontil, M., & Poggio, T. (2000). Regularization networks and support vector machines. Adv. Comp. Math., 13, 1-50.
16. Girosi, E., Jones, M., & Poggio, T. (1995). Regularization theory and neural networks architectures. Neural Computation, 7(2), 219-269.
17. Golub, G. H., & Van Loan, C. F. (1996). Matrix computations (3rd ed.). Baltimore, MD: Johns Hopkins University Press.
18. Hastie, S. T., Rosset, S., Tibshirani, R., & Zhu, J. (2004). The entire regularization path for the support vector machine. JMLR, 5, 1391-1415.
19. Hastie, T., Tibshirani, R., & Friedman, J. (2001). The elements of statistical learning. New York: Springer.
20. Li, W., Lee, K.-H., & Leung, K.-S. (2007). Large-scale RLSC learning without agony. In ICML '07: Proceedings of the 24th International Conference on Machine Learning (pp. 529-536). New York: ACM Press.
21. Micchelli, C. A., Xu, Y., & Zhang, H. (2006). Universal kernels. JMLR, 7, 2651-2667.
22. Ong, C., & Canu, S. (2004). Regularization by early stopping (Tech. Rep.). Computer Sciences Laboratory and RSISE, Australian National University. Available online at http://asi.insa-rouen.fr/scanu/.
23. Ong, C., Mary, X., Canu, S., & Smola, A. (2004). Learning with nonpositive kernels. In Proceedings of the 21st International Conference on Machine Learning. New York: ACM Press. Available online at http://www.aicml.cs. ualberta.ca/_banff04/icml /pages /papers/392.pdf.
24. Poggio, T., & Girosi, F. (1992). A theory of networks for approximation and learning. In C. Lau (Ed.), Foundation of neural networks (pp. 91-106). Piscataway, NJ: IEEE Press.
25. Poggio, T., Rifkin, R., Mukherjee, S., & Niyogi, P. (2004). General conditions for predictivity in learning theory. Nature, 428, 419-422.
26. Pontil, M., & Verri, A. (1998). Properties of support vector machines. Neural Computation, 10, 977-996.
27. Rakhlin, A., Mukherjee, S., & Poggio, T. (2005). Stability results in learning theory. Analysis and Applications, 3, 397-419.
28. Schölkopf, B., & Smola, A. (2002). Learning with kernels. Cambridge, MA: MIT Press.
29. Smale, S., & Zhou, D.-X. (2004). Shannon sampling and function reconstruction from point values. Bull. Amer. Math. Soc. (N.S.), 41(3), 279-305.
30. Smale, S., & Zhou, D.-X. (2005). Shannon sampling. II. Connections to learning theory. Appl. Comput. Harmon. Anal., 19(3), 285-302.
31. Smale, S., & Zhou, D.-X. (2007). Learning theory estimates via integral operators and their approximations. Constructive Approximation, 26(2), 153-172.
32. Smola, A., & Kondor, R. (2003). Kernels and regularization on graphs. In Learning theory and kernel machines. Berlin: Springer-Verlag.
33. Tikhonov, A., & Arsenin, V. (1977). Solutions of ill posed problems. Washington, DC: Winston.
34. Vapnik, V. (1982). Estimation of dependences based on empirical data. New York: Springer-Verlag.
35. Vapnik, V. N. (1998). Statistical learning theory. New York: Wiley.
36. Wahba, G. (1990). Spline models for observational data. Philadelphia: SIAM.
37. Wu, Q., Ying, Y., & Zhou, D.-X. (2006). Learning rates of least-square regularized regression. Found. Comput. Math., 6(2), 171-192.
38. Yao, Y., Rosasco, L., & Caponnetto, A. (2007). On early stopping in gradient descent learning. Constructive Approximation, 26, 289-315.
39. Zhang, T., & Ando, R. (2006). Analysis of spectral kernel design based semi-supervised learning. In Y. Weiss, B. Scholkopf, & J. Platt (Eds.), Advances in neural information processing systems, 18 (pp. 1601-1608). Cambridge, MA: MIT Press.
40. Zhu, X., Kandola, J., Ghahramani, Z., & Lafferty, J. (2005). Nonparametric transforms of graph kernels for semi-supervised learning. In L. K. Saul, Y. Weiss, & L. Bottou (Eds.), Neural information processing systems, 17. Cambridge, MA: MIT Press.