Regularized least square regression with dependent samples

Advances in Computational Mathematics

Volumn 32, Issue 2, 2010, Pages 175-189

  Sun, Hongwei ^a,b   Wu, Qiang ^c  

^a UNIVERSITY OF JINAN   (China)

^b BEIJING NORMAL UNIVERSITY   (China)

^c Duke University   (United States)

Author keywords

Capacity independent error bounds; Integral operator; Regularized least square regression; Strong mixing condition

Indexed keywords

EID: 77951769307     PISSN: 10197168     EISSN: None     Source Type: Journal    
DOI: 10.1007/s10444-008-9099-y     Document Type: Article

References (19)

1. Aronszajn, N.: Theory of reproducing kernels. Trans. Amer. Math. Soc. 68, 337-404 (1950).
2. Athreya, K. B., Pantula, S. G.: Mixing properties of Harris chains and autoregressive processes. J. Appl. Probab. 23, 880-892 (1986).
3. Bartlett, P. L., Mendelson, S.: Rademacher and Gaussian complexities: risk bounds and structural results. J. Mach. Learn. Res. 3, 463-482 (2002).
4. Billingsley, P.: Convergence of Probability Measures. Wiley, New York (1968).
5. Bousquet, O., Elisseeff, A.: Stability and generalization. J. Mach. Learn. Res. 2, 499-526 (2002).
6. Cucker, F., Zhou, D. X.: Learning Theory: An Approximation Theory Viewpoint. Cambridge University Press, Cambridge (2007).
7. Davydov, Y. A.: The invariance principle for stationary processes. Theory Probab. Appl. 14, 487-498 (1970).
8. Dehling, H., Philipp, W.: Almost sure invariance principles for weakly dependent vector-valued random variables. Ann. Probab. 10, 689-701 (1982).
9. Evgeniou, T., Pontil, M., Poggio, T.: Regularization networks and support vector machines. Adv. Comput. Math. 13, 1-50 (2000).
10. Li, L. Q., Wan, C. G.: Support vector machines with beta-mixing input sequences. In: Wang, J., et al. (eds.) Lecture Notes on Computer Science, vol. 3971, pp. 928-935. Springer, New York (2006).
11. Modha, D. S.: Minimum complexity regression estimation with weakly dependent observations. IEEE. Trans. Inform. Theory 42, 2133-2145 (1996).
12. Smale, S., Zhou, D. X.: Shannon sampling and function reconstruction from point values. Bull. Amer. Math. Soc. 41, 279-305 (2004).
13. Smale, S., Zhou, D. X.: Shannon sampling II: connections to learning theory. Appl. Comput. Harmon. Anal. 19, 285-302 (2005).
14. Smale, S., Zhou, D. X.: Learning theory estimates via integral operators and their approximations. Constr. Approx. 26, 153-172 (2007).
15. Vidyasagar, M.: Learning and Generalization with Applications to Neural Networks. Springer, Berlin Heidelberg New York (2003).
16. Withers, C. S.: Connectionist nonparametric regression: multilayer feedforward networks can learn arbitrary mappings. Neural Netw. 3, 535-549 (2000).
17. Wu, Q., Ying, Y. M., Zhou, D. X.: Learning rates of least-square regularized regression. Found. Comput. Math. 6, 171-192 (2006).
18. Xu, Y. L., Chen, D. R.: Learning rates of regularized regression for exponentially strongly mixing sequence. J. Statist. Plann. Inference 138(7), 2180-2189 (2008).
19. Zhang, T.: Leave-one-out bounds for kernel methods. Neural Comput. 15, 1397-1437 (2003).