Strong universal consistency of smooth kernel regression estimates

Annals of the Institute of Statistical Mathematics

Volumn 57, Issue 4, 2005, Pages 665-685

  Walk, Harro ^a  

^a UNIVERSITY OF STUTTGART   (Germany)

Author keywords

Covering; Efron Stein inequality; Kernel estimate of Nadaraya and Watson; Nonparametric regression estimation; Square integrability; Strong and weak universal consistency; Tauberian theorem

Indexed keywords

EFRON-STEIN INEQUALITY; KERNEL ESTIMATE OF NADARAYA AND WATSON; NONPARAMETRIC REGRESSION ESTIMATION; SQUARE INTEGRABILITY; TAUBERIAN THEOREM;

BANDWIDTH; PARAMETER ESTIMATION; THEOREM PROVING;

REGRESSION ANALYSIS;

EID: 33845579837     PISSN: 00203157     EISSN: 15729052     Source Type: Journal    
DOI: 10.1007/BF02915432     Document Type: Article

References (33)

1. Devroye, L. (1981). On the almost everywhere convergence of nonparametric regression function estimates, Annals of Statistics, 9, 1310-1319.
2. 1 convergence of the kernel regression estimate, Journal of Statistical Planning and Inference, 23, 71-82.
3. Devroye, L. and Wagner, T. J. (1980a). Distribution-free consistency results in nonparametric discrimination and regression function estimation, Annals of Statistics, 8, 231-239.
4. 1 convergence of kernel estimators of regression functions with applications in discrimination, Zeitschrift für Wahrscheinlichkeitstheorie und verwandte Gebiete, 51, 15-25.
5. Devroye, L., Györfi, L., Krzyżak, A. and Lugosi, G. (1994). On the strong universal consistency of nearest neighbor regression function estimates, Annals of Statistics, 22, 1371-1385.
6. Efron, B. and Stein, C. (1981). The jackknife estimate of variance, Annals of Statistics, 9, 586-596.
7. Greblicki, W., Krzyżak, A. and Pawlak, M. (1984). Distribution-free pointwise consistency of kernel regression estimate, Annals of Statistics, 12, 1570-1575.
8. Györfi, L. (1991). Universal consistencies of a regression estimate for unbounded regression functions, Nonparametric Functional Estimation and Related Topics (ed. G. Roussas), 329-338, NATO ASI Ser. C., Kluwer Academic Publishers, Dordrecht.
9. Györfi, L. and Walk, H. (1996). On the strong universal consistency of a series type regression estimate, Mathematical Methods of Statistics, 5, 332-342.
10. Györfi, L. and Walk, H. (1997). On the strong universal consistency of a recursive regression estimate by Pál Révész, Statistics & Probability Letters, 31, 177-183.
11. Györfi, L., Kohler, M. and Walk, H. (1998). Weak and strong universal consistency of semi-recursive kernel and partitioning regression estimates, Statistics & Decisions, 16, 1-18.
12. Györfi, L., Kohler, M., Krzyżak, A. and Walk, H. (2002). A Distribution-free Theory of Nonparametric Regression, Springer-Verlag, New York, Berlin.
13. Härdie, W. (1990). Applied Nonparametric Regression, Cambridge University Press, Cambridge, Massachusetts.
14. Hardy, G. H. (1949). Divergent Series, Oxford University Press, Oxford.
15. Kohler, M. (1997). On the universal consistency of a least squares spline regression estimator, Mathematical Methods of Statistics, 6, 349-364.
16. Kohler, M. (1999). Universally consistent regression function estimation using hierarchical B-splines, Journal of Multivariate Analysis, 68, 138-164.
17. Kozek, A. S., Leslie, J. R. and Schuster, E. F. (1998). On a universal strong law of large numbers for conditional expectations, Bernoulli, 4, 143-165.
18. Krzyżak, A. and Pawlak, M. (1987). The pointwise rate of convergence of the kernel regression estimate, Journal of Statistical Planning and Inference, 10, 159-166.
19. Loève, M. (1977). Probability Theory, 4th ed., Springer-Verlag, New York, Berlin.
20. Lugosi, G. and Zeger, K. (1995). Nonparametric estimation via empirical risk minimization, IEEE Transactions on Information Theory, 41, 677-687.
21. Nadaraya, E. A. (1964). On estimating regression, Theory of Probability and Its Applications, 9, 141-142.
22. Pawlak, M. (1991). On the almost everywhere properties of the kernel regression estimate, Annals of the Institute of Statistical Mathematics, 43, 311-326.
23. Révész, P. (1973). Robbins-Monro procedure in a Hilbert space and its application in the theory of learning processes I, Studia Scientiarum Mathematicarum Hungarica, 8, 391-398.
24. Spiegelman, C. and Sacks, J. (1980). Consistent window estimation in nonparametric regression, Annals of Statistics, 8, 240-246.
25. Steele, J. M. (1986). An Efron-Stein inequality for nonsymmetric statistics, Annals of Statistics, 14, 753-758.
26. Stone, C. J. (1977). Consistent nonparametric regression, Annals of Statistics, 5, 595-645.
27. Stone, C. J. (1980). Optimal rates of convergence for nonparametric estimators, Annals of Statistics, 8, 1348-1360.
28. Stone, C. J. (1982). Optimal global rates of convergence for nonparametric regression, Annals of Statistics, 10, 1040-1053.
29. Stute, W. (1986). On almost sure convergence of conditional empirical distribution functions, Annals of Probability, 14, 891-901.
30. Walk, H. (2001). Strong universal pointwise consistency of recursive regression estimates, Annals of the Institute of Statistical Mathematics, 53, 691-707.
31. Walk, H. (2005). Strong laws of large numbers by elementary Tauberian arguments, Monatshefte für Mathematik, 144, 329-346.
32. Watson, G. S. (1964). Smooth regression analysis, Sankhyä Series A, 26, 359-372.
33. Zeller, K. and Beekmann, W. (1970). Theorie der Limitierungsverfahren, 2. Aufl., Springer-Verlag, Berlin.