Rates of convergence for partitioning and nearest neighbor regression estimates with unbounded data

Journal of Multivariate Analysis

Volumn 97, Issue 2, 2006, Pages 311-323

  Kohler, Michael ^a   Krzyzak, Adam ^b   Walk, Harro ^c  

^a SAARLAND UNIVERSITY   (Germany)

^b Dept of Electrical and Computer Engineering   (Canada)

^c UNIVERSITY OF STUTTGART   (Germany)

Author keywords

Nearest neighbor estimate; Partitioning estimate; Rate of convergence; Regression

Indexed keywords

EID: 29444446826     PISSN: 0047259X     EISSN: 10957243     Source Type: Journal    
DOI: 10.1016/j.jmva.2005.03.006     Document Type: Article

References (20)

1. T.M. Cover Rates of convergence for nearest neighbor procedures in: Proceedings of the Hawaii International Conference on System Sciences Honolulu, HI 1968 413-415
2. L. Devroye Any discrimination rule can have arbitrarily bad probability of error for finite sample size IEEE Trans. Pattern Anal. Mach. Intell. 4 1982 154-157
3. L. Devroye L. Györfi A. Krzyzak G. Lugosi On the strong universal consistency of nearest neighbor regression function estimates Ann. Statist. 22 1994 1371-1385
4. W. Greblicki A. Krzyzak M. Pawlak Distribution-free pointwise consistency of kernel regression estimate Ann. Statist. 12 1984 1570-1575
5. L. Györfi The rate of convergence of k n - NN regression estimates and classification rules IEEE Trans. Inform. Theory 27 1981 362-364
6. L. Györfi M. Kohler A. Krzyzak H. Walk A Distribution-Free Theory of Nonparametric Regression, Springer Series in Statistics 2002 Springer Berlin
7. L. Györfi M. Kohler H. Walk Weak and strong universal consistency of semi-recursive partitioning and kernel regression estimates Statist. Decisions 16 1998 1-18
8. L. Györfi H. Walk On the strong universal consistency of a series type regression estimate Math. Methods Statist. 5 1996 332-342
9. L. Györfi H. Walk On the strong universal consistency of a recursive regression estimate by Pál Révész Statist. Probab. Lett. 31 1997 177-183
10. M. Kohler Universally consistent regression function estimation using hierarchical B-splines J. Multivariate Anal. 67 1999 138-164
11. M. Kohler Universal consistency of local polynomial kernel regression estimates Ann. Inst. Statist. Math. 54 2003 879-899
12. M. Kohler A. Krzyzak Nonparametric regression estimation using penalized least squares IEEE Trans. Inform. Theory 47 2001 3054-3058
13. M. Kohler, A. Krzyzak, H. Walk, Optimal global rates of convergence for nonparametric regression with unbounded data, 2004, submitted for publication.
14. S.R. Kulkarni S.E. Posner Rates of convergence of nearest neighbor estimation under arbitrary sampling IEEE Trans. Inform. Theory 41 1995 1028-1039
15. G. Lugosi K. Zeger Nonparametric estimation via empirical risk minimization IEEE Trans. Inform. Theory 41 1995 677-687
16. A. Nobel Histogram regression estimation using data-dependent partitions Ann. Statist. 24 1996 1084-1105
17. C. Spiegelman J. Sacks Consistent window estimation in nonparametric regression Ann. Statist. 8 1980 240-246
18. C.J. Stone Consistent nonparametric regression Ann. Statist. 5 1977 595-645
19. C.J. Stone Optimal global rates of convergence for nonparametric regression Ann. Statist. 10 1982 1040-1053
20. H. Walk Almost sure convergence properties of Nadaraya-Watson regression estimates in: M. Dror P. L'Ecuyer F. Szidarovszky (Eds.) Modeling Uncertainty An Examination of its Theory, Methods and Applications 2002 Kluwer Academic Publishers Dordrecht 201-223