Data-dependent k n-NN and kernel estimators consistent for arbitrary processes

IEEE Transactions on Information Theory

Volumn 48, Issue 10, 2002, Pages 2785-2788

  Kulkarni, Sanjeev R ^a,b   Posner, Steven E ^c   Sandilya, Sathyakama ^d,e  

^a IEEE   (United States)

^b Princeton University   (United States)

^c Goldman Sachs Group   (United States)

^d PRINCETON UNIVERSITY   (United States)

^e SIEMENS CORPORATE RESEARCH   (United States)

Author keywords

Arbitrary random processes; Consistency; Data dependent; Kernel estimate; Nearest neighbor estimate; Nonparametric regression

Indexed keywords

ARBITRARY RANDOM PROCESSES; KERNEL ESTIMATORS;

MATHEMATICAL MODELS; METRIC SYSTEM; PARAMETER ESTIMATION; PROBLEM SOLVING; RANDOM PROCESSES; REGRESSION ANALYSIS; SET THEORY; THEOREM PROVING;

DATA REDUCTION;

EID: 0036794591     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIT.2002.802611     Document Type: Article

References (18)

1. n-NN non-parametric regression and decision," Prob. Contr. Inform. Theory, vol. 8, pp. 303-311, 1979.
2. T.M. Cover, "Rates of convergence for nearest neighbor procedures," in Proc. 1st Annu. Hawaii Conf. Systems Theory, Jan. 1968, pp. 413-415.
3. L. Devroye, "Necessary and sufficient conditions for the pointwise convergence of nearest neighbor regression function estimates," Z. Wahrscheinlichkeitstheorie verw. Gebiete, vol. 61, pp. 467-481, 1982.
4. R.M. Dudley, Real Analysis and Probability. London, U.K.: Chapman & Hall, 1989.
5. n-NN regression estimates and classification rules," IEEE Trans. Inform. Theory, vol. IT-27, pp. 362-364, May 1981.
6. L. Györfi, W. Härdle, P. Sarda, and P. Vieu, Nonparametric Curve Estimation From Time Series. Berlin, Germany: Springer-Verlag, 1989.
7. A. Krzyżak, "The rates of convergence of kernel regression estimates and classification rules," IEEE Trans. Inform. Theory, vol. IT-32, pp. 668-679, Sept. 1986.
8. S.R. Kulkarni and S.E. Posner, "Rates of convergence of nearest neighbor estimation under arbitrary sampling," IEEE Trans. Inform. Theory, vol. 41, pp. 1028-1039, July 1995.
9. D. Modha and E. Masry, "Memory-universal prediction of stationary random processes," IEEE Trans. Inform. Theory, vol. 44, pp. 117-133, Jan. 1998.
10. G. Morvai, S.R. Kulkarni, and A.B. Nobel, "Regression estimation from an individual stable sequence," Statistics, vol. 33, pp. 99-119, 1999.
11. A.B. Nobel, "Limits to classification and regression estimation from ergodic processes," Ann. Statist., vol. 27, pp. 262-273, 1999.
12. A.B. Nobel, G. Morvai, and S. Kulkarni, "Density estimation from an individual numerical sequence," IEEE Trans. Inform. Theory, vol. 44, pp. 537-541, Mar. 1998.
13. G. Roussas, "Nonparametric estimation in Markov processes," Ann. Inst. Statist. Math., vol. 21, pp. 73-87, 1967.
14. G. Roussas, Ed., Nonparametric Functional Estimation and Related Topics. Amsterdam, The Netherlands: Kluwer, 1991.
15. C.J. Stone, "Consistent nonparametric regression," Ann. Statist., vol. 5, pp. 595-645, 1977.
16. S. Yakowitz, "Nonparametric density and regression estimation from Markov sequences without mixing assumptions," J. Multivar. Anal., vol. 30, pp. 124-136, 1989.
17. _, "Nearest neighbor regression estimation for null-recurrent Markov time series," Stock Processes Appl., vol. 48, pp. 311-318, 1993.
18. L.C. Zhao, "Exponential bounds of mean error for the nearest neighbor estimates of regression functions," J. Multiv. Anal., vol. 21, pp. 168-178, 1987. [blank_line]