Regression estimation from an individual stable sequence

Statistics

Volumn 33, Issue 2, 1999, Pages 99-118

  Morvai, Gusztáv ^a   Kulkarni, Sanjeev R ^b,d   Nobel, Andrew B ^c,e  

^a BUDAPEST UNIVERSITY OF TECHNOLOGY AND ECONOMICS   (Hungary)

^b PRINCETON UNIVERSITY   (United States)

^c UNIVERSITY OF NORTH CAROLINA   (United States)

^d Princeton University   (United States)

^e The University of North Carolina at Chapel Hill   (United States)

Author keywords

Ergodic time series; Individual sequences; Nonparametric estimation; Regression estimation

Indexed keywords

EID: 0348238223     PISSN: 02331888     EISSN: None     Source Type: Journal    
DOI: 10.1080/02331889908802686     Document Type: Article

References (24)

1. Algoet, P. H. (1992). Universal schemes for prediction, gambling and portfolio selection. Ann. Probab., 20, 901-941.
2. Bailey, D., Sequential schemes for classifying and predicting ergodic processes. Ph.D. Dissertation, Dept. Math, Stanford University.
3. Chaitin, G. J. (1966). On the length of programs for computing binary sequences. J. Assoc. Comp. Mach., 13, 547-569.
4. Cover, T. M. (1975). Open problems in information theory. In: IEEE Joint Workshop on Information Theory, pp. 35-36, IEEE Press.
5. 1 convergence of the kernel regression estimate. J. of Statistical Planning and Inference, 23, 71-82.
6. Györfi, L., Härdle, W., Sarda, P. and Vieu, P. (1989). Nonparametric Curve Estimation from Time Series. Springer-Verlag, Berlin.
7. Haussler, D., Kivinen, J. and Warmuth, M. (1994). Tight worst-case loss bounds for predicting with expert advice. Proc. European Conference on Computational Learning Theory.
8. Kolmogorov, A. N. (1965). Three approaches to the quantitative definition of information. Problems of Information Transmission, 1, 4-7.
9. Kolmogorov, A. N. (1968). Logical basis for information theory and probability theory. IEEE Trans. Info. Theory, IT-14, 662-664.
10. Kolmogorov, A. N. and Fomin, S. V. (1970). Introductory Real Analysis. Dover, Mineola.
11. Kulkarni, S. R. and Posner, S. E. (1995). Rates of convergence for nearest neighbor estimation under arbitrary sampling. IEEE Trans. on Information Theory, IT-41, 1028-1039.
12. Lempel, A. and Ziv, J. (1976). On the complexity of finite sequences. IEEE Trans. on Information Theory, IT-22, 75-81.
13. Merhav, N., Feder, M. and Gutman, M. (1992). Universal prediction of individual sequences. IEEE Trans. on Information Theory, IT-38, 1258-1270.
14. Morvai, G., Yakowitz, S. and Algoet, P. (1997). Weakly convergent nonparametric forecasting of stationary time series. IEEE Trans. Information Theory, IT-43, 483-498.
15. Morvai, G., Györfi, L. and Yakowitz, S. (1996). Nonparametric inference for ergodic, stationary time series. Annals of Statistics, 24, 370-379.
16. Nobel, A. B., Limits to classification and regression estimation from ergodic processes. To appear in Ann. Stat.
17. Nobel, A. B., Morvai, G. and Kulkarni, S. (1998). Density estimation from an individual numerical sequence. IEEE Trans. Information Theory, 44, 537-541.
18. Ornstein, D. (1974). Guessing the next output of a stationary process. Israel J. Math., 30, 292-396.
19. Pollard, D. (1984). Convergence of Stochastic Processes. Springer-Verlag, New York.
20. Roussas, G. Ed. (1991). Nonparametric functional estimation and related topics. Kluwer, Netherlands.
21. Ryabko, B. Ya. (1988). Prediction of random sequences and universal coding. Problems of Inform. Trans., 24, 87-96.
22. Stout, W. F. (1974). Almost Sure Convergence. Academic Press, New York.
23. Yakowitz, S., Györfi, L., Kieffer, J. and Morvai, G. (1997). Strongly-consistent non-parametric estimation of smooth regression functions for stationary ergodic sequences. Under revision to Journal of Multivariate Analysis.
24. Ziv, J. (1978). Coding theorems for individual sequences. IEEE Trans. on Information Theory, IT-24, 405-412.