Density estimation from an individual numerical sequence

IEEE Transactions on Information Theory

Volumn 44, Issue 2, 1998, Pages 537-541

  Nobel, Andrew B ^a,b   Morvai, Gusztáv ^c   Kulkarni, Sanjeev R ^a,d  

^a IEEE   (United States)

^b University of North Carolina at Chapel Hill   (United States)

^c INSTITUTE OF EXPERIMENTAL MEDICINE   (Hungary)

^d Princeton University   (United States)

Author keywords

Bounded variation; Density estimation; Ergodic processes; Individual sequences

Indexed keywords

ESTIMATION; MARKOV PROCESSES; NUMERICAL METHODS; PROBABILITY DENSITY FUNCTION; STATISTICS;

BOUNDED VARIATION; DENSITY ESTIMATION; ERGODIC PROCESSES; NUMERICAL SEQUENCE;

INFORMATION THEORY;

EID: 0032029008     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/18.661503     Document Type: Article

References (22)

1. T. M. Adams and A. B. Nobel, "On density estimation from ergodic processes," Ann. Probab., 1998, to be published.
2. I. A. Ahmad, "Strong consistency of density estimation by orthogonal series methods for dependent variables with applications," Ann. Inst. Statist. Math., vol. 31, pp. 279-288, 1979.
3. J. V. Castellana and M. R. Leadbetter, "On smoothed probability density estimation for stationary processes," Stock. Proc. Appl., vol. 21, pp. 179-193, 1986.
4. 1-view. New York: Wiley, 1985.
5. L. Györfi, "Strongly consistent density estimate from ergodic sample," J. Multivariate Anal., vol. 11, pp. 81-84, 1981.
6. L. Györfi and G. Lugosi, "Kernel density estimation from ergodic sample is not universally consistent," Comput. Stat. Data Anal., vol. 14, pp. 437-442, 1992.
7. 2 strong consistency of recursive kernel density estimation from dependent samples," IEEE Trans. Inform. Theory, vol. 36, pp. 531-539, 1990.
8. L. Györfi, W. Härdle, P. Sarda, and P. Vieu, Nonparametric Curve Estimation from Time Series. Berlin, Germany: Springer-Verlag, 1989.
9. P. Hall and J. D. Hart, "Convergence rates in density estimation for data from infinite-order moving average processes," Probab. Theory Rel. Fields, vol. 87, pp. 253-274, 1990.
10. D. Haussler, J. Kivinen, and M. Warmuth, "Tight worst-case loss bounds for predicting with expert advice," in Proc. European Conf. on Computational Learning Theory, 1994.
11. A. N. Kolmogorov and S. V. Fomin, Introductory Real Analysis. Dover, DE: Mineola, 1970.
12. S. R. Kulkarni and S. E. Posner, "Rates of convergence for nearest neighbor estimation under arbitrary sampling," IEEE Trans. Inform. Thoery, vol. 41, pp. 1028-1039, 1995.
13. N. Merhav, M. Feder, and M. Gutman, "Universal prediction of individual sequences," IEEE Trans. Inform. Thoery, vol. 38, pp. 1258-1270, 1992.
14. G. Morvai, S. Kulkarni, and A. B. Nobel, "Regression estimation from an individual sequence," in preparation, 1997.
15. D. Pollard, Convergence of Stochastic Processes. New York: Springer-Verlag, 1984.
16. M. Rosenblatt, "Density estimates and Markov sequences," in Nonparametric Techniques in Statistical Inference, M. Puri, Ed. London, U.K.: Cambridge Univ. Press, 1970, pp. 199-213.
17. G. Roussas, "Nonparametric estimation in Markov processes," Ann. Inst. Statist. Math., vol. 21, pp. 73-87, 1967.
18. D. W. Scott, Multivariate Density Estimation: Theory, Practice, and Visualization. New York: Wiley, 1992.
19. B. W. Silverman Density Estimation for Statistics and Data Analysis. London, U.K.: Chapman and Hall, 1986.
20. M. P. Wand and M. C. Jones, Kernel Smoothing. London, U.K.: Chapman and Hall, 1995.
21. S. Yakowitz, "Nonparametric density and regression estimation for Markov sequences without mixing assumptions," J. Multivar. Anal., vol. 30, pp. 124-136, 1989.
22. J. Ziv, "Coding theorems for individual sequences," IEEE Trans. Inform. Thoery, vol. IT-24, pp. 405-412, 1978.