Sequential prediction of unbounded stationary time series

IEEE Transactions on Information Theory

Volumn 53, Issue 5, 2007, Pages 1866-1872

  Györfi, Ĺszló ^a   Ottucsák, György ^a  

^a BUDAPEST UNIVERSITY OF TECHNOLOGY AND ECONOMICS   (Hungary)

Author keywords

On line learning; Pattern recognition; Sequential prediction; Time series; Universal consistency

Indexed keywords

BAYESIAN NETWORKS; CONVERGENCE OF NUMERICAL METHODS; LEARNING SYSTEMS; PATTERN RECOGNITION; PROBABILITY; RANDOM PROCESSES; TIME SERIES ANALYSIS;

ON-LINE LEARNING; SEQUENTIAL PREDICTION; UNIVERSAL CONSISTENCY;

ONLINE SYSTEMS;

EID: 34248596750     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIT.2007.894660     Document Type: Article

References (25)

1. P. Algoet, "Universal schemes for prediction, gambling, and portfolio selection," Ann. Probab., vol. 20, pp. 901-941, 1992.
2. P. Algoet, "The strong law of large numbers for sequential decisions under uncertainity," IEEE Trans. Inf. Theory, vol. 40, no. 3, pp. 609-634, May 1994.
3. P. Auer, N. Cesa-Bianchi, and C. Gentile, "Adaptive and self-confident on-line learning algorithms," J. Comp. Syst. Sci., vol. 64, no. 1, pp. 48-75, 2002, a preliminary version has appeared in Proc. 13th Annu. Conf. Computational Learning Theory.
4. D. H. Bailey, "Sequential Schemes for Classifying and Predicting Ergodic Processes," Ph.D. dissertation, Stanford Univ., Stanford, CA, 1976.
5. L. Breiman, "The individual ergodic theorem of information theory," Ann. Math. Statist., vol. 28, pp. 809-811, 1957, correction in Ann Math. Statist., vol. 31, pp. 809-810, 1960.
6. N. Cesa-Bianchi and G. Lugosi, Prediction, Learning, and Games. Cambridge, U.K.: Cambridge Univ. Press, 2006.
7. Y. S. Chow, "Local convergence of martingales and the law of large numbers," Ann. Math. Statist., vol. 36, pp. 552-558, 1965.
8. L. Devroye, L. Györfi, and G. Lugosi, A Probabilistic Theory of Pattern Recognition. New York: Springer-Verlag, 1996.
9. M. Feder, N. Merhav, and M. Gutman, "Universal prediction of individual sequences," IEEE Trans. Inf. Theory, vol. 38, no. 4, pp. 1258-1270, Jul. 1992.
10. L. Györfi, M. Kohler, A. Krzyzak, and H. Walk, A Distribution-Free Theory of Nonparametric Regression. New York: Springer-Verlag, 2002.
11. L. Györfi and G. Lugosi, "Strategies for sequential prediction of stationary time series," in Modeling Uncertainty: An Examination of Its Theory, Methods and Applications, M. Dror, P. L'Ecuyer, and F. Szidarovszky, Eds. Norwell, MA: Kluwer Academic, 2001, pp. 225-248.
12. L. Györfi, G. Lugosi, and G. Morvai, "A simple randomized algorithm for consistent sequential prediction of ergodic time series," IEEE Trans. Inf. Theory, vol. 45, no. 7, pp. 2642-2650, Nov. 1999.
13. N. Littlestone and M. K.Warmuth, "The weighted majority algorithm," Inf. Comput., vol. 108, pp. 212-261, 1994.
14. N. Merhav and M. Feder, "Universal prediction," IEEE Trans. Inf. Theory, vol. 44, no. 6, pp. 2124-2147, Oct. 1998.
15. D. Modha and E. Masry, "Memory-universal prediction of stationary random preocesses," IEEE Trans. Inf. Theory, vol. 44, no. 1, pp. 117-133, Jan. 1998.
16. G. Morvai, S. Yakowitz, and P. Algoet, "Weakly convergent stationary time series," IEEE Trans. Inf. Theory, vol. 43, no. 2, pp. 483-498, Mar. 1997.
17. G. Morvai, S. Yakowitz, and L. Györfi, "Nonparametric inference for ergodic, stationary time series," Ann. Statist., vol. 24, pp. 370-379, 1996.
18. A. Nobel, "On optimal sequential prediction for general processes," IEEE Trans. Inf. Theory, vol. 49, no. 1, pp. 83-98, Jan. 2003.
19. D. Ornstein, "Guessing the next output of a stationary process," Israel J. Math., vol. 30, pp. 292-296, 1978.
20. A. C. Singer and M. Feder, "Universal linear prediction by model order weighting," IEEE Trans. Signal Process., vol. 47, no. 10, pp. 2685-2699, Oct. 1999.
21. A. C. Singer and M. Feder, "Universal linear least-squares prediction," in Proc, IEEE Int. Symp. Information Theory, Sorrento, Italy, Jun. 2000, p. 81.
22. W. F. Stout, Almost Sure Convergence. New York: Academic, 1974.
23. V. Vovk, "A game of prediction with expert advice," J. Comp. Syst. Sci., vol. 56, pp. 153-173, 1998.
24. T. Weissman and N. Merhav, "Universal prediction of random binary sequences in a noisy environment," Ann. Appl. Probab., vol. 14, no. 1, pp. 54-89, Feb. 2004.
25. Y. Yang, "Combining different procedures for adaptive regression," J. Multivariate Anal., vol. 74, pp. 135-161, 2000.