Universal linear prediction by model order weighting

IEEE Transactions on Signal Processing

Volumn 47, Issue 10, 1999, Pages 2685-2699

  Singer, Andrew C ^a   Feder, Meir ^b  

^a United States of America   (United States)

^b TEL AVIV UNIVERSITY   (Israel)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; COMPUTATIONAL COMPLEXITY; DECISION THEORY; LEARNING SYSTEMS; LEAST SQUARES APPROXIMATIONS; MATHEMATICAL MODELS; PROBABILITY; REGRESSION ANALYSIS; SIGNAL ENCODING; SPEECH PROCESSING;

BAYESIAN METHODS; MODEL ORDER WEIGHTING; UNIVERSAL LINEAR PREDICTION;

ADAPTIVE FILTERING;

EID: 0033348048     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/78.790651     Document Type: Article

References (28)

1. H. Akaike, A new look at the statistical model identification, IEE Trans. Automat. Contr., vol. AC-19, pp. 716-723, Dec. 1974.
2. J. Rissanen, Modeling by shortest data description, Automatica, vol 14, pp. 465-171, 1978.
3. G. Schwarz, Estimating the dimension of a model, Ann. Stat, vol. 6 no. 2, pp. 461-164, 1978.
4. J. Rissanen, A predictive least squares principle, IMA J. Math. Contr Inform., vol. 3, no. 2-3, pp. 221-222, 1986.
5. M. Wax, Order selection for AR models by predictive least squares, IEEE Trans. Acoust., Speech, Signal Processing, vol. 36, pp. 581-588 Apr. 1988.
6. A. Barron, J. Rissanen, and B. Yu, The minimum description lengt principle in coding and modeling (invited paper), IEEE Trans. Inform Theory, vol. 44, pp. 2743-2760, Oct. 1998.
7. N. Merhav and M. Feder, Universal schemes for sequential decisio from individual sequences, IEEE Trans. Inform. Theory, vol. 39, pp 1280-1292, July 1993.
8. B. Y. Ryabko, Twice-universal coding, Probl. Inform. Transm. vol 20, pp. 173-177, July/Aug./Sept. 1984.
9. __, Prediction of random sequences and universal coding, Probl Inform. Transm., vol. 24, pp. 87-96, Apr./May/June 1988.
10. N. Merhav and M. Feder, Universal prediction (invited paper), IEE Trans. Inform. Theory, vol. 44, pp. 2124-2147, Oct. 1998.
11. L. D. Davisson, The prediction error of stationary Gaussian time serie of unknown covariance, IEEE Trans. Inform. Theory, vol. IT-11, pp 527-532, Oct. 1965.
12. J. Rissanen, Universal coding, information, prediction, and estimation, IEEE Trans. Inform. Theory, vol. IT-30, pp. 629-636, 1984.
13. M. Feder and A. Singer, Universal data compression and linea prediction, in Proc. 1998 Data Compression Conf., Mar. 1998.
14. V. Vovk, Aggregating strategies (learning), in Proc. 3rd Anna. Workshop Comput. Learning Theory, M. Fulk and J. Case, Eds. San Mateo CA: Morgan Kaufmann, 1990, pp. 371-383.
15. P. Elias, Universal codeword sets and representations of the integers, IEEE Trans. Inform. Theory, vol. IT-21, pp. 194-203, Mar. 1975.
16. N. Cesa-Bianchi, Y. Freund, D. Helmbold, D. Haussler, R. Schapire and M. Warmuth, How to use expert advice, in Proc. Anna. AC Symp. Theory Comput., 1993, pp. 382-391.
17. D. Haussler, J. Kivinen, and M. Warmuth, Tight worst-case loss bound for predicting with expert advice, in Comput. Learning Theory 2n Euro. Conf., P. Vitanyi, Ed., Mar. 1995, pp. 69-83.
18. D. T. L. Lee, M. Morf, and B. Friedlander, Recursive least square ladder estimation algorithms, IEEE Trans. Circuits Syst., vol. CAS-28 pp. 467-181, June 1981.
19. M. Morf, A. Vieira, and D. Lee, Ladder forms for identification an speech processing, in Proc. IEEE Conf. Decision Contr., Dec. 1977 pp. 1074-1078.
20. P. Strobach, New forms of Levinson and Schur algorithms, IEE Signal Processing Mag., pp. 12-36, Jan. 1991.
21. A. H. Sayed and T. Kailath, A state-space approach to adaptive RL filtering, IEEE Signal Processing Mag., pp. 18-60, July 1994.
22. B. Friendlander, Lattice methods for spectral estimation, Proc. IEEE vol. 70, pp. 990-1017, Sept. 1982.
23. __, Lattice filters for adaptive processing, Proc. IEEE, vol. 70 pp. 829-867, Aug. 1982
24. M. Honig and D. Messerschmidt, Adaptive Filters: Structures, Algorithms and Applications. Boston, MA: Kluwer, 1984.
25. F. Ling and J. Proakis, Generalized least squares lattice algorithm an its application to decision feedback equalization, in Proc. Int. Conf Acoust. Speech, Signal Process., 1982, vol. 3, pp. 1764-1769.
26. E. Satorius and J. Pack, Application of least squares lattice algorithm to adaptive equalization, IEEE Trans. Commun., vol. COMM-29, pp 136-142, Feb. 1981.
27. J. Makhoul, Stable and efficient lattice methods for linear prediction, IEEE Trans. Acoust., Speech, Signal Processing, vol. ASSP-25, pp 423-428, Oct. 1977.
28. L. Rabiner and R. Schafer, Digital Processing of Speech Signals Englewood Cliffs, NJ: Prentice-Hall, 1978.