Some notes on Rissanen's stochastic complexity

IEEE Transactions on Information Theory

Volumn 44, Issue 2, 1998, Pages 782-786

  Qian, Guoqi ^a   Künsch, Hans R ^b  

^a LA TROBE UNIVERSITY   (Australia)

^b ETH ZURICH   (Switzerland)

Author keywords

Fisher information; Model selection; Robust regression; Stochastic complexity; Two part codes

Indexed keywords

APPROXIMATION THEORY; CODES (SYMBOLS); DATA COMPRESSION; EIGENVALUES AND EIGENFUNCTIONS; ENCODING (SYMBOLS); MATHEMATICAL MODELS; OPTIMIZATION; RANDOM PROCESSES; REGRESSION ANALYSIS;

FISHER INFORMATION; STOCHASTIC COMPLEXITY;

COMPUTATIONAL COMPLEXITY;

EID: 0032026464     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/18.661521     Document Type: Article

References (11)

1. J. L. Bentley and A. C. Yao, "An almost optimal algorithm for unbounded searching," Inform. Processing Lett., vol. 5, pp. 82-87, 1976.
2. P. Elias, "Universal codeword sets and representations of the integers," IEEE Trans. Inform. Theory, vol. IT-21, pp. 194-203, 1975.
3. P. Hall and E. J. Hannan, "On stochastic complexity and nonparametric density estimation," Biometrika, vol. 75, pp. 705-714, 1988.
4. F. R. Hampel, E. M. Ronchetti, P. J. Rousseeuw, and W. A. Stahel, Robust Statistics, the Approach Based on Influence Functions. New York: Wiley, 1986.
5. P. J. Huber, "Robust estimation of a location parameter," Ann. Math. Statist., vol. 35, pp. 73-101, 1964.
6. S. K. Leung-Yan-Cheong and T. Cover, "Some equivalences between Shannon entropy and Kolmogorov complexity," IEEE Trans. Inform. Theory, vol. IT-24, pp. 331-338, 1978.
7. G. Qian and H. R. Künsch, "On model selection in robust linear regression," Res. Rep. 80, Seminar für Statistik, ETH Zürich, 1996.
8. J. Rissanen, "A universal prior for integers and estimation by minimum description length," Ann. Statist., vol. 11, pp. 416-431, 1983.
9. _, Stochastic Complexity in Statistical Inquiry. Singapore: World Scientific, 1989.
10. _, "Fisher information and stochastic complexity," IEEE Trans. Inform. Theory, vol. 42, pp. 40-47, 1996.
11. B. Yu and T. Speed, "Data compression and histograms," Probab. Theory Related Fields, vol. 92, pp. 195-229, 1992.