Hypothesis selection and testing by the MDL principle

Computer Journal

Volumn 42, Issue 4, 1999, Pages 267-269

  Rlssanen, J ^a  

^a IBM ALMADEN RESEARCH CENTER   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

MATHEMATICAL MODELS;

MINIMUM DESCRIPTION LENGTH (MDL) PRINCIPLE; NORMALIZED MAXIMUM LIKELIHOOD (NML) MODELS;

PROBABILITY DISTRIBUTIONS;

EID: 0032614642     PISSN: 00104620     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (17)

1. Wallace, C. S. and Boulton, D. M. (1968) An information measure for classification. Coniput. J., 11, 185-195.
2. Rissanen, J. (1978) Modeling by shortest data description. Aiitomatica, 14,465-471.
3. Rissanen, J. (1986) Stochastic complexity and modeling. Ann. Statist., 14, 1080-1100.
4. Berger, J. O. (1985) Statistical Decision Theory and Bayesian Analysis (2nd edn). Springer, New York.
5. Cover, T. M. and Thomas, J. A. (1991) Elements of Information Theory. Wiley, New York.
6. Vitdnyi, P. and Li, M. (1997) Minimum description length induction, Bayesianism, and Kolmogorov complexity. Private communication.
7. Vovk, V. ( 1997) Learning about the parameter of the Bernoulli model. J. Compitt. System Sei., 55, 96-104.
8. Li, M. and Vitânyi, P. (1993) An Introduction to Kolmogorov Complexity and Its Applications. Springer, New York.
9. Shtarkov, Yu. M. (1987) Universal sequential coding of single messages. Translated from Problems of Information Transmission, 23, 3-17.
10. Rissanen, J. (1996) Fisher information and stochastic complexity. IEEE Trans. Information Theory, IT-42, 40-47.
11. Dawid, A. P. (1992) Prequential analysis, stochastic complexity and Bayesian inference (with discussion). In Bernardo, J. M., Berger, J. O., Dawid, A. P. and Smith, A. F. M. (eds), Bayesian Statistics 4, pp. 109-125. Oxford University Press, Oxford, UK.
12. Domingos, P. (1998) Occam's two razors: the sharp and the blunt. The 4th Int. Conf. of Knowledge Discovery and Data Mining, August 27-31, 1998, New York, NY.
13. Ban-on, A. R., Rissanen, J. and Yu, B. (1998) The MDL principle in modeling and coding. Special issue of IEEE Trans. Information Theory, IT-44, 2743-2760. To commemorate 50 years of information theory.
14. Dom, B. (1996) MDL Estimation for Small Sample Sizes and its Application to Linear Regression. IBM Research Report RJ 10030, June 13.
15. Rissanen, J. (1999) MDL denoising. http://www.cs.tut.fi/~rissanen/ (submitted to IEEE Trans. Information Theory)
16. Clarke, B. S. and Barren, A. R. (1990) Information-theoretic asymptotics of Bayes methods. IEEE Trans. Information Theory, IT-36, 453-471.
17. Merhav, N. and Feder, M. (1995) A strong version of the redundancy-capacity theorem of universal coding. IEEE Trans. Information Theory, IT-41, 714-722.