Global statistical information in exponential experiments and selection of exponential models

Applications of Mathematics

Volumn 43, Issue 1, 1998, Pages 23-51

  Vajda, Igor ^a   Van Der Meulen, E ^b  

^a INSTITUTE OF INFORMATION THEORY AND AUTOMATION   (Czech Republic)

^b UNIVERSITY OF LEUVEN   (Belgium)

Author keywords

Akaike criterion; Exponential families; Fisher information; Global information; Information divergence; Model selection

Indexed keywords

EID: 0042969021     PISSN: 08627940     EISSN: None     Source Type: Journal    
DOI: 10.1023/A:1022244007831     Document Type: Article

References (21)

1. Akaike H.: Information theory and an extension of the maximum likelihood principle. Proceedings of the Second International Symposium on Information Theory (B. N. Petrov et al., eds.). Akademiai Kiado, Budapest, 1973, pp. 267-281.
2. Bauer, P., Pötscher B. M. and Hackl P.: Model selection by multiple test procedures. Statistics 19 (1988), 39-44.
3. Berlinet, A. and Francq, Ch.: Identification of a univariate ARMA model. Comp. Statist. 9 (1994), 117-133.
4. Brown, L. D.: Fundamentals of Statistical Exponential Families. Inst. of Mathem. Statist, Hayword, California, 1986.
5. Chernoff, H.: On the distribution of likelihood ratio. Ann. Math. Statist. 25 (1954), 573-578.
6. Kullback, S.: Information Theory and Statistics. Wiley, New York, 1959.
7. Lehmann, E. L.: Testing Statistical Hypotheses. 2nd edition, Wiley, New York, 1986.
8. Liese, F. and Vajda, J.: Convex Statistical Distances. Teubner, Leipzing, 1987.
9. Nikolov, V.: Regression and Autoregression Models of Signals and their Recognition by Neural Nets. Diploma Theses. Faculty of Physical and Nuclear Engineering, Czech Tech. University, Prague, 1996. (In Czech.)
10. Nishii, R.: Maximum likelihood principle and model selection when the true model is unspecified. Journal of Multivariate Analysis 27 (1988), 392-403.
11. Pötscher, B. M.: Order estimation in Arma-models by Lagrangian multiplier test. Ann. Statist. 11 (1983), 872-885.
12. Rissanen, J.: Modelling by shortest data description. Automatica 14 (1978), 465-471.
13. Rockefellar, R. T.: Convex Analysis. Princeton University Press, Princeton, 1970.
14. Ronchetti, E.: Robust model selection. In Transactions of the Twelfth Prague Conference on Information Theory, ... (J. Á. Víšek, and P. Lachout, eds.). Academy of Sciences of the Czech Republic, Prague, 1994, pp. 200-202.
15. Rydén, T.: Estimating the order of hidden Markov models. Statistics 26 (1995), 345-354.
16. Sahamoto, Y., Ishiguro, M. and Kitagawa, G.: Akaike Information Criterion Statistics. Reidel, Dordrecht, 1986.
17. Schwartz, G.: Estimating the dimension of a model. Annals of Statistics 6 (1978), 461-464.
18. Spanier, J. and Oldham, K. B.: An Atlas of Functions. Springer, Berlin, 1987.
19. Speed, T. P. and Yu, B.: Model collection and prediction: Normal regression. Ann. Inst. Statist. Math. 45 (1993), 35-54.
20. Vajda, I.: Global statistical information, likelihood ratio tests and maximum likelihood estimators. Kybernetika (submitted) (1997).
21. Vieu, P.: Order choice of nonlinear autoregressive models. Statistics 2b (1995), 307-308.