A Comparative study of information criteria for model selection

International Journal of Bifurcation and Chaos

Volumn 16, Issue 8, 2006, Pages 2153-2175

  Nakamura, Tomomichi ^a   Judd, Kevin ^a   Mees, Alistair I ^b   Small, Michael ^c  

^a UNIVERSITY OF WESTERN AUSTRALIA   (Australia)

^b Prediction Company   (United States)

^c HONG KONG POLYTECHNIC UNIVERSITY   (Hong Kong)

Author keywords

Fitting errors; Information criteria; Model selection; The least squares method

Indexed keywords

BIFURCATION (MATHEMATICS); ERROR ANALYSIS; LEAST SQUARES APPROXIMATIONS; MATHEMATICAL MODELS; PROBLEM SOLVING;

FITTING ERRORS; INFORMATION CRITERIA; MODEL SELECTION;

INFORMATION ANALYSIS;

EID: 30144444999     PISSN: 02181274     EISSN: None     Source Type: Journal    
DOI: 10.1142/S0218127406015982     Document Type: Article

References (32)

1. Akaike, H. [1974] "A new look at the statistical identification model," IEEE Trans. Automat. Contr. 19, 716-723.
2. Barron, A., Rissanen, J. & Yu, B. [1998] "The minimum description length principle in coding and modeling," IEEE Trans. Inform. Th. 44, 2743-2760.
3. Baxter, R. A. & Oliver, J. J. [1994] "MDL and MML: Similarities and differences (introduction to minimum encoding inference - Part III)," Technical Report 207, Department of Computer Science, Monash University, Australia, available at www.act.cmis.csiro.au/rohanb/PAPERS/intro.3.ps
4. Casdagli, M. [1989] "Nonlinear prediction of chaotic time series," Physica D 35, 335-356.
5. Chen, S., Cowan, C. F. N. & Grant, P. M. [1991] "Orthogonal least squares learning algorithm for radial basis function networks," IEEE Trans. Neural Network 2, 302-309.
6. Farmer, J. D. & Sidorowich, J. J. [1987] "Predicting chaotic time series," Phys. Rev. Lett. 59, 845-848.
7. Henon, M. [1976] "A two-dimensional map with a strange attractor," Commun. Math. Phys. 50, 69-77.
8. Judd, K. & Mees, A. I. [1995] "On selecting models for nonlinear time series," Physica D 82, 426-444.
9. Judd, K. & Mees, A. I. [1996] "Modeling chaotic motions of a string from experimental data," Physica D 92, 221-236.
10. Judd, K. & Mees, A. I. [1998] "Embedding as modeling problem," Physica D 120, 273-286.
11. Judd, K. [2003] "Building optimal models of time series," in Chaos and Its Reconstruction, eds. Gouesbet, G., Meunier-Guttin-Cluzel, S. & Menard, O. (Nova Science Pub. Inc.), pp. 179-214.
12. Kilminster, D. [2003] "Modelling dynamical systems via behaviour criterion," PhD thesis, The University of Western Australia, School of Mathematics and Statistics.
13. Kullback, S. & Leibler, R. A. [1951] "On information and sufficiency," Ann. Math Stat. 22, 79-86.
14. Lanterman, A. D. [2001] "Schwarz, Wallace, and Rissanen: Intertwining themes in theories of model order estimation," Int. Statist. Rev. 69, 85-212.
15. Ljung, L. & Ljung, E. J. [1999] System Identification: Theory for the User (Prentice Hall Information and System Sciences Series).
16. Lorenz, E. N. [1963] "Deterministic non-periodic flow," J. Atoms. Sci. 20, 130-141.
17. McSharry, P. E. & Smith, L. A. [1999] "Better nonlinear models from noisy data: Attractors with maximum likelihood," Phys. Rev. Lett. 83, 4285-4288.
18. Mees, A. [1993] "Parsimonious dynamical reconstruction," Int. J. Bifurcation and Chaos 3, 669-675.
19. Mees, A. [2000] Nonlinear Dynamics and Statistics, ed. Mees, A. I. (Birkhäuser, Boston).
20. Nakamura, T., Mees, A. I. & Judd, K. [2003] "Refinements to model selection for nonlinear time series," Int. J. Bifurcation and Chaos 13, 1263-1274.
21. Nakamura, T. [2004] "Modelling nonlinear time series using selection methods and information criteria," PhD thesis, The University of Western Australia, School of Mathematics and Statistics.
22. Nakamura, T., Kilminster, D., Judd, K. & Mees, A. I. [2004] "A comparative study of model selection methods for nonlinear time series," Int. J. Bifurcation and Chaos 14, 1129-1146.
23. Nakamura, T. & Small, M. [2006] "Modelling nonlinear time series using improved least squares method," Int. J. Bifurcation and Chaos 16, 445-464.
24. Oliver, J. J. & Baxter, R. A. [1994] "MML and Bayesianism: Similarities and differences (Introduction to minimum encoding inference -Part II)," Technical Report 206, Department of Computer Science, Monash University, Australia, available at www. act.cmis.csiro.au/rohanb/PAPERS/intro. 2.ps
25. Oliver, J. J. & Hand, D. [1994] "Introduction to minimum coding inference," Technical Report 205, Department of Computer Science, Monash University, Australia. Available at www.act.cmis.csiro.au/rohanb/PAPERS/TR4-94. ps
26. Rissanen, J. [1989] Stochastic Complexity in Statistical Inquiry (World Scientific, Singapore).
27. Rissanen, J. [2000] "MDL Denoising," IEEE Trans. Inform. Th. 46, 2537-2543.
28. Schwarz, G. [1978] "Estimating the dimension of a model," Ann. Stat. 6, 461-464.
29. Small, M. & Judd, K. [1998] "Comparisons of new nonlinear modeling techniques with applications to infant respiration," Physica D 117, 283-298.
30. Small, M. & Judd, K. [1999] "Detecting periodicity in experimental data using linear modeling techniques," Phys. Rev. E 59, 1379-1385.
31. Tong, H. [1990] Non-Linear Time Series: A Dynamical Systems Approach (Oxford University Press, Oxford), Chap. 7.3, pp. 419-429.
32. Wallace, C. S. & Freeman, P. R. [1987] "Estimation and inference by compact coding," J. R. Stat. Soc. B 49, 240-265.