Entropic criterion for model selection

Physica A: Statistical Mechanics and its Applications

Volumn 370, Issue 2, 2006, Pages 530-538

  Tseng, Chih Yuan ^a  

^a NATIONAL CENTRAL UNIVERSITY   (Taiwan)

Author keywords

Inductive inference; Kullback Leibler distance; Model selection; Probability model; Relative entropy

Indexed keywords

FORMAL LOGIC; MATHEMATICAL MODELS; PROBABILITY DISTRIBUTIONS; STATISTICAL METHODS;

INDUCTIVE INFERENCE; KULLBACK LEIBLER DISTANCE; MODEL SELECTION; PROBABILITY MODEL; RELATIVE ENTROPY;

ENTROPY;

EID: 33748150915     PISSN: 03784371     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.physa.2006.03.024     Document Type: Article

References (25)

1. A. Caticha, Relative entropy and inductive inference, in: G. Erickson, Y. Zhai (Eds.), Bayesian Inference and Maximum Entropy Methods in Science and Engineering, AIP Conference Proceedings, vol. 707, 2004 (available from arXiv.org/abs/physics/0311093).
2. Raftery A.E. Sociol. Methodol. 25 (1995) 111
3. Weiss R.E. J. Am. Stat. Assoc. 90 (1995) 619
4. Raftery A.E., Madigan D., and Hoeting J.A. J. Am. Stat. Assoc. 92 (1997) 179
5. Kieseppa I.A. Philos. Sci. 68 (2000) S141
6. Forbes F., and Peyrard N. IEEE Trans. Pattern Anal. Mach. Intell. 25 (2003) 1089
7. B.V. Bonnlander, A.E. Weigend, Selecting input variables using mutual information and nonparametric density estimation, in: Proceedings of the 1994 International Symposium on Artificial Neural Networks, 1994, pp. 42-50.
8. Dupuis J.A., and Robert C.P. J. Stat. Plann. Infer. 111 (2003) 77
9. Jaynes E.T. Phys. Rev. 106 (1957) 620
10. Jaynes E.T. Phys. Rev. 108 (1957) 171
11. Jaynes E.T. Probability Theory: The Logic of Science (2003), Cambridge University Press, Cambridge
12. Shore J.E., and Johnson R.W. IEEE Trans. Inf. Theory IT-26 (1980) 26
13. Shore J.E., and Johnson R.W. IEEE Trans. Inf. Theory IT-27 (1981) 472
14. Skilling J. The axioms of maximum entropy. In: Erickson G.J., and Smith C.R. (Eds). Maximum-Entropy and Bayesian Methods in Science and Engineering (1988), Kluwer, Dordrecht
15. Skilling J. Classic maximum entropy. In: Skilling J. (Ed). Maximum Entropy and Bayesian Methods (1989), Kluwer, Dordrecht
16. Skilling J., and Quantified maximum entropy. In: Fougère P.F. (Ed). Maximum Entropy and Bayesian Methods (1990), Kluwer, Dordrecht
17. Barker J.A., and Henderson D. Rev. Mod. Phys. 48 (1976) 587
18. Hansen J.P., and McDonald I.R. Theory of Simple Liquids. second ed. (1986), Academic Press, London
19. Kalikmanov V.I. Statistical Physics of Fluids (2002), Springer, New York
20. C.-Y. Tseng, A. Caticha, Maximum entropy approach to a mean field theory for fluids, in: C.J. Williams (Ed.), Bayesian Inference and Maximum Entropy Methods in Science and Engineering, AIP Conference Proceedings, vol. 659, 2003 (available from arXiv.org/abs/cond-mat/0212198).
21. Mansoori G.A., and Canfield F.B. J. Chem. Phys. 51 (1969) 4958
22. C.-Y. Tseng, A. Caticha, Maximum entropy approach to the theory of simple fluids, in: G. Erickson, Y. Zhai (Eds.), Bayesian Inference and Maximum Entropy Methods in Science and Engineering, AIP Conference Proceedings, vol. 707, 2004 (available from arXiv.org/abs/cond-mat/0310746)
23. C.-Y. Tseng, A. Caticha, Maximum entropy and the variational method in statistical mechanics: an application to simple fluids, in the process of reviewing for publication in Phys. Rev. E 2004 (available from arXiv.org.abs/cond-mat/0411625).
24. Weeks J.D., Chandler D., and Andersen H.C. J. Chem. Phys. 54 (1971) 5237
25. Weeks J.D., Chandler D., and Andersen H.C. Science 220 (1983) 787