How good are the Bayesian information criterion and the minimum description length principle for model selection? A Bayesian network analysis

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 4293 LNAI, Issue , 2006, Pages 494-504

  Cruz Ramírez, Nicandro ^a   Acosta Mesa, Héctor Gabriel ^a   Barrientos Martínez, Rocío Erandi ^a   Nava Fernández, Luis Alonso ^a  

^a UNIVERSIDAD VERACRUZANA   (Mexico)

Author keywords

[No Author keywords available]

Indexed keywords

CLASSIFICATION (OF INFORMATION); COMPUTATIONAL COMPLEXITY; MATHEMATICAL MODELS;

BAYESIAN INFORMATION CRITERION (BIC); MINIMUM DESCRIPTION LENGTH PRINCIPLE (MDL);

COMPUTER NETWORKS;

EID: 33845914962     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/11925231_46     Document Type: Conference Paper

References (28)

1. Heckerman, D., A Tutorial on Learning with Bayexian Networks, in Learning in Graphical Models, M.I. Jordan, Editor. 1998, MIT Press. p. 301-354.
2. Grunwald, P., Tutorial on MDL, in Advances in Minimum Description Length: Theory and Applications, P. Grunwald, I.J. Myung, and M.A. Pitt, Editors. 2005, The MIT Press.
3. Friedman, N., D. Geiger, and M. Goldszmidt, Bayesian Network Classifiers. Machine Learning, 1997, 29: p. 131-163.
4. Lam, W. and Bacchus, Learning Bayesian belief networks: An approach based on the MDL principle. Computational Intelligence, 1994. 10(4).
5. Grunwald, P., Model Selection Based on Minimum Description Length. Journal of Mathematical Psychology, 2000. 44: p. 133-152.
6. Suzuki, J. Learning Bayesian Belief Networks based on the MDL principle: An efficient algorithm using the branch and bound technique, in International Conference on Machine Learning. 1996. Bary, Italy.
7. Suzuki, J., Learning Bayesian Belief Networks based on the Minimum Description Length Principle: Basic Properties. IEICE Transactions on Fundamentals, 1999. E82-A(10): p. 2237-2245.
8. Cooper, G.F., An Overview of the Representation and Discovery of Causal Relationships using Bayesian Networks, in Computation, Causation & Discovery, C. Glymour and G.F. Cooper, Editors. 1999, AAAI Press / MIT Press, p. 3-62.
9. Cooper, G.F. and E. Herskovits, A Bayesian Method for the Induction of Probabilistic Networks from Data. Machine Learning, 1992. 9: p. 309-347.
10. Cheng, J., Learning Bayesian Networks from data: An information theory based approach, in Faculty of Informatics, University of Ulster, United Kingdom. 1998, University of Ulster: Jordanstown, United Kingdom.
11. Friedman, N. and M. Goldszmidt, Learning Bayesian Networks from Data. 1998, University of California, Berkeley and Stanford Research Institute. p. 117.
12. Cheng, J., Bell, D.A., Liu, W. Learning Belief Networks from Data: An Information Theory Based Approach, in Sixth ACM International Conference on Information and Knowledge Management. 1997: ACM.
13. Spirtes, P., C. Glymour, and R. Scheines, Causation, Prediction and Search. First ed. Lecture Notes in Statistics, ed. J. Berger, et al. Vol. 81. 1993: Springer-Verlag. 526.
14. Bozdogan, H., Akaike's Information Criterion and Recent Developments in Information Complexity. Journal of Mathematical Psychology, 2000. 44: p. 62-91.
15. Heckerman, D., D. Geiger, and D.M. Chickering, Learning Bayesian Networks: The combination of knowledge and statistical data. Machine Learning, 1995.20: p. 197-243.
16. Cruz-Ramirez Nicandro, N.-F.L., Acosta-Mesa Hector Gabriel, Barrientos-Martinez Erandi, Rojas-Marcial Juan Efrain, A Parsimonious Constraint-based Algorithm to Induce Bayesian Network Structures from Data, in IEEE Proceedings of the Mexican International Conference on Computer Science ENC 2005, IEEE, Editor. 2005, IEEE: Puebla. p. 306-313.
17. Cheng, J. and R. Greiner. Learning Bayesian Belief Network Classifiers: Algorithms and Systems. in Proceedings of the Canadian Conference on Artificial Intelligence (CSCSI01). 2001. Ottawa, Canada.
18. Duda, R.O., Hart, Peter E., Stork, David G., Pattern Classification. 2001: John Wiley & Sons, INC.
19. Chickering, D.M., Learning Bayesian Networks from Data, in Computer Science, Cognitive Systems Laboratory. 1996, University of California, Los Angeles: Los Angeles, California, p. 172.
20. Spiegelhalter, D.J., et al., Bayesian Analysis in Expert Systems. Statistical Science, 1993. 8(3): p. 219-247.
21. Norsys, www.norsys.com.
22. Murphy, P.M., Aha, D.W., UCI repository of Machine Learning Databases. 1995.
23. Kurgan, L.A., Cios, Krzysztof J., CAIM Discretization Algorithm. IEEE Transactions on Knowledge and Data Engineering, 2004. 16(2): p. 145-153.
24. Kohavi, R. A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection. in 14th International Joint Conference on Artificial Intelligence IJCAI'95. 1995a. Montreal, Canada: Morgan Kaufmann.
25. Cheng, J. and R. Greiner. Comparing Bayesian Network Classifiers, in Fifteenth Conference on Uncertainty in Artificial Intelligence. 1999.
26. Spirtes, P. and C. Meek. Learning Bayesian Networks with Discrete Variables from Data. in First International Conference on Knowledge Discovery and Data Mining. 1995.
27. Singh, M., Valtorta, Marco. An Algorithm for the Construction of Bayesian Network Structures from Data, in 9th Conference on Uncertainty in Artificial Intelligence. 1993: Morgan Kaufmann.
28. Singh, M., Valtorta, Marco, Construction of Bayesian Network Structures from Data: a Brief Survey and an Efficient Algorithm. International Journal of Approximate Reasoning, 1995. 12: p. 111-131.