Learning bayesian belief networks based on the MDL principle: An efficient algorithm using the branch and bound technique

IEICE Transactions on Information and Systems

Volumn E82-D, Issue 2, 1999, Pages 356-367

  Suzuki, Joe ^a  

^a OSAKA UNIVERSITY   (Japan)

Author keywords

Bayesian belief networks; Branch and bound technique; Cooper and Herskovits procedure; K2; K3; MDL based procedure; Minimum description length (MDL) principle

Indexed keywords

ALGORITHMS; COMPUTATIONAL METHODS; HEURISTIC METHODS; LEARNING SYSTEMS; PROBABILITY;

BAYESIAN BELIEF NETWORKS; BRANCH AND BOUND TECHNIQUE; MINIMUM DESCRIPTION LENGTH;

NEURAL NETWORKS;

EID: 0033335693     PISSN: 09168532     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (22)

1. H. Akaike, "A new look at the statistical model identification," IEEE Trans. Autom. Control, voI.AC-19, no.6, pp.716-723, Dec. 1974.
2. I.A. Beinlich, H.J. Suermondt, U.M. Chavez, and G.F. Cooper, "The ALARM monitoring system: A case study with two probabilistic inference techniques for belief networks," Proc. 2nd European conference on Artificial Intelligence in Medicine, London, England, pp.247-56, 1989.
3. R.E. Blahut, "Principles and practice of information theory," Addison-Weiley, 1987.
4. R.R. Bouckaert, "Probablistic network construction using the minimum description length principle," Tech. Rep. RUU-CS-94-27, July 1994.
5. C.K. Chow and C.N. Liu, "Approximating discrete probability distributions with dependence trees," IEEE Trans. Inf. Theory, vol.IT-14, no.3, pp.462-467, May 1968.
6. B.S. Clarke and A.R. Barron, "Jefferys prior is asymptotically least favorable under entropy risk," J. of Statistical Planning and Inference, vol.41, pp.37-60, 1994.
7. G.F. Cooper and E. Herskovits, "A Bayesian method for the induction of probabilistic network from data," Machine Learning, vol.9, pp.309-347, July 1992.
8. E.J. Hannan and B.G. Quinn, "The determination of the order of an autoregression," J.R. Statist. Soc. B, vol.41, no.2, pp.190-195, 1979.
9. D. Heckerman, D. Geiger, and D.M. Chickering, "Learning Bayesian networks: The combination of knowledge and statistical data," Machine Learning, vol.20, no.3, 1995.
10. E. Ordentlich and T.M. Cover, "Universal portfolios with side information," IEEE Trans. Inf. Theory, vol.42, no.2, pp.348-363, 1996.
11. J. Ferai, "Probabilistic reasoning in intelligent systems," Morgan Kaufmann, San Mateo, CA, 1988.
12. J. Rissanen "Modeling by shortest data description," Automatica, vol.14, pp.465-471, 1978.
13. J. Rissanen, "Stochastic complexity and modeling," The Annals of Statistics, vol.14, no.3, pp.1080-1100, 1986.
14. R. Shibata, "Selection of the order of an autoregression model by Akaike's information criterion," Biometrika, vol.63, pp.117-126, 1976.
15. C. Spirtes, P. Glymour, and R. Scheines, "Causality from probability," Evolving Knowledge in Natural Science and Artificial Intelligence, pp.181-199, 1990.
16. J. Suzuki, Y. Odake, and S. Hirasawa, "Selection of the stochastic model based on the minimum description length principle and state decomposition," Journal for Information Processing Society, pp.1281-1289, Nov. 1992.
17. J. Suzuki, "A construction of Bayesian networks from databases on an MDL principle," Proc. Ninth Conference on Uncertainty in Artificial Intelligence, Washington D.C., pp.266-273, July 1993.
18. J. Suzuki, "Universal coding scheme minimizing minimum redundancy for sources with an unknown model," IEICE Trans. Fundamentals, vol.E76, no.7, pp. 1234-1239, July 1993.
19. K. Yamanishi, "A learning criterion for stochastic rules," Machine Learning, vol.9, pp.165-203, 1992.
20. W. Lam and F. Bacchus, "Using causal information and local measures to learn Bayesian networks," Uncertainty in Artificial Intelligence '93, Washington D.C., pp.243-250, July 1993.
21. W. Lam and F. Bacchus, "Learning Bayesian belief networks: An approach based on the MDL principle," Computational Intelligence, vol.10, pp.269-293, July 1994.
22. Private communication with R.R. Bouckaert at the 1993 International Workshop on Artificial Intelligence and Statistics, Ft. Lauderdale, FL, Jan. 1993.