An improved Bayesian structural EM algorithm for learning Bayesian networks for clustering

Pattern Recognition Letters

Volumn 21, Issue 8, 2000, Pages 779-786

  Pena J M ^a   Lozano, J A ^a   Larranaga P ^a  

^a UNIVERSITY OF THE BASQUE COUNTRY UPV EHU   (Spain)

Author keywords

Bayesian networks; Bayesian Structural EM algorithm; Bound and collapse method; Clustering; EM algorithm

Indexed keywords

ALGORITHMS; DATABASE SYSTEMS; LEARNING SYSTEMS; MATHEMATICAL MODELS; OPTIMIZATION; PROBABILITY DISTRIBUTIONS;

BAYESIAN NETWORKS; BAYESIAN STRUCTURAL ALGORITHM; DATA CLUSTERING; EXPECTATION MAXIMIZATION ALGORITHM;

PATTERN RECOGNITION;

EID: 0033685826     PISSN: 01678655     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0167-8655(00)00038-6     Document Type: Article

References (23)

1. Banfield J., Raftery A. Model-based Gaussian and non-Gaussian clustering. Biometrics. 49:1993;803-821.
2. Castillo E., Gutiérrez J.M., Hadi A.S. Expert Systems and Probabilistic Network Models. 1997;Springer, New York.
3. Cheeseman, P., Stutz, J., 1995. Bayesian classification (AutoClass): Theory and results. In: Advances in Knowledge Discovery and Data Mining. AAAI Press, Menlo Park, CA, pp. 153-180.
4. Dempster A., Laird N., Rubin D. Maximum likelihood from incomplete data via the EM algorithm. J. Roy. Statist. Soc. Ser. B. 39:1977;1-38.
5. Duda R., Hart P. Pattern Classification and Scene Analysis. 1973;Wiley, New York.
6. Fisher D. Knowledge acquisition via incremental conceptual clustering. Machine Learning. 2:1987;139-172.
7. Friedman, N., Goldszmidt, M., 1996. Building classifiers using Bayesian networks. In: Proc. 13th National Conf. on Artificial Intelligence. AAAI Press, Menlo Park, CA, pp. 1277-1284.
8. Friedman, N., 1997. Learning belief networks in the presence of missing values and hidden variables. In: Proc. 14th Internat. Conf. on Machine Learning. Morgan Kaufmann, San Francisco, CA.
9. Friedman, N., 1998. The Bayesian Structural EM algorithm. In: Proc. 14th Conf. on Uncertainty in Artificial Intelligence. Morgan Kaufmann, San Francisco, CA, pp. 129-138.
10. Hartigan J.A. Clustering Algorithms. 1975;Wiley, Canada.
11. Jensen F.V. An Introduction to Bayesian Networks. 1996;Springer, New York.
12. Kaufman L., Rousseeuw P. Finding Groups in Data. 1990;Wiley, New York.
13. Keogh, E.J., Pazzani, M.J., 1999. Learning augmented Bayesian classifiers: A comparison of distribution-based and classification-based approaches. In: Proc. Seventh Internat. Workshop on Artificial Intelligence and Statistics. Ft. Lauderdale, FL, pp. 225-230.
14. McLachlan G.J., Krishnan T. The EM Algorithm and Extensions. 1997;Wiley, New York.
15. Meila, M., Heckerman, D., 1998. An experimental comparison of several clustering and initialization methods. In: Proc. 14th Conf. on Uncertainty in Artificial Intelligence. Morgan Kaufmann, San Francisco, CA, pp. 386-395.
16. Meila M., Jordan M.I. Estimating dependency structure as a hidden variable. Neural Inform. Process. Syst. 10:1997;584-590.
17. Merz, C., Murphy, P., Aha, D., 1997. UCI repository of machine learning databases, Department of Information and Computer Science, University of California, Irvine, http://www.ics.uci.edu/mlearn/MLRepository.html.
18. Pearl J. Probabilistic Reasoning in Intelligent Systems. 1988;Morgan Kaufmann, Palo Alto, CA.
19. Peña J.M., Lozano J.A., Larrañaga P. Learning Bayesian networks for clustering by means of constructive induction. Pattern Recognition Lett. 20(11-13):1999;1219-1230.
20. Peña, J.M., Lozano, J.A., Larrañaga, P., 2000. Learning recursive Bayesian multinets for clustering by means of constructive induction. Machine Learning, accepted.
21. Ramoni, M., Sebastiani, P., 1997. Learning Bayesian networks from incomplete databases. In: Proc. 13th Conf. on Uncertainty in Artificial Intelligence. Morgan Kaufmann, San Mateo, CA.
22. Ramoni M., Sebastiani P. Parameter estimation in Bayesian networks from incomplete databases. Intelligent Data Analysis. 2(1):1998.
23. Thiesson, B., Meek, C., Chickering, D.M., Heckerman, D., 1998. Learning mixtures of DAG models. In: Proc. 14th Conf. on Uncertainty in Artificial Intelligence. Morgan Kaufmann, San Francisco, CA, pp. 504-513.