Discriminative learning of bayesian networks via factorized conditional log-likelihood

Journal of Machine Learning Research

Volumn 12, Issue , 2011, Pages 2181-2210

  Carvalho, Alexandra M ^a   Roos, Teemu ^b   Oliveira, Arlindo L ^a   Myllym̈aki, Petri ^a  

^a INSTITUTO SUPERIOR TÉCNICO   (Portugal)

^b UNIVERSITY OF HELSINKI   (Finland)

Author keywords

Approximation; Bayesian networks; Classification; Conditional log likelihood; Discriminative learning; Scoring criterion

Indexed keywords

APPROXIMATION; BENCHMARK DATA; COMPUTATIONAL RESOURCES; DECOMPOSABILITY; DISCRIMINATIVE LEARNING; EFFICIENT ESTIMATION; EMPIRICAL COMPARISON; INTERACTION INFORMATION; LEARNING BAYESIAN NETWORKS; LOG LIKELIHOOD; NETWORK STRUCTURES; OPTIMAL PARAMETER; SCORING CRITERIA; SPACE COMPLEXITY; UCI REPOSITORY;

DISTRIBUTED PARAMETER NETWORKS; INFERENCE ENGINES; INFORMATION THEORY; INTELLIGENT NETWORKS;

BAYESIAN NETWORKS;

EID: 80052204958     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Article

References (39)

1. A. J. Bell. The co-information lattice. In Proc. ICA'03, pages 921-926, 2003.
2. J. Bilmes. Dynamic Bayesian multinets. In Proc. UAI'00, pages 38-45. Morgan Kaufmann, 2000.
3. A. M. Carvalho. Scoring function for learning Bayesian networks. Technical report, INESC-ID Tec. Rep. 54/2009, 2009.
4. A. M. Carvalho, A. L. Oliveira, and M.-F. Sagot. Efficient learning of Bayesian network classifiers: An extension to the TAN classifier. In M. A. Orgun and J. Thornton, editors, Proc. IA'07, volume 4830 of LNCS, pages 16-25. Springer, 2007.
5. D. M. Chickering. A transformational characterization of equivalent Bayesian network structures. In Proc. UAI'95, pages 87-98. Morgan Kaufmann, 1995.
6. D. M. Chickering. Learning Bayesian networks is NP-complete. In D. Fisher and H.-J. Lenz, editors, Learning from Data: AI and Statistics V, pages 121-130. Springer, 1996.
7. D. M. Chickering. Learning equivalence classes of Bayesian-network structures. Journal of Machine Learning Research, 2:445-498, 2002. (Pubitemid 135712569)
8. D. M. Chickering, D. Heckerman, and C. Meek. Large-sample learning of Bayesian networks is NP-hard. Journal of Machine Learning Research, 5:1287-1330, 2004.
9. C. K. Chow and C. N. Liu. Approximating discrete probability distributions with dependence trees. IEEE Transactions on Information Theory, 14(3):462-467, 1968.
10. T. Cover and J. Thomas. Elements of Information Theory. John Wiley & Sons, 2006.
11. S. Dasgupta. Learning polytrees. In Proc. UAI'99, pages 134-141. Morgan Kaufmann, 1999.
12. L. M. de Campos. A scoring function for learning Bayesian networks based on mutual information and conditional independence tests. Journal of Machine Learning Research, 7:2149-2187, 2006. (Pubitemid 44582045)
13. P. Domingos and M. J. Pazzani. On the optimality of the simple Bayesian classifier under zero-one loss. Machine Learning, 29(2-3):103-130, 1997. (Pubitemid 127510035)
14. J. Edmonds. Optimum branchings. Journal of Research of the National Bureau of Standards, 71B: 233-240, 1967.
15. U. M. Fayyad and K. B. Irani. Multi-interval discretization of continuous-valued attributes for classification learning. In Proc. IJCAI'93, pages 1022-1029. Morgan Kaufmann, 1993.
16. N. Friedman, D. Geiger, and M. Goldszmidt. Bayesian network classifiers. Machine Learning, 29 (2-3):131-163, 1997. (Pubitemid 127510036)
17. R. Greiner and W. Zhou. Structural extension to logistic regression: Discriminative parameter learning of belief net classifiers. In Proc. AAAI/IAAI'02, pages 167-173. AAAI Press, 2002.
18. R. Greiner, X. Su, B. Shen, and W. Zhou. Structural extension to logistic regression: Discriminative parameter learning of belief net classifiers. Machine Learning, 59(3):297-322, 2005. (Pubitemid 40890481)
19. D. Grossman and P. Domingos. Learning Bayesian network classifiers by maximizing conditional likelihood. In Proc. ICML'04, pages 46-53. ACM Press, 2004.
20. M. Hall, E. Frank, G. Holmes, B. Pfahringer, P. Reutemann, and I. H. Witten. The WEKA data mining software: An update. SIGKDD Explorations, 11(1):10-18, 2009.
21. D. Heckerman, D. Geiger, and D. M. Chickering. Learning Bayesian networks: The combination of knowledge and statistical data. Machine Learning, 20(3):197-243, 1995.
22. C.-W. Hsu, C.-C. Chang, and C.-J. Lin. A practical guide to support vector classification. Technical report, Department of Computer Science, National Taiwan University, 2003.
23. A. Jakulin. Machine Learning Based on Attribute Interactions. PhD thesis, University of Ljubljana, 2005.
24. R. Kohavi. A study of cross-validation and bootstrap for accuracy estimation and model selection. In Proc. IJCAI'95, pages 1137-1145. Morgan Kaufmann, 1995.
25. R. Kohavi and G. H. John. Wrappers for feature subset selection. Artificial Intelligence, 97(1-2): 273-324, 1997. (Pubitemid 127401107)
26. P. Kontkanen, P. Myllymäki, T. Silander, and H. Tirri. BAYDA: Software for Bayesian classification and feature selection. In Proc. KDD'98, pages 254-258. AAAI Press, 1998
27. E. Lawler. Combinatorial Optimization: Networks and Matroids. Dover, 1976.
28. W. J. McGill. Multivariate information transmission. Psychometrika, 19:97-116, 1954.
29. C. Meek. Finding a path is harder than finding a tree. Journal of Artificial Intelligence Research, 15:383-389, 2001.
30. D. J. Newman, S. Hettich, C. L. Blake, and C. J. Merz. UCI repository of machine learning databases, 1998. URL http://www.ics.uci.edu/̃mlearn/ MLRepository.html.
31. J. Pearl. Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. Morgan Kaufmann, San Francisco, CA, USA, 1988.
32. S. V. Pemmaraju and S. S. Skiena. Computational Discrete Mathematics: Combinatorics and Graph Theory with Mathematica. Cambridge University Press, 2003.
33. F. Pernkopf and J. A. Bilmes. Discriminative versus generative parameter and structure learning of Bayesian network classifiers. In Proc. ICML'05, pages 657-664. ACM Press, 2005. (Pubitemid 43183390)
34. T. Roos, H. Wettig, P. Grünwald, P. Myllymäki, and H. Tirri. On discriminative Bayesian network classifiers and logistic regression. Machine Learning, 59(3):267-296, 2005. (Pubitemid 40890480)
35. T. Silander, T. Roos, and P. Myllymäki. Learning locally minimax optimal Bayesian networks. International Journal of Approximate Reasoning, 51(5):544-557, 2010.
36. J. Su and H. Zhang. Full Bayesian network classifiers. In Proc. ICML'06, pages 897-904. ACM Press, 2006. (Pubitemid 44483020)
37. J. Su, H. Zhang, C. X. Ling, and S. Matwin. Discriminative parameter learning for Bayesian networks. In Proc ICML'08, pages 1016-1023. ACM Press, 2008.
38. T. Verma and J. Pearl. Equivalence and synthesis of causal models. In Proc. UAI'90, pages 255-270. Elsevier, 1990.
39. S. Yang and K.-C. Chang. Comparison of score metrics for Bayesian network learning. IEEE Transactions on Systems, Man, and Cybernetics, Part A, 32(3):419-428, 2002.