Stochastic margin-based structure learning of Bayesian network classifiers

Pattern Recognition

Volumn 46, Issue 2, 2013, Pages 464-471

  Pernkopf, Franz ^a   Wohlmayr, Michael ^a  

^a GRAZ UNIVERSITY OF TECHNOLOGY   (Austria)

Author keywords

Bayesian network classifier; Discriminative learning; Maximum margin learning; Structure learning

Indexed keywords

BAYESIAN NETWORK CLASSIFIERS; BAYESIAN NETWORK STRUCTURE; CLASSIFICATION PERFORMANCE; DISCRIMINATIVE CLASSIFIERS; DISCRIMINATIVE LEARNING; FEATURE VALUES; GRAPHICAL MODEL; GREEDY HEURISTICS; HILL CLIMBING; MAXIMUM MARGIN; PARAMETER LEARNING; SEARCH HEURISTICS; SIGNIFICANT IMPACTS; STRUCTURE-LEARNING;

HEURISTIC ALGORITHMS; SIMULATED ANNEALING; STOCHASTIC SYSTEMS;

BAYESIAN NETWORKS;

EID: 84867399506     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2012.08.007     Document Type: Article

References (33)

1. C. Bishop Pattern Recognition and Machine Learning 2006 Springer
2. F. Pernkopf, and J. Bilmes Efficient heuristics for discriminative structure learning of Bayesian network classifiers Journal of Machine Learning Research 11 2010 2323 2360
3. D.M. Chickering, Learning Bayesian networks is NP-Complete, in: Learning from Data: Artificial Intelligence and Statistics V, Springer-Verlag, 1996, pp. 121-130.
4. M. Koivisto, and K. Sood Exact Bayesian structure discovery in Bayesian networks Journal of Machine Learning Research 5 2004 549 573
5. P. Parviainen, M. Koivisto, Exact structure discovery in Bayesian networks with less space, in: Uncertainty in Artificial Intelligence (UAI), 2009, pp. 436-443.
6. C. de Campos, Z. Zeng, Q. Ji, Structure learning of Bayesian networks using constraints, in: International Conference on Machine Learning (ICML), 2009, pp. 113-120.
7. T. Jaakkola, D. Sontag, A. Globerson, M. Meila, Learning Bayesian network structure using LP relaxations, in: International Conference on Artificial Intelligence and Statistics (AISTATS), 2010, pp. 358-365.
8. M. Teyssier, D. Koller, Ordering-based search: a simple and effective algorithm for learning Bayesian networks, in: 21th Conference on Uncertainty in AI (UAI), 2005, pp. 584-590.
9. E. Keogh, M. Pazzani, Learning augmented Bayesian classifiers: a comparison of distribution-based and classification-based approaches, in: International Workshop on Artificial Intelligence and Statistics, 1999, pp. 225-230.
10. D. Grossman, P. Domingos, Learning Bayesian network classifiers by maximizing conditional likelihood, in: International Conference of Machine Learning (ICML), 2004, pp. 361-368.
11. W. Buntine, Theory refinement on Bayesian networks, in: Uncertainty in Artificial Intelligence (UAI), 1991, pp. 52-60.
12. G. Cooper, and E. Herskovits A Bayesian method for the induction of probabilistic networks from data Machine Learning 9 1992 309 347
13. T. Cover, and J. Thomas Elements of Information Theory 1991 John Wiley & Sons
14. V. Vapnik Statistical Learning Theory 1998 Wiley & Sons
15. B. Taskar, C. Guestrin, D. Koller, Max-margin Markov networks, in: Advances in Neural Information Processing Systems (NIPS), 2003, pp. 25-32.
16. Y. Guo, D. Wilkinson, D. Schuurmans, Maximum margin Bayesian networks, in: International Conference on Uncertainty in Artificial Intelligence (UAI), 2005, pp. 233-242.
17. F. Pernkopf, M. Wohlmayr, and S. Tschiatschek Maximum margin Bayesian network classifiers IEEE Transactions on Pattern Analysis and Machine Intelligence 34 3 2012 521 532
18. Z. Michalewicz, and D. Fogel How to Solve it Modern Heuristics 2000 Springer Verlag
19. T. Wang, J. Touchman, G. Xue, Applying two-level simulated annealing on Bayesian structure learning to infer genetic networks, in: IEEE Computational Systems Bioinformatics Conference, 2004, pp. 647-648.
20. N. Friedman, D. Geiger, and M. Goldszmidt Bayesian network classifiers Machine Learning 29 1997 131 163
21. R. Greiner, X. Su, S. Shen, and W. Zhou Structural extension to logistic regression discriminative parameter learning of belief net classifiers Machine Learning 59 2005 297 322
22. F. Pernkopf, M. Wohlmayr, M. Mücke, Maximum margin structure learning of Bayesian network classifiers, in: IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2011, pp. 2076-2079.
23. R. Peharz, F. Pernkopf, Exact maximum margin structure learning of Bayesian networks, in: International Conference on Machine Learning (ICML), accepted for publication.
24. A. Frank, A. Asuncion, UCI machine learning repository (2010). URL 〈 http://archive.ics.uci.edu/ml 〉.
25. J. Pearl Probabilistic Reasoning in Intelligent Systems Networks of Plausible Inference 1988 Morgan Kaufmann
26. D. Koller, and N. Friedman Probabilistic Graphical Models 2009 The MIT Press
27. F. Pernkopf Bayesian network classifiers versus selective k-NN classifier Pattern Recognition 38 3 2005 1 10
28. P. Bartlett, M. Jordan, and J. McAuliffe Convexity, classification, and risk bounds Journal of the American Statistical Association 101 473 2006 138 156
29. B. Schölkopf, and A. Smola Learning with Kernels Support Vector Machines, Regularization, Optimization, and Beyond 2001 MIT Press
30. M. Pazzani, Searching for dependencies in Bayesian classifiers, in: Learning from Data: Artificial Intelligence and Statistics V, 1996, pp. 239-248.
31. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner Gradient-based learning applied to document recognition Proceedings of the IEEE 86 11 1998 2278 2324
32. R. Collobert, F. Sinz, J. Weston, L. Bottou, Trading convexity for scalability, in: International Conference on Machine Learning (ICML), 2006, pp. 201-208.
33. T. Minka, Discriminative Models, not Discriminative Training, Technical Report, MSR-TR-2005-144, Microsoft Research, 2005.