Robust RegBayes: Selectively incorporating first-order logic domain knowledge into bayesian models

31st International Conference on Machine Learning, ICML 2014

Volumn 1, Issue , 2014, Pages 425-442

  Mei, Shike ^a   Zhu, Jun ^b   Zhu, Xiaojin ^a  

^a University of Wisconsin Madison   (United States)

^b TSINGHUA UNIVERSITY   (China)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; BAYESIAN NETWORKS; FORMAL LOGIC; LEARNING SYSTEMS;

BAYESIAN FRAMEWORKS; DIRECT APPROACH; DOMAIN KNOWLEDGE; FIRST ORDER LOGIC; LATENT TOPIC MODEL; POSTERIOR DISTRIBUTIONS; PRIOR DISTRIBUTION; TASK PERFORMANCE;

UNCERTAINTY ANALYSIS;

EID: 84919825338     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (17)

1. Andrzejewski, D., Zhu, X., Craven, M., and Recht, B. A framework for incorporating general domain knowledge into latent Dirichlet allocation using first-order logic. In International Joint Conference on Artificial Intelligence (IJCAI), 2011.
2. Asuncion, A., Welling, M., Smyth, P., and Teh, Y.W. On smoothing and inference for topic models. In Uncertainty in Artificial Intelligence (UAI), 2009.
3. Blei, D.M., Ng, A.Y., and Jordan, M.I. Latent Dirichlet allocation. Journal of Machine Learning Research, 3: 993-1022, 2003.
4. Bottou, L. and Bousquet, O. The tradeoffs of large-scale learning. Optimization for Machine Learning, pp. 351, 2011.
5. Garthwaite, P., Kadane, J., and O'Hagan, A. Statistical methods for eliciting probability distributions. Journal of the American Statistical Association, 100(470): 680-700, 2005.
6. Mao, Y. and Lebanon, G. Domain knowledge uncertainty and probabilistic parameter constraints. In Uncertainty in Artificial Intelligence (UAI), 2009.
7. Raykar, V., Yu, S., Zhao, L., Valadez, G.H., Florin, C, Bo-goni, L., and Moy, L. Learning from crowds. Journal of Machine Learning Research, 11: 1297-1322, 2010.
8. Richardson, M. and Domingos, P. Markov logic networks. Machine Learning, 62(1-2): 107-136, 2006.
9. Teh, Y.W., Newman, D., and Welling, M. A collapsed variational Bayesian inference algorithm for latent Dirichlet allocation. Advances in Neural Information Processing Systems (NIPS), 19: 1353, 2007.
10. Wainwright, M.J. and Jordan, M.I. Graphical models, exponential families, and variational inference. Foundations and Trends in Machine Learning, 1(1-2): 1-305, 2008.
11. Wang, H., Lu, Y, and Zhai, C. Latent aspect rating analysis on review text data: a rating regression approach. In International Conference on Knowledge Discovery and Data mining (SIGKDD), 2010.
12. Welinder, P., Branson, S., Belongie, S., and Perona, P. The multidimensional wisdom of crowds. In Advances in Neural Information Processing Systems (NIPS), 2010.
13. Zhu, J. Max-margin nonparametric latent feature models for link prediction. In International Conference on Machine Learning (ICML), 2012.
14. Zhu, J. and Xing, E.P. Conditional topic random fields. In International Conference on Machine Learning (ICML), 2010.
15. Zhu, J., Chen, N., and Xing, E.P. Infinite latent SVM for classification and multi-task learning. Advances in Neural Information Processing Systems (NIPS), 25, 2011.
16. Zhu, J., Chen, N., Perkins, H., and Zhang, B. Gibbs max-margin topic models with fast sampling algorithms. In International Conference on Machine Learning (ICML), 2013a.
17. Zhu, J., Chen, N., and Xing, E.P. Bayesian inference with posterior regularization and applications to infinite latent SVMs. arXiv: 1210.1766v2, 2013b.