A framework for incorporating general domain knowledge into latent dirichlet allocation using first-order logic

IJCAI International Joint Conference on Artificial Intelligence

Volumn , Issue , 2011, Pages 1171-1177

  Andrzejewski, David ^a   Zhu, Xiaojin ^b   Craven, Mark ^b   Recht, Benjamin ^b  

^a LAWRENCE LIVERMORE NATIONAL LABORATORY   (United States)

^b UNIVERSITY OF WISCONSIN MADISON   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

INFERENCE METHODS; INFERENCE PROBLEM; INFERENCE TECHNIQUES; LATENT DIRICHLET ALLOCATION; LATENT DIRICHLET ALLOCATIONS; MARKOV LOGIC NETWORKS; RESEARCH COMMUNITIES; STOCHASTIC GRADIENT DESCENT;

ARTIFICIAL INTELLIGENCE; FORMAL LOGIC;

STATISTICS;

EID: 84881083774     PISSN: 10450823     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.5591/978-1-57735-516-8/IJCAI11-200     Document Type: Conference Paper

References (29)

1. D. Andrzejewski, A. Mulhern, B. Liblit, and X. Zhu. Statistical debugging using latent topic models. In ECML, pages 6-17. Springer-Verlag, 2007.
2. D. Andrzejewski, X. Zhu, and M. Craven. Incorporating domain knowledge into topic modeling via Dirichlet forest priors. In ICML, pages 25-32. Omnipress, 2009.
3. D. Andrzejewski. Incorporating Domain Knowledge in Latent Topic Models. PhD thesis, University of Wisconsin-Madison, 2010.
4. A. Beck and M. Teboulle. Mirror descent and nonlinear projected subgradient methods for convex optimization. Operations Research Letters, 31(3):167-175, 2003.
5. D. Blei, A. Ng, and M. Jordan. Latent Dirichlet allocation. JMLR, 3:993-1022, 2003.
6. C. Chemudugunta, A. Holloway, P. Smyth, and M. Steyvers. Modeling documents by combining semantic concepts with unsupervised statistical learning. In ISWC, pages 229-244. Springer, 2008.
7. M. Collins, A. Globerson, T. Koo, X. Carreras, and P.L. Bartlett. Exponentiated gradient algorithms for conditional random fields and max-margin Markov networks. JMLR, 9:1775-1822, 2008.
8. P. Domingos and D. Lowd. Markov logic: An interface layer for artificial intelligence. Synthesis Lectures on Artificial Intelligence and Machine Learning, 3(1):1-155, 2009.
9. S. Gerrish and D. Blei. A language-based approach to measuring scholarly impact. In ICML, pages 375-382. Omnipress, 2010.
10. T.L. Griffiths and M. Steyvers. Finding scientific topics. PNAS, 101(Suppl 1):5228-5235, 2004. (Pubitemid 38469131)
11. A. Gruber, M. Rosen-Zvi, and Y. Weiss. Hidden topic Markov models. In AISTATS, pages 163-170. Omnipress, 2007.
12. Y. Hu, J. Boyd-Graber, and B. Satinoff. Interactive topic modeling. In ACL. ACL, 2011.
13. T.N. Huynh and R.J. Mooney. Maxmargin weight learning for Markov logic networks. In ECMLPKDD, pages 564-579. Springer, 2009.
14. K. Kersting, B. Ahmadi, and S. Natarajan. Counting belief propagation. In UAI, pages 277-284. AUAI Press, 2009.
15. J. Kivinen and M.K. Warmuth. Exponentiated gradient versus gradient descent for linear predictors. Information and Computation, 132(1):1-63, 1997. (Pubitemid 127454001)
16. S. Kok, M. Sumner, M. Richardson, P. Singla, H. Poon, D. Lowd, J. Wang, and P. Domingos. The Alchemy System for Statistical Relational AI. Technical report, Department of Computer Science and Engineering, University of Washington, Seattle, WA, 2009.
17. S. Lacoste-Julien, F. Sha, and M. Jordan. DiscLDA: Discriminative learning for dimensionality reduction and classification. In NIPS, pages 897-904. MIT Press, 2008.
18. B. Pang and L. Lee. A sentimental education: Sentiment analysis using subjectivity summarization based on minimum cuts. In ACL, pages 271-278. ACL, 2004.
19. J. Petterson, A. Smola, T. Caetano,W. Buntine, and S. Narayanamurthy. Word features for latent Dirichlet allocation. In NIPS, pages 1921-1929. MIT Press, 2010.
20. H. Poon and P. Domingos. Sound and efficient inference with probabilistic and deterministic dependencies. In AAAI. AAAI Press, 2006.
21. D. Ramage, D. Hall, R. Nallapati, and C.D. Manning. Labeled LDA: a supervised topic model for credit attribution in multi-labeled corpora. In EMNLP, pages 248-256. ACL, 2009.
22. M. Richardson and P. Domingos. Markov logic networks. Machine Learning, 62(1-2):107-136, 2006. (Pubitemid 43202307)
23. S. Riedel. Improving the accuracy and efficiency of MAP inference for Markov logic. In UAI, pages 468-475. AUAI Press, 2008.
24. B. Selman, H. Kautz, and B. Cohen. Local search strategies for satisfiability testing. In DIMACS: Series in Discrete Mathematics and Theoretical Computer Science, pages 521-532. AMS, 1995.
25. J. Shavlik and S. Natarajan. Speeding up inference in Markov logic networks by preprocessing to reduce the size of the resulting grounded network. In IJCAI, pages 1951-1956. Morgan Kaufmann, 2009.
26. P. Singla and P. Domingos. Lifted first-order belief propagation. In AAAI, pages 1094-1099. AAAI Press, 2008.
27. M. Thomas, B. Pang, and L. Lee. Get out the vote: Determining support or opposition from Congressional floor-debate transcripts. In EMNLP, pages 327-335. ACL, 2006.
28. J. Wang and P. Domingos. Hybrid Markov logic networks. In AAAI, pages 1106-1111. AAAI Press, 2008.
29. C. Wang, D. Blei, and F. Li. Simultaneous image classification and annotation. In CVPR, pages 1903-1910. IEEE, 2009.