Structured learning with constrained conditional models

Machine Learning

Volumn 88, Issue 3, 2012, Pages 399-431

  Chang, Ming Wei ^a   Ratinov, Lev ^a   Roth, Dan ^a  

^a University of Illinois at Urbana Champaign   (United States)

Author keywords

Information extraction; Natural language processing; Semi supervised learning

Indexed keywords

COMPLEX DECISION; CONDITIONAL MODELS; DEPENDENCY STRUCTURES; INFORMATION EXTRACTION; NATURAL LANGUAGE PROCESSING; NONLOCAL; NOVEL ALGORITHM; PERCEPTRON; PROBABILISTIC MODELS; REAL-WORLD PROBLEM; SEMI-SUPERVISED; SEMI-SUPERVISED LEARNING; STRUCTURED LEARNING;

COMPUTATIONAL LINGUISTICS; NATURAL LANGUAGE PROCESSING SYSTEMS; SUPERVISED LEARNING;

LEARNING ALGORITHMS;

EID: 84865223146     PISSN: 08856125     EISSN: 15730565     Source Type: Journal    
DOI: 10.1007/s10994-012-5296-5     Document Type: Article

References (54)

1. Barzilay, R., & Lapata, M. (2006). Aggregation via set partitioning for natural language generation. In Proceedings of HLT/NAACL, June 2006.
2. Bellare, K., Druck, G., & McCallum, A. (2009). Alternating projections for learning with expectation constraints. In Proceedings of uncertainty in artificial intelligence (UAI).
3. Blum, A., & Mitchell, T. (1998). Combining labeled and unlabeled data with co-training. In Proceedings of the annual ACM workshop on computational learning theory (COLT) (pp. 92-100).
4. Borman, S. (2004). The expectation maximization algorithm-a short tutorial. Introduces the Expectation Maximization (EM) algorithm and fleshes out the basic mathematical results, including a proof of convergence. The Generalized EM algorithm is also introduced, July 2004.
5. Carlson, A., Betteridge, J., Wang, R. C., Hruschka, E. R. Jr., & Mitchell, T. M. (2010). Coupled semisupervised learning for information extraction. In Proceedings of the third ACM international conference on web search and data mining.
6. Chang, M., Ratinov, L., & Roth, D. (2007). Guiding semi-supervision with constraint-driven learning. In Proceedings of the annual meeting of the association for computational linguistics (ACL), Prague, Czech Republic, June 2007 (pp. 280-287). New York: Association for Computational Linguistics.
7. Charniak, E., & Johnson, M. (2005). Coarse-to-fine n-best parsing and maxent discriminative reranking. In Proceedings of the annual meeting of the association for computational linguistics (ACL), Ann Arbor, Michigan (pp. 173-180). New York: ACL.
8. Clarke, J., & Lapata, M. (2006). Constraint-based sentence compression: An integer programming approach. In Proceedings of the annual meeting of the association for computational linguistics (ACL), Sydney, Australia, July 2006 (pp. 144-151). New York: ACL.
9. Cohen, W. (2004). Exploiting dictionaries in named entity extraction: Combining semi-Markov extraction processes and data integration methods. In Proceedings of international conference on knowledge discovery and data mining (KDD) (pp. 89-98). (Pubitemid 40114919)
10. Collins, M. (2000). Discriminative reranking for natural language parsing. In Proceedings of the 17th international conference on machine learning (pp. 175-182). San Francisco: Morgan Kaufmann.
11. Collins, M. (2002). Discriminative training methods for hidden Markov models: Theory and experiments with perceptron algorithms. In Proceedings of the conference on empirical methods for natural language processing (EMNLP).
12. Collins, M., & Singer, Y. (1999). Unsupervised models for named entity classification. In Proceedings of the conference on empirical methods for natural language processing (EMNLP).
13. Collins-Thompson, K. (2009). Reducing the risk of query expansion via robust constrained optimization. In Proceedings of ACM conference on information and knowledge management (CIKM) (pp. 837-846).
14. Cozman, F. G., Cohen, I., & Cirelo, M. C. (2003). Semi-supervised learning of mixture models. In Proceedings of the international conference on machine learning (ICML) (pp. 99-106).
15. Daumé, H., & Marcu, D. (2005). Learning as search optimization: Approximate large margin methods for structured prediction. In Proceedings of the international conference on machine learning (ICML), Bonn, Germany, 2005.
16. Dechter, R., & Mateescu, R. (2004). Mixtures of deterministic- probabilistic networks and their AND/OR search space. In Proceedings of AUAI, Arlington, VA, USA, 2004 (pp. 120-129). New York: AUAI Press.
17. Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977). Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society, 39, 1-38.
18. Denis, P., & Baldridge, J. (2007). Joint determination of anaphoricity and coreference resolution using integer programming. In Proceedings of the annual meeting of the North American association of computational linguistics (NAACL).
19. Finkel, J. R., Grenager, T., & Manning, C. (2005). Incorporating non-local information into information extraction systems by Gibbs sampling. In Proceedings of the annual meeting of the association for computational linguistics (ACL), Morristown, NJ, USA, 2005 (pp. 363-370). New York: Association for Computational Linguistics.
20. Friedman, N., Getoor, L., Koller, D., & Pfeffer, A. (1999). Learning probabilistic relational models. In Proceedings of the international joint conference on artificial intelligence (IJCAI) (pp. 1300-1309).
21. Ganchev, K., Graça, J., Gillenwater, J., & Taskar, B. (2010). Posterior regularization for structured latent variable models. Journal of Machine Learning Research.
22. Graca, J. V., Ganchev, K., & Taskar, B. (2007). Expectation maximization and posterior constraints. In NIPS (Vol. 20).
23. Grenager, T., Klein, D., &Manning, C. (2005). Unsupervised learning of field segmentation models for information extraction. In Proceedings of the annual meeting of the association for computational linguistics. New York: ACL.
24. Haghighi, A., & Klein, D. (2006). Prototype-driven learning for sequence models. In Proceedings of HTLNAACL.
25. Hinton, G. (1999). Products of experts. In Proceedings of the 9th international conference on artificial neural networks (ICANN99) (pp. 1-6). (Pubitemid 30519905)
26. Huang, L. (2008). Forest reranking: Discriminative parsing with non-local features. In Proceedings of the annual meeting of the association for computational linguistics (ACL).
27. Jaeger, M. (1997). Relational Bayesian networks. In M. Kaufmann (Ed.), Proceedings of the 13th conference on uncertainty in artificial intelligence (pp. 266-273).
28. Kazama, J.,&Torisawa, K. (2007). A new perceptron algorithm for sequence labeling with non-local features. In Proceedings of the 2007 joint conference of EMNLP-CoNLL (pp. 315-324).
29. Kersting, K., & Raedt, L. D. (2000). Bayesian logic programs. In J. Cussens & A. Frisch (Eds.), Proceedings of the work-in-progress track at the 10th international conference on inductive logic programming (pp. 138-155).
30. Lafferty, J., McCallum, A., & Pereira, F. (2001). Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In Proceedings of the international conference on machine learning (ICML).
31. Liang, P., Jordan, M. I., & Klein, D. (2009). Learning from measurements in exponential families. In Proceedings of the international conference on machine learning (ICML).
32. Liang, P., & Klein, D. (2008). Analyzing the errors of unsupervised learning. In Proceedings of the annual meeting of the association for computational linguistics (ACL).
33. Mann, G., & McCallum, A. (2008). Generalized expectation criteria for semi-supervised learning of conditional random fields. In Proceedings of the annual meeting of the association for computational linguistics (ACL) (pp. 870-878).
34. Marciniak, T., & Strube, M. (2005). Beyond the pipeline: Discrete optimization in NLP. In Proceedings of the annual conference on computational natural language learning (CoNLL), Ann Arbor, MI, June 2005 (pp. 136-143). New York: Association for Computational Linguistics.
35. McCallum, A., Freitag, D.,&Pereira, F. (2000).Maximum entropyMarkovmodels for information extraction and segmentation. In Proceedings of the international conference on machine learning (ICML).
36. Merialdo, B. (1991). Tagging text with a probabilistic model. In Proceedings of the international conference on acoustics, speech, and signal processing.
37. Ng, A. Y., & Jordan, M. I. (2001). On discriminative vs. generative classifiers: A comparison of logistic regression and naive Bayes. In The conference on advances in neural information processing systems (NIPS) (pp. 841-848).
38. Ngo, L., & Haddawy, P. (1995). Probabilistic logic programming and Bayesian networks. In Asian computing science conference (pp. 286-300). (Pubitemid 126004053)
39. Nigam, K., Mccallum, A., Thrun, S., & Mitchell, T. (2000). Text classification from labeled and unlabeled documents using EM. Machine Learning, 39(2/3), 103-134. (Pubitemid 30594822)
40. Punyakanok, V., Roth, D., & Yih, W. (2005a). The necessity of syntactic parsing for semantic role labeling. In Proceedings of the international joint conference on artificial intelligence (IJCAI) (pp. 1117-1123).
41. Punyakanok, V., Roth, D., Yih, W., & Zimak, D. (2005b). Learning and inference over constrained output. In Proceedings of the international joint conference on artificial intelligence (IJCAI) (pp. 1124-1129).
42. Punyakanok, V., Roth, D., & Yih, W. (2008). The importance of syntactic parsing and inference in semantic role labeling. Computational Linguistics, 34(2), 257-287.
43. Rabiner, L. R., & Juang, B. H. (1986). An introduction to hidden Markov models. IEEE ASSP Magazine, 3(1), 4-16.
44. Richardson, M., & Domingos, P. (2006). Markov logic networks. Machine Learning Journal, 62(1-2), 107-136. (Pubitemid 43202307)
45. Rizzolo, N., & Roth, D. (2007). Modeling Discriminative Global Inference. In Proceedings of the first international conference on semantic computing (ICSC), Irvine, CA, September 2007 (pp. 597-604). New York: IEEE.
46. Roth, D. (1999). Learning in natural language. In Proceedings of the international joint conference on artificial intelligence (IJCAI) (pp. 898-904).
47. Roth, D., & Yih,W. (2004). A linear programming formulation for global inference in natural language tasks. In H. T. Ng & E. Riloff (Eds.), Proceedings of the annual conference on computational natural language learning (CoNLL) (pp. 1-8). New York: Association for Computational Linguistics.
48. Roth, D., & Yih, W. (2005). Integer linear programming inference for conditional random fields. In Proceedings of the international conference on machine learning (ICML) (pp. 737-744). (Pubitemid 43183400)
49. Roth, D., & Yih, W. (2007). Global inference for entity and relation identification via a linear programming formulation. In L. Getoor & B. Taskar (Eds.), Introduction to statistical relational learning. Cambridge: MIT Press.
50. Sarawagi, S., & Cohen,W. (2004). Semi-Markov conditional random fields for information extraction. In The conference on advances in neural information processing systems (NIPS) (pp. 1185-1192).
51. Thelen, M., & Riloff, E. (2002). A bootstrapping method for learning semantic lexicons using extraction pattern contexts. In Proceedings of the conference on empirical methods for natural language processing (EMNLP).
52. Toutanova, K., Haghighi, A., & Manning, C. D. (2005). Joint learning improves semantic role labeling. In Proceedings of ACL 2005.
53. Yarowsky, D. (1995). Unsupervised word sense disambiguation rivaling supervied methods. In Proceedings of the annual meeting of the association for computational linguistics (ACL).
54. Zhu, X. (2006). Semi-supervised learning literature survey.