Piecewise pseudolikelihood for efficient training of conditional random fields

ACM International Conference Proceeding Series

Volumn 227, Issue , 2007, Pages 863-870

  Sutton, Charles ^a   McCallum, Andrew ^a  

^a Biologically Inspired Neural and Dynamical Systems Laboratory   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BENCHMARKING; COMPUTATIONAL EFFICIENCY; GRAPHIC METHODS; MATHEMATICAL MODELS; MAXIMUM LIKELIHOOD; PIECEWISE LINEAR TECHNIQUES;

CARDINALITY; CRF TRAINING; NLP DATA SETS; PSEUDOLIKELIHOOD; RANDOM FIELDS; RUNNING TIME;

GRAPH THEORY;

EID: 34547987363     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1273496.1273605     Document Type: Conference Paper

References (22)

1. Abbeel, P., Koller, D., &, Ng, A. Y. (2005). Learning factor graphs in polynomial time and sample complexity. Twenty-first Conference on Uncertainty in Artificial Intelligence (UAI05).
2. Besag, J. (1975). Statistical analysis of non-lattice data. The Statistician, 24, 179-195.
3. Daumé III, H., & Marcu, D. (2005). Learning as search optimization: Approximate large margin methods for structured prediction. International Conference on Machine Learning (ICML). Bonn, Germany.
4. Finkel, J. R., Manning, C. D., & Ng, A. Y. (2006). Solving the problem of cascading errors: Approximate bayesian inference for linguistic annotation pipelines. Conference on Empirical Methods in Natural Language Proceeding (EMNLP).
5. Freitag, D. (1998). Machine learning for information extraction in informal domains. Doctoral dissertation, Carnegie Mellon University.
6. Gidas, B. (1988). Consistency of maximum likelihood and pseudolikelihood estimators for gibbs distributions. In W. Fleming and P. Lions (Eds.), Stochastic differential systems, stochastic control theory and applications. New York: Springer.
7. Hyvarinen, A. (2006). Consistency of pseudolikelihood estimation of fully visible boltzmann machines. Neural Computation (pp. 2283-92).
8. Lafferty, J., McCallum, A., &, Pereira, F. (2001). Conditional random fields: Probabilistic models for segmenting and labeling sequence data. Proc. 18th International Conf. on Machine Learning.
9. McCallum, A., Freitag, D., & Pereira, F. (2000). Maximum entropy Markov models for information extraction and segmentation. Proc. 17th International Conf. on Machine Learning (pp. 591-598). Morgan Kaufmann, San Francisco, CA.
10. McCallum, A., & Li, W. (2003). Early results for named entity recognition with conditional random fields, feature induction and web-enhanced lexicons. Seventh Conference on Natural Language Learning (CoNLL).
11. Nocedal, J., &, Wright, S. J. (1999). Numerical optimization. New York: Springer-Verlag.
12. Parise, S., & Welling, M. (2005). Learning in markov random fields: An empirical study. Joint Statistical Meeting (JSM2005).
13. Punyakanok, V., Roth, D., Yih, W., & Zimak, D. (2005). Learning and inference over constrained output. Proc. of the International Joint Conference on Artificial Intelligence (IJCAI) (pp. 1124-1129).
14. Ratnaparkhi, A. (1996). A maximum entropy model for part-of-speech tagging. Proc. of the 1996 Conference on Empirical Methods in Natural Language Proceeding (EMNLP 1996).
15. Schraudolph, N. N. (1999). Local gain adaptation in stochastic gradient descent. Intl. Conf. Artificial Neural Networks (ICANN) (pp. 569-574).
16. Sutton, C., & McCallum, A. (2004). Collective segmentation and labeling of distant entities in information extraction. ICML Workshop on Statistical Relational Learning and Its Connections to Other Fields.
17. Sutton, C., & McCallum, A. (2005). Piecewise training of undirected models. Conference on Uncertainty in Artificial Intelligence (UAI).
18. Sutton, C., & McCallum, A. (2006). An introduction to conditional random fields for relational learning. In L. Getoor and B. Taskar (Eds.), Introduction to statistical relational learning. MIT Press. To appear.
19. Sutton, C., &, Minka, T. (2006). Local training and belief propagation (Technical Report TR-2006-121). Microsoft Research.
20. Sutton, C., Rohanimanesh, K., & McCallum, A. (2004). Dynamic conditional random fields: Factorized probabilistic models for labeling and segmenting sequence data. International Conference on Machine Learning (ICML).
21. Toutanova, K., Klein, D., Manning, C. D., & Singer, Y. (2003). Feature-rich part-of-speech tagging with a cyclic dependency network. HLT-NAACL.
22. Vishwanathan, S., Schraudolph, N. N., Schmidt, M. W., & Murphy, K. (2006). Accelerated training of conditional random fields with stochastic meta-descent. International Conference on Machine Learning (ICML) (pp. 969-976).