Softmax-Margin CRFs: Training log-linear models with cost functions

NAACL HLT 2010 - Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics, Proceedings of the Main Conference

Volumn , Issue , 2010, Pages 733-736

  Gimpel, Kevin ^a   Smith, Noah A ^a  

^a Carnegie Mellon University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

LOG LIKELIHOOD; LOGLINEAR MODEL; NAMED-ENTITY RECOGNITION; STRUCTURED MODEL; STRUCTURED PREDICTION;

COMPUTATIONAL LINGUISTICS; MATHEMATICAL MODELS; REGRESSION ANALYSIS; SPEECH RECOGNITION;

COST FUNCTIONS;

EID: 84858385957     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (22)

1. A. Berger, V. J. Della Pietra, and S. A. Della Pietra. 1996. A maximum entropy approach to natural language processing. Computational Linguistics, 22(1):39-71.
2. M. Collins. 2002a. Discriminative training methods for hidden Markov models: Theory and experiments with perceptron algorithms. In Proc. of EMNLP.
3. M. Collins. 2002b. Ranking algorithms for named-entity extraction: Boosting and the voted perceptron. In Proc. of ACL.
4. K. Crammer, O. Dekel, J. Keshet, S. Shalev-Shwartz, and Y. Singer. 2006. Online passive-aggressive algorithms. Journal of Machine Learning Research, 7:551-585. (Pubitemid 43668115)
5. K. Gimpel and N. A. Smith. 2010. Softmax-margin training for structured log-linear models. Technical report, Carnegie Mellon University.
6. M. Jansche. 2005. Maximum expected F-measure training of logistic regression models. In Proc. of HLT-EMNLP.
7. J. Kaiser, B. Horvat, and Z. Kacic. 2000. A novel loss function for the overall risk criterion based discriminative training of HMM models. In Proc. of ICSLP.
8. S. Kakade, Y. W. Teh, and S. Roweis. 2002. An alternate objective function for Markovian fields. In Proc. of ICML.
9. J. Kazama and K. Torisawa. 2007. A new perceptron algorithm for sequence labeling with non-local features. In Proc. of EMNLP-CoNLL.
10. P. Koehn. 2004. Statistical significance tests for machine translation evaluation. In Proc. of EMNLP.
11. J. Lafferty, A. McCallum, and F. Pereira. 2001. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In Proc. of ICML.
12. Z. Li and J. Eisner. 2009. First-and second-order expectation semirings with applications to minimum-risk training on translation forests. In Proc. of EMNLP.
13. F. J. Och. 2003. Minimum error rate training for statistical machine translation. In Proc. of ACL.
14. D. Povey and P. C. Woodland. 2002. Minimum phone error and I-smoothing for improved discrimative training. In Proc. of ICASSP.
15. D. Povey, D. Kanevsky, B. Kingsbury, B. Ramabhadran, G. Saon, and K. Visweswariah. 2008. Boosted MMI for model and feature space discriminative training. In Proc. of ICASSP.
16. N. Ratliff, J. A. Bagnell, and M. Zinkevich. 2006. Subgradient methods for maximum margin structured learning. In ICML Workshop on Learning in Structured Output Spaces.
17. F. Sha and L. K. Saul. 2006. Large margin hidden Markov models for automatic speech recognition. In Proc. of NIPS.
18. D. A. Smith and J. Eisner. 2006. Minimum risk annealing for training log-linear models. In Proc. of COLING-ACL.
19. J. Suzuki, E. McDermott, and H. Isozaki. 2006. Training conditional random fields with multivariate evaluation measures. In Proc. of COLING-ACL.
20. B. Taskar, C. Guestrin, and D. Koller. 2003. Max-margin Markov networks. In Advances in NIPS 16.
21. E. F. Tjong Kim Sang and F. De Meulder. 2003. Introduction to the CoNLL-2003 shared task: Language-independent named entity recognition. In Proc. of CoNLL.
22. Y. Xiong, J. Zhu, H. Huang, and H. Xu. 2009. Minimum tag error for discriminative training of conditional random fields. Information Sciences, 179(1-2):169-179.