Discriminative Training Methods for Hidden Markov Models: Theory and Experiments with Perceptron Algorithms

Proceedings of the 2002 Conference on Empirical Methods in Natural Language Processing, EMNLP 2002

Volumn , Issue , 2002, Pages 1-8

  Collins, Michael ^a  

^a AT AND T LABS RESEARCH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; HIDDEN MARKOV MODELS; MAXIMUM ENTROPY METHODS;

DISCRIMINATIVE TRAINING; HIDDEN MARKOV MODEL THEORIES; MAXIMUM ENTROPY MODELS; MODEL EXPERIMENTS; PERCEPTRON ALGORITHMS; RANDOM FIELDS; TAGGING MODELS; TRAINING EXAMPLE; TRAINING METHODS; VITERBI DECODING;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 85127836544     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (12)

1. References Brill, E. (1995). Transformation-Based Error-Driven Learning and Natural Language Processing: A Case Study in Part of Speech Tagging. Computational Linguistics.
2. Collins, M., and Duy, N. (2001). Convolution Kernels for Natural Language. In Proceedings of Neural Information Processing Systems (NIPS 14).
3. Collins, M., and Duy, N. (2002). New Ranking Algorithms for Parsing and Tagging: Kernels over Discrete Structures, and the Voted Perceptron. In Proceedings of ACL 2002.
4. Collins, M. (2002). Ranking Algorithms for Named{ Entity Extraction: Boosting and the Voted Perceptron. In Proceedings of ACL 2002.
5. Freund, Y. & Schapire, R. (1999). Large Margin Classification using the Perceptron Algorithm. In Machine Learning, 37(3):277{296.
6. Helmbold, D., and Warmuth, M. On weak learning. Journal of Computer and System Sciences, 50(3):551-573, June 1995.
7. Lafferty, J., McCallum, A., and Pereira, F. (2001). Conditional random fields: Probabilistic models for segmenting and lab eling sequence data. In Proceedings of ICML 2001.
8. McCallum, A., Freitag, D., and Pereira, F. (2000) Maximum entropy markov models for information extraction and segmentation. In Proceedings of ICML 2000.
9. Marcus, M., Santorini, B., & Marcinkiewicz, M. (1993). Building a large annotated corpus of english: The Penn treebank. Computational Linguistics, 19.
10. Ramshaw, L., and Marcus, M. P. (1995). Text Chunking Using Transformation-Based Learning. In Proceedings of the Third ACL Workshop on Very Large Corpora, Association for Computational Linguistics, 1995.
11. Ratnaparkhi, A. (1996). A maximum entropy part-of-speech tagger. In Proceedings of the empirical methods in natural language processing conference.
12. Rosenblatt, F. 1958. The Perceptron: A Probabilistic Model for Information Storage and Organization in the Brain. Psychological Review, 65, 386-408. (Reprinted in Neurocomputing (MIT Press, 1998).)