Discriminative language modeling with conditional random fields and the perceptron algorithm

Proceedings of the Annual Meeting of the Association for Computational Linguistics

Volumn , Issue , 2004, Pages 47-54

  Roark, Brian ^a   Saraclar, Murat ^a   Collins, Michael ^b   Johnson, Mark ^c  

^a AT AND T LABS RESEARCH   (United States)

^b MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^c BROWN UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; NATURAL LANGUAGE PROCESSING SYSTEMS; RANDOM PROCESSES; SPEECH RECOGNITION;

DETERMINISTICS; DISCRIMINATIVE LANGUAGE MODELS; FEATURES SETS; FINITE-STATE AUTOMATA; LARGE VOCABULARY SPEECH RECOGNITION; PARAMETER ESTIMATION METHOD; PERCEPTRON ALGORITHMS; RANDOM FIELDS; SMALL FEATURES; TWO PARAMETER;

MODELING LANGUAGES;

EID: 85149106909     PISSN: 0736587X     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (26)

1. Cyril Allauzen, Mehryar Mohri, and Brian Roark. 2003. Generalized algorithms for constructing language models. In Proceedings of the 41st Annual Meeting of the Association for Computational Linguistics, pages 40–47.
2. Satish Balay, William D. Gropp, Lois Curfman McInnes, and Barry F. Smith. 2002. Petsc users manual. Technical Report ANL-95/11Revision 2.1.2, Argonne National Laboratory.
3. Satanjeev Banerjee, Jack Mostow, Joseph Beck, and Wilson Tam. 2003. Improving language models by learning from speech recognition errors in a reading tutor that listens. In Proceedings of the Second International Conference on Applied Artificial Intelligence, Fort Panhala, Kolhapur, India.
4. Steven J. Benson and Jorge J. Moré. 2002. A limited memory variable metric method for bound constrained minimization. Preprint ANL/ACSP909-0901, Argonne National Laboratory.
5. Steven J. Benson, Lois Curfman McInnes, Jorge J. Moré, and Jason Sarich. 2002. Tao users manual. Technical Report ANL/MCS-TM-242-Revision 1.4, Argonne National Laboratory.
6. Zheng Chen, Kai-Fu Lee, and Ming Jing Li. 2000. Discriminative training on language model. In Proceedings of the Sixth International Conference on Spoken Language Processing (ICSLP), Beijing, China.
7. Michael Collins. 2002. Discriminative training methods for hidden markov models: Theory and experiments with perceptron algorithms. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 1–8.
8. Michael Collins. 2004. Parameter estimation for statistical parsing models: Theory and practice of distribution-free methods. In Harry Bunt, John Carroll, and Giorgio Satta, editors, New Developments in Parsing Technology. Kluwer.
9. Yoav Freund and Robert Schapire. 1999. Large margin classification using the perceptron algorithm. Machine Learning, 3(37):277–296.
10. Frederick Jelinek. 1995. Acoustic sensitive language modeling. Technical report, Center for Language and Speech Processing, Johns Hopkins University, Baltimore, MD.
11. Mark Johnson, Stuart Geman, Steven Canon, Zhiyi Chi, and Stefan Riezler. 1999. Estimators for stochastic “unification-based” grammars. In Proceedings of the 37th Annual Meeting of the Association for Computational Linguistics, pages 535–541.
12. Sanjeev Khudanpur and Jun Wu. 2000. Maximum entropy techniques for exploiting syntactic, semantic and collocational dependencies in language modeling. Computer Speech and Language, 14(4):355–372.
13. Hong-Kwang Jeff Kuo, Eric Fosler-Lussier, Hui Jiang, and Chin-Hui Lee. 2002. Discriminative training of language models for speech recognition. In Proceedings of the International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Orlando, Florida.
14. John Lafferty, Andrew McCallum, and Fernando Pereira. 2001. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In Proc. ICML, pages 282–289, Williams College, Williamstown, MA, USA.
15. Robert Malouf. 2002. A comparison of algorithms for maximum entropy parameter estimation. In Proc. CoNLL, pages 49–55.
16. Andrew McCallum and Wei Li. 2003. Early results for named entity recognition with conditional random fields, feature induction and web-enhanced lexicons. In Proc. CoNLL.
17. Mehryar Mohri, Fernando C. N. Pereira, and Michael Riley. 2002. Weighted finite-state transducers in speech recognition. Computer Speech and Language, 16(1):69–88.
18. NIST. 2000. Speech recognition scoring toolkit (sctk) version 1.2c. Available at http://www.nist.gov/speech/tools.
19. David Pinto, Andrew McCallum, Xing Wei, and W. Bruce Croft. 2003. Table extraction using conditional random fields. In Proc. ACM SIGIR.
20. Adwait Ratnaparkhi, Salim Roukos, and R. Todd Ward. 1994. A maximum entropy model for parsing. In Proceedings of the International Conference on Spoken Language Processing (ICSLP), pages 803–806.
21. Brian Roark, Murat Saraclar, and Michael Collins. 2004. Corrective language modeling for large vocabulary ASR with the perceptron algorithm. In Proceedings of the International Conference on Acoustics, Speech, and Signal Processing (ICASSP), pages 749–752.
22. Fei Sha and Fernando Pereira. 2003. Shallow parsing with conditional random fields. In Proc. HLT-NAACL, Edmonton, Canada.
23. A. Stolcke and M. Weintraub. 1998. Discriminitive language modeling. In Proceedings of the 9th Hub-5 Conversational Speech Recognition Workshop.
24. A. Stolcke, H. Bratt, J. Butzberger, H. Franco, V. R. Rao Gadde, M. Plauche, C. Richey, E. Shriberg, K. Sonmez, F. Weng, and J. Zheng. 2000. The SRI March 2000 Hub-5 conversational speech transcription system. In Proceedings of the NIST Speech Transcription Workshop.
25. Hanna Wallach. 2002. Efficient training of conditional random fields. Master’s thesis, University of Edinburgh.
26. P.C. Woodland and D. Povey. 2000. Large scale discriminative training for speech recognition. In Proc. ISCA ITRW ASR2000, pages 7–16.