Efficient discriminative training of long-span language models

2011 IEEE Workshop on Automatic Speech Recognition and Understanding, ASRU 2011, Proceedings

Volumn , Issue , 2011, Pages 214-219

  Rastrow, Ariya ^a   Dredze, Mark ^a   Khudanpur, Sanjeev ^a  

^a Johns Hopkins University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BROADCAST NEWS; COMPUTATIONAL SAVINGS; DISCRIMINATIVE TRAINING; HILL CLIMBING; LANGUAGE MODEL; LONG SPAN; N-BEST HYPOTHESIS; STATE OF THE ART; TRAINING METHODS;

COMPUTATIONAL LINGUISTICS;

SPEECH RECOGNITION;

EID: 84858980581     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ASRU.2011.6163933     Document Type: Conference Paper

References (21)

1. A. Rastrow, M. Dreyer, A. Sethy, S. Khudanpur, B. Ramabhadran, and M. Dredze, "Hill climbing on speech lattices: A new rescoring framework," in ICASSP, 2011.
2. R. Kneser and H. Ney, "Improved backing-off for m-gram language modeling," in ICASSP, 1995.
3. S. Katz, "Estimation of probabilities from sparse data for the language model component of a speech recognizer." IEEE Transactions on Acoustics, Speech, and Signal Processing, vol. 35, No. 3, 1987.
4. S. Khudanpur and J. Wu, "Maximum entropy techniques for exploiting syntactic, semantic and collocational dependencies in language modeling," Computer Speech and Language, pp. 355-372, 2000.
5. P. Brown, P. Desouza, R. Mercer, V. Pietra, and J. Lai, "Class-based n-gram models of natural language," Computational linguistics, vol. 18, No. 4, pp. 467-479, 1992.
6. T. Niesler, E. Whittaker, and P. Woodland, "Comparison of part-of-speech and automatically derived category-based language models for speech recognition," in ICASSP, 1998.
7. D. Filimonov and M. Harper, "A joint language model with fine-grain syntactic tags," in EMNLP, 2009.
8. C. Chelba and J. Frederick, "Structured language modeling," Computer Speech and Language, vol. 14, No. 4, pp. 283-332, 2000.
9. M. Collins, B. Roark, and M. Saraclar, "Discriminative syntactic language modeling for speech recognition," in ACL, 2005.
10. H.-K. J. Kuo, B. Kingsbury, and G. Zweig, "Discriminative training of decoding graphs for large vocabulary continuous speech recognition," in Proc. ICASSP, vol. 4, 2007, pp. 45-48.
11. B. Roark, M. Saraclar, and M. Collins, "Discriminative n-gram language modeling," Computer Speech & Language, vol. 21(2), 2007.
12. A. Rastrow, A. Sethy, and B. Ramabhadran, "Constrained Discriminative Training of N-gram Language Models," in ASRU, 2009.
13. A. Deoras and F. Jelinek, "Iterative decoding: A novel re-scoring framework for confusion networks," in ASRU, 2009.
14. M. Collins, "Discriminative training methods for hidden markov models: Theory and experiments with perceptron algorithms," in EMNLP, 2002.
15. J. Cheppalier, M. Rajman, R. Aragues, and A. Rozenknop, "Lattice parsing for speech recognition," in Sixth Conference sur le Traitement Automatique du Langage Naturel (TANL'99), 1999.
16. A. Arun, B. Haddow, P. Koehn, A. Lopez, P. Blunsom, and C. Dyer, "Monte carlo techniques for phrase-based translation," Machine Translation, vol. 24, No. 2, August 2010.
17. L. Shen, G. Satta, and A. Joshi, "Guided learning for bidirectional sequence classification," in Annual Meeting-Association for Computational Linguistics, vol. 45, No. 1, 2007, p. 760.
18. R. McDonald, K. Hall, and G. Mann, "Distributed training strategies for the structured perceptron," in NAACL-HLT, 2010.
19. S. Chen, B. Kingsbury, L. Mangu, D. Povey, G. Saon, H. Soltau, and G. Zweig, "Advances in speech transcription at IBM under the DARPA EARS program," IEEE Transactions on Audio, Speech and Language Processing, pp. 1596-1608, 2006.
20. Z. Huang and M. Harper, "Self-Training PCFG grammars with latent annotations across languages," in EMNLP, 2009.
21. R. Weischedel, S. Pradhan, L. Ramshaw, M. Palmer, N. Xue, M. Marcus, A. Taylor, C. Greenberg, E. Hovy, R. Belvin, and A. Houston, OntoNotes Release 2.0, Linguistic Data Consortium, Philadelphia, 2008.