Large-scale discriminative language model reranking for voice-search

WLM 2012 - Will We Ever Really Replace the N-gram Model? On the Future of Language Modeling for HLT at the 2012 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT 2012

Volumn , Issue , 2012, Pages 41-49

  Jyothi, Preethi ^a   Johnson, Leif ^b   Chelba, Ciprian ^c   Strope, Brian ^c  

^a OHIO STATE UNIVERSITY   (United States)

^b UNIVERSITY OF TEXAS AT AUSTIN   (United States)

^c GOOGLE INC   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; CONTINUOUS SPEECH RECOGNITION;

ACOUSTICS MODEL; DISCRIMINATIVE LANGUAGE MODELS; DISTRIBUTED FRAMEWORK; LARGE VOCABULARY CONTINUOUS SPEECH RECOGNITION; LARGE-SCALES; LATTICE RESCORING; MAPREDUCE FRAMEWORKS; RE-RANKING; SPEECH RECOGNITION SYSTEMS; VOICE SEARCHES;

SEARCH ENGINES;

EID: 84902303733     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (15)

1. Thorsten Brants, Ashok C. Popat, Peng Xu, Franz J. Och, and Jeffrey Dean. 2007. Large language models in machine translation. In Proc. of EMNLP, pages 858-867.
2. C. Chelba, J. Schalkwyk, T. Brants, V. Ha, B. Harb, W. Neveitt, C. Parada, and P. Xu. 2010. Query language modeling for voice search. In Proc. of SLT.
3. C.T. Chu, S.K. Kim, Y.A. Lin, Y.Y. Yu, G. Bradski, A.Y. Ng, and K. Olukotun. 2007. Map-reduce for machine learning on multicore. Proc. NIPS, 19:281.
4. M. Collins. 2002. Discriminative training methods for hidden markov models: Theory and experiments with perceptron algorithms. In Proc. EMNLP.
5. J. Gao, H. Yu, W. Yuan, and P. Xu. 2005. Minimum sample risk methods for language modeling. In Proc. of EMNLP.
6. S. Ghemawat and J. Dean. 2004. Mapreduce: Simplified data processing on large clusters. In Proc. OSDI.
7. K.B. Hall, S. Gilpin, and G. Mann. 2010. MapReduce/ Bigtable for distributed optimization. In NIPS LCCC Workshop.
8. P. Jyothi and E. Fosler-Lussier. 2010. Discriminative language modeling using simulated ASR errors. In Proc. of Interspeech.
9. P. Jyothi, L. Johnson, C. Chelba, and B. Strope. 2012. Distributed discriminative language models for Google voice-search. In Proc. of ICASSP.
10. G. Mann, R. McDonald, M. Mohri, N. Silberman, and D. Walker. 2009. Efficient large-scale distributed training of conditional maximum entropy models. Proc. NIPS.
11. R. McDonald, K. Hall, and G. Mann. 2010. Distributed training strategies for the structured perceptron. In Proc. NAACL.
12. B. Roark, M. Saraçlar, M. Collins, and M. Johnson. 2004. Discriminative language modeling with conditional random fields and the perceptron algorithm. In Proc. ACL.
13. R. Schlüter, B. Müller, F. Wessel, and H. Ney. 1999. Interdependence of language models and discriminative training. In Proc. ASRU.
14. B. Strope, D. Beeferman, A. Gruenstein, and X. Lei. 2011. Unsupervised testing strategies for ASR. In Proc. of Interspeech.
15. Z. Zhou, J. Gao, F.K. Soong, and H. Meng. 2006. A comparative study of discriminative methods for reranking LVCSR N-best hypotheses in domain adaptation and generalization. In Proc. ICASSP.