Web augmentation of language models for continuous speech recognition of SMS text messages

EACL 2009 - 12th Conference of the European Chapter of the Association for Computational Linguistics, Proceedings

Volumn , Issue , 2009, Pages 157-165

  Creutz, Mathias ^a   Virpioja, Sami ^a,b   Kovaleva, Anna ^a  

^a NOKIA RESEARCH CENTER   (United States)

^b AALTO UNIVERSITY   (Finland)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; CONTINUOUS SPEECH RECOGNITION; NATURAL LANGUAGE PROCESSING SYSTEMS; TEXT MESSAGING;

LANGUAGE MODEL; QUERY SELECTION; RELEVANT DOCUMENTS; STATISTICAL LANGUAGE MODELING; WEB AUGMENTATION; WEB DATA; WEB TEXT DATA; WORD ERROR RATE REDUCTIONS;

CHARACTER RECOGNITION;

EID: 84878587867     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.3115/1609067.1609084     Document Type: Conference Paper

References (20)

1. Adam Berger and Robert Miller. 1998. Just-in-time language modeling. In ICASSP-98, pages 705-708.
2. Brigitte Bigi, Yan Huang, and Renato De Mori. 2004. Vocabulary and language model adaptation using information retrieval. In Proc. Interspeech 2004 - ICSLP, pages 1361-1364, Jeju Island, Korea.
3. Thorsten Brants, Ashok C. Popat, Peng Xu, Franz J. Och, and Jeffrey Dean. 2007. Large language models in machine translation. In Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL), pages 858-867.
4. Ivan Bulyko, Mari Ostendorf, and Andreas Stolcke. 2003. Getting more mileage from web text sources for conversational speech language modeling using class-dependent mixtures. In NAACL'03: Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology, pages 7-9, Morristown, NJ, USA. Association for Computational Linguistics.
5. Ivan Bulyko, Mari Ostendorf, Manhung Siu, Tim Ng, Andreas Stolcke, and Ozgiir Çetin. 2007. Web resources for language modeling in conversational speech recognition. ACM Trans. Speech Lang. Process., 5(1): 1-25.
6. Ozgiir Çetin and Andreas Stolcke. 2005. Language modeling in the ICSI-SRI spring 2005 meeting speech recognition evaluation system. Technical Report 05-006, International Computer Science Institute, Berkeley, CA, USA, July.
7. S. F. Chen and J. Goodman. 1999. An empirical study of smoothing techniques for language modeling. Computer Speech and Language, 13: 359-394.
8. Joshua T. Goodman. 2001. A bit of progress in language modeling. Computer Speech and Language, 15: 403-434.
9. Slava M. Katz. 1987. Estimation of probabilities from sparse data for the language model component of a speech recognizer. IEEE Transactions on Acoustics, Speech and Signal Processing, ASSP-35(3): 400-401, March.
10. Teruhisa Misu and Tatsuya Kawahara. 2006. A bootstrapping approach for developing language model of new spoken dialogue systems by selecting web texts. In Proc. INTERSPEECH '06, pages 9-13, Pittsburgh, PA, USA, September, 17-21.
11. Jesper Olsen, Yang Cao, Guohong Ding, and Xinxing Yang. 2008. A decoder for large vocabulary continuous short message dictation on embedded devices. In Proc. ICASSP 2008, Las Vegas, Nevada.
12. Ronald Rosenfeld. 2000. Two decades of language modeling: Where do we go from here? Proceedings of the IEEE, 88(8): 1270-1278.
13. Ruhi Sarikaya, Augustin Gravano, and Yuqing Gao. 2005. Rapid language model development using external resources for new spoken dialog domains. In Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP '05), Volume I, pages 573-576.
14. Abhinav Sethy, Shrikanth Narayanan, and Bhuvana Ramabhadran. 2007. Data driven approach for language model adaptation using stepwise relative entropy minimization. In Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP '07), Volume IV, pages 177-180.
15. Vesa Siivola, Teemu Hirsimäki, and Sami Virpioja. 2007. On growing and pruning Kneser-Ney smoothed n-gram models. IEEE Transactions on Audio, Speech and Language Processing, 15(5): 1617-1624.
16. A. Stolcke. 1998. Entropy-based pruning of backoff language models. In Proc. DARPA BNTU Workshop, pages 270-274, Lansdowne, VA, USA.
17. A. Stolcke. 2002. SRILM - an extensible language modeling toolkit. In Proc. ICSLP, pages 901-904. http://www.speech.sri.com/projects/srilm/.
18. Vincent Wan and Thomas Hain. 2006. Strategies for language model web-data collection. In Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP '06), Volume I, pages 1069-1072.
19. Karl Weilhammer, Matthew N. Stuttle, and Steve Young. 2006. Bootstrapping language models for dialogue systems. In Proc. INTERSPEECH 2006 - ICSLP Ninth International Conference on Spoken Language Processing, Pittsburgh, PA, USA, September 17-21.
20. Xiaojin Zhu and R. Rosenfeld. 2001. Improving trigram language modeling with the world wide web. In Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP '01)., Volume 1, pages 533-536.