Compressing trigram language models with Golomb coding

EMNLP-CoNLL 2007 - Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning

Volumn , Issue , 2007, Pages 199-207

  Church, Ken ^a   Hart, Ted ^a   Gao, Jianfeng ^a  

^a MICROSOFT   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPRESSION METHODS; GOLOMB CODING; LANGUAGE MODEL; MICROSOFT OFFICE; TRADE OFF;

COMPUTATIONAL LINGUISTICS;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 77954618708     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (17)

1. Ashok K. Chandra, Dexter C. Kozen, and Larry J.Stockmeyer. 1981 Alternation. Journal of the Association for Computing Machinery, 28(1):114-133.
2. Church, K., and Gale, W. 1991 Probability Scoring for Spelling Correction, Statistics and Computing.
3. Clarkson, P. and Robinson, T. 2001 Improved language modeling through better language model evaluation measures, Computer Speech and Language, 15:39- 53, 2001. (Pubitemid 32330587)
4. Dan Gusfield. 1997 Algorithms on Strings, Trees and Sequences. Cambridge University Press, Cambridge, UK.
5. Gao, J. and Zhang, M., 2002 Improving language model size reduction using better pruning criteria. ACL 2002: 176-182.
6. Gao, J., Goodman, J., and Miao, J. 2001 The use of clustering techniques for language modeling - application to Asian languages. Computational Linguistics and Chinese Language Processing, 6:1, pp 27- 60.
7. Golding, A. R. and Schabes, Y. 1996 Combining Trigram- based and feature-based methods for contextsensitive spelling correction, ACL, pp. 71-78.
8. Golomb, S.W. 1966 Run-length encodings IEEE Transactions on Information Theory, 12:3, pp. 399-40.
9. Goodman, J. and Gao, J. 2000 Language model size reduction by pruning and clustering, ICSLP-2000, International Conference on Spoken Language Processing, Beijing, October 16-20, 2000.
10. Mays, E., Damerau, F. J., and Mercer, R. L. 1991 Context based spelling correction. Inf. Process. Manage. 27, 5 (Sep. 1991), pp. 517-522.
11. Katz, Slava, 1987 Estimation of probabilities from sparse data for other language component of a speech recognizer. IEEE transactions on Acoustics, Speech and Signal Processing, 35:3, pp. 400-401.
12. Kukich, Karen, 1992 Techniques for automatically correcting words in text, Computing Surveys, 24:4, pp. 377-439.
13. M. D. McIlroy, 1982 Development of a spelling list, IEEE Trans. on Communications 30 pp. 91-99.
14. Seymore, K., and Rosenfeld, R. 1996 Scalable backoff language models. Proc. ICSLP, Vol. 1, pp.232-235.
15. Stolcke, A. 1998 Entropy-based Pruning of Backoff Language Models. Proc. DARPA News Transcription and Understanding Workshop, 1998, pp. 270-274, Lansdowne, VA.
16. Whittaker, E. and Ray, B. 2001 Quantization-based language model compression. Proc. Eurospeech, pp. 33-36.
17. Witten, I. H., Moffat, A., and Bell, T. C. 1999 Managing Gigabytes (2nd Ed.): Compressing and Indexing Documents and Images. Morgan Kaufmann Publishers Inc.