A succinct N-gram language model

ACL-IJCNLP 2009 - Joint Conf. of the 47th Annual Meeting of the Association for Computational Linguistics and 4th Int. Joint Conf. on Natural Language Processing of the AFNLP, Proceedings of the Conf.

Volumn , Issue , 2009, Pages 341-344

  Watanabe, Taro ^a   Tsukada, Hajime ^a   Isozaki, Hideki ^a  

^a NTT Communication Science Laboratories   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

NATURAL LANGUAGE PROCESSING SYSTEMS;

BIT-STRINGS; COMPRESSION RATES; LOSSLESS COMPRESSION; N-GRAM COMPRESSION; N-GRAM LANGUAGE MODELS; RESEARCH TOPICS; SUCCINCT DATA STRUCTURE; VARIABLE LENGTH CODING; LARGE-SCALES; MODEL-BASED OPC; TERASCALE; TEXT DATA; VARIABLE-LENGTH CODING;

COMPUTATIONAL LINGUISTICS;

EID: 84859920606     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.3115/1667583.1667689     Document Type: Conference Paper

References (10)

1. T. Brants, A. C. Popat, P. Xu, F. J. Och, and J. Dean. 2007. Large language models in machine translation. In Proc. of EMNLP-CoNLL 2007.
2. K. Church, T. Hart, and J. Gao. 2007. Compressing trigram language models with Golomb coding. In Proc. of EMNLP-CoNLL 2007.
3. O. Delpratt, N. Rahman, and R. Raman. 2006. Engineering the LOUDS succinct tree representation. In Proc. of the 5th International Workshop on Experimental Algorithms.
4. M. Federico and M. Cettolo. 2007. Efficient handling of n-gram language models for statistical machine translation. In Proc. of the 2nd Workshop on Statistical Machine Translation.
5. G. Jacobson. 1989. Space-efficient static trees and graphs. In 30th Annual Symposium on Foundations of Computer Science, Nov.
6. D. K. Kim, J. C. Na, J. E. Kim, and K. Park. 2005. Efficient implementation of rank and select functions for succinct representation. In Proc. of the 5th International Workshop on Experimental Algorithms.
7. B. Raj and E. W. D. Whittaker. 2003. Lossless compression of language model structure and word identifiers. In Proc. of ICASSP 2003, volume 1.
8. A. Stolcke. 1998. Entropy-based pruning of backoff language models. In Proc. of the ARPA Workshop on Human Language Technology.
9. D. Talbot and T. Brants. 2008. Randomized language models via perfect hash functions. In Proc. of ACL- 08: HLT.
10. T. Watanabe, H. Tsukada, and H. Isozaki. 2008. NTT SMT system 2008 at NTCIR-7. In Proc. of the 7th NTCIR Workshop, pages 420-422.