Smoothing a tera-Word language model

ACL-08: HLT - 46th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, Proceedings of the Conference

Volumn , Issue , 2008, Pages 142-144

  Yuret, Deniz ^a  

^a KOÇ UNIVERSITY   (Turkey)

Author keywords

[No Author keywords available]

Indexed keywords

DATA SETS; DIRICHLET PRIOR; FREQUENCY COUNTS; LANGUAGE MODEL; LANGUAGE MODELING; LARGE DATASETS; LOW FREQUENCY; SMOOTHING ALGORITHMS; SMOOTHING METHODS;

SOFTWARE AGENTS;

COMPUTATIONAL LINGUISTICS;

EID: 84859927912     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (11)

1. Lalit R. Bahl, Frederick Jelinek, and Robert L. Mercer. 1983. A maximum likelihood approach to continuous speech recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 5(2):179-190.
2. Thorsten Brants and Alex Franz. 2006. Web 1T 5-gram version 1. Linguistic Data Consortium, Philadelphia. LDC2006T13.
3. Peter F. Brown, John Cocke, Stephen A. Della Pietra, Vincent J. Della Pietra, Frederick Jelinek, John D. Lafferty, Robert L. Mercer, and Paul S. Roossin. 1990. A statistical approach to machine translation. Computational Linguistics, 16(2):79-85.
4. Stanley F. Chen and Joshua Goodman. 1996. An empirical study of smoothing techniques for language modeling. In Proceedings of the 34th Annual Meeting of the ACL.
5. Stanley F. Chen and Joshua Goodman. 1999. An empirical study of smoothing techniques for language modeling. Computer Speech and Language.
6. S. Goldwater, T.L. Griffiths, and M. Johnson. 2006. Interpolating between types and tokens by estimating power-law generators. In Advances in Neural Information Processing Systems, volume 18. MIT Press.
7. Joshua Goodman. 2001. A bit of progress in language modeling. Computer Speech and Language.
8. R. Kneser and H. Ney. 1995. Improved backing-off for m-gram language modeling. In International Conference on Acoustics, Speech, and Signal Processing.
9. David J. C. Mackay and Linda C. Bauman Peto. 1995. A hierarchical Dirichlet language model. Natural Language Engineering, 1(3):1-19.
10. Y.W. Teh. 2006. A hierarchical Bayesian language model based on Pitman-Yor processes. In Proceedings of the ACL, pages 985-992.
11. Deniz Yuret. 2007. KU: Word sense disambiguation by substitution. In SemEval-2007: 4th International Workshop on Semantic Evaluations.