Extensions of absolute discounting (Kneser-Ney method)

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn , Issue , 2009, Pages 4729-4732

  Andrés Ferrer, Jesús ^a   Ney, H ^b  

^a UNIVERSITAT POLITÈCNICA DE VALÈNCIA   (Spain)

^b RWTH AACHEN UNIVERSITY   (Germany)

Author keywords

Kneser Ney smoothing; Language modelling; Language smoothing; Leaving one out

Indexed keywords

CONSTRAINED METHOD; DESIGN MODELS; EFFICIENT ALGORITHM; EMPIRICAL BAYES METHOD; FREE PARAMETERS; INTERVAL CONSTRAINT; KNESER-NEY SMOOTHING; LANGUAGE MODELLING; LANGUAGE SMOOTHING; LEAVING ONE OUT; N-GRAM LANGUAGE MODELS; STUDY METHODS;

ACOUSTICS; ALGORITHMS; COMPUTATIONAL LINGUISTICS; SIGNAL PROCESSING;

PARAMETER ESTIMATION;

EID: 70349204649     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2009.4960687     Document Type: Conference Paper

References (11)

1. Stanley Chen and Joshua Goodman, "An empirical study of smoothing techniques for language modelling," In Proc. annual meeting of the ACL, pp. 310-318, 1996.
2. T. Lwin and J. S. Maritz, Empirical Bayes methods, Chapman and Hall, 1989.
3. Herbert Robbins, "An empirical bayes approach to statistics," Proceeding of the Third Berkeley Symposium on Mathematical Statistics, vol. 1, pp. 157-163, 1956.
4. S. M. Katz, "Estimation of probabilities from sparse data for the language model component of a speech recognizer," In IEEE Transactions on ASSP, vol. ASSP-35, pp. 400-401, 1987.
5. I. J. Good, "Population frequencies of species and the estimation of population parameters," Biometrika, vol. 40, pp. 237-264, 1953.
6. A. Nadas, "On turing's formula for word probabilities," IEEE Trans. ASSP, vol. 33, pp. 1,414-1,416, 1985.
7. R. Kneser and H. Ney, "Improved backing-off for m-gram language modeling.," IEEE Int. Conf. on ASSP, vol. II, pp. 181-184, 1995.
8. H. Ney, U. Essen, and R. Kneser, "On the estimation of 'small' probabilities by leaving-one-out," IEEE Trans. PAMI., vol. 17, no. 12, pp. 1202-1212, 1995.
9. Stephen Boyd and Lieven Vandenberghe, "Convex optimization," pp. 244-254, March 2004.
10. P. F. Brown, V. J. Della Pietra, R. L. Mercer, S. A. Della Pietra, and J. C. Lai, "An estimate of an upper bound for the entropy of english," Comput. Linguist., vol. 18, no. 1, pp. 31-40, 1992.
11. A. Stolcke, "Srilm - an extensible language modeling toolkit," In Proc. International Conference on Spoken Language Processing, vol. 2, pp. 901-904, Sep. 2002.