Semantic N-gram language modeling with the latent maximum entropy principle

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn 1, Issue , 2003, Pages 376-379

  Wang, Shaojun ^a   Schuurmans, Dale ^a   Peng, Fuchun ^a   Zhao, Yunxin ^b  

^a UNIVERSITY OF WATERLOO   (Canada)

^b UNIVERSITY OF MISSOURI   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

LANGUAGE MODELING;

CONSTRAINT THEORY; LINGUISTICS; PROBABILITY; SEMANTICS;

SPEECH RECOGNITION;

EID: 0141480003     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (15)

1. J. Bellegarda, "Exploiting Latent Semantic Information in Statistical Language Modeling," Proceedings of IEEE, Vol. 88, No. 8, pp. 1279-1296, August 2000
2. A. Berger, S. Della Pietra and V. Della Pietra, "A Maximum Entropy Approach to Natural Language Processing," Computational Linguistics, Vol. 22, No. 1, pp. 39-71, 1996
3. P. Brown, S. Della Pietra, V. Della Pietra, R. Mercer, A. Nadas, and S. Roukos, "A Maximum Entropy Construction of Conditional Log-linear Language and Translation Models Using Learned Features and a Generalized Csiszar Algorithm," IBM report, 1992
4. C. Chelba and F. Jelinek, "Structured Language Modeling, Computer Speech and Language," Vol. 14, No. 4, pp. 283-332, October 2000
5. S. Chen and R. Rosenfeld, "A Survey of Smoothing Techniques for ME Models, IEEE Trans. on Speech and Audio Processing, Vol. 8, No. 1, pp. 37-50, 2000
6. I. Csiszar, "Maxent, Mathematics, and Information Theory," Maximum Entropy and Bayesian Methods, Edited by K. Hanson and R. Silver, pp. 35-50, Kluwer Academic Publishers, 1996
7. S. Della Pietra, V. Della Pietra and J. Lafferty, "Inducing Features of Random Fields," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 19, No. 4, pp. 380-393, 1997
8. J. Darroch and D. Ratchliff, "Generalized Iterative Scaling for Log-Linear Models," The Annals of Mathematical Statistics, Vol. 43, No. 5, pp. 1470-1480, 1972
9. A. Dempster, N. Laird and D. Rubin, "Maximum Likelihood Estimation from Incomplete Data via the EM Algorithm," Journal of Royal Statistical Society, Series B, Vol. 39, pp 1-38, 1977
10. T. Hofmann, "Unsupervised Learning by Probabilistic Latent Semantic Analysis," Machine Learning, Vol. 42, No. 1, pp.177-196, 2001
11. E. Jaynes, Papers on Probability, Statistics, and Statistical Physics, edited by R. Rosenkrantz, D. Reidel Publishing Company, 1983
12. S. Khudanpur and J. Wu, "Maximum Entropy Techniques for Exploiting Syntactic, Semantic and Collocational Dependencies in Language Modeling," Computer Speech and Language, Vol. 14, No. 4, pp. 355-372, 2000
13. R. Rosenfeld, "A Maximum Entropy Approach to Adaptive Statistical Language Modeling," Computer Speech and Language, Vol. 10, pp. 187-228, 1996
14. C. Shannon, "A Mathematical Theory of Communication, Bell System Technical Journal, Vol. 27, pp. 398-403, 1948
15. S. Wang, D. Schuurmans and Y. Zhao, "The Latent Maximum Entropy Principle," submitted to IEEE Trans. on Information Theory, 2002