TOPIC-BASED LANGUAGE MODELS USING EM

6th European Conference on Speech Communication and Technology, EUROSPEECH 1999

Volumn , Issue , 1999, Pages 2167-2170

  Gildea, Daniel ^a   Hofmann, Thomas ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; NATURAL LANGUAGE PROCESSING SYSTEMS;

EM ALGORITHMS; FACTOR DECOMPOSITIONS; LANGUAGE MODEL; LATENT VARIABLE; LONG-RANGE DEPENDENCIES; STATISTICAL LANGUAGE MODELLING; TOPIC MODELING; TRAINING CORPUS; WORD PREDICTION;

SPEECH COMMUNICATION;

EID: 85121030057     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (16)

1. J. Bellegarda. A latent semantic analysis framework for large-span language modeling. In Eurospeech-97, Rhodes, Greece, September 1997.
2. C. Chelba and F. Jelinek. Exploiting syntactic structure for language modeling. In COLING-ACL, 1998.
3. P. R. Clarkson and A. J. Robinson. Language model adaption using mixtures and an exponentially decaying cache. In IEEE ICASSP-97, pages 799-802, Munich, Germany, 1997.
4. N. Coccaro and D. Jurafsky. Towards better integration of semantic predictors in statistical language modeling. In ICSLP-98, Sydney, Australia, November 1998.
5. G. Cook, J. Christie, D. Ellis, E. Fosler-Lussier, Y. Gotoh, B. Kingsbury, N. Morgan, S. Renals, T. Robinson, and G. Williams. An overview of the SPRACH system for the transcription of broadcast news. In DARPA Broadcast News Workshop, Herndon, Virginia, February 1999.
6. J. Darroch and D. Ratcliff. Generalized iterative scaling for log-linear models. Ann. Math. Statist., 43:1470-1480, 1972.
7. S. Deerwester, S. T. Dumais, T. K. Landauer, G. W. Furnas, and R. A. Harshman. Indexing by latent semantics analysis. Journal of the American Society for Information Science, 41(6):391-407, 1991.
8. A.P. Dempster, N.M. Laird, and D.B. Rubin. Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society B, 39:1-38, 1977.
9. T. Hofmann. Probabilistic latent semantic analysis. In Proceedings of the 15th Conference on Uncertainty in AI, 1999.
10. T. Hofmann. Probabilistic latent semantic indexing. In 22nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Berkeley, CA, USA, 1999.
11. R. M. Iyer and M. Ostendorf. Modeling long distance dependencies in language: Topic mixtures versus dynamic cache model. IEEE Transactions on Speech and Audio Processing, 7, January 1999.
12. D. Jurafsky, C. Wooters, G. Tajchman, J. Segal, A. Stolcke, E. Fosler, and N. Morgan. Using a stochastic context-free grammar as a language model for speech recognition. In IEEE ICASSP-95, pages 189-192, 1995.
13. R. Kuhn and R. de Mori. A cache based natural language model for speech recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 14:570-583, 1992.
14. R. M. Neal and G. E. Hinton. A view of the EM algorithm that justifies incremental, sparse, and other variants. In M. I. Jordan, editor, Learning in Graphical Models, pages 355-368. Kluwer Academic Publishers, 1998.
15. F. C. Pereira, Y. Singer, and N. Tishby. Beyond word n-grams. Computational Linguistics, June 1996.
16. R. Rosenfeld. A maximum entropy approach to adaptive statistical language modeling. Computer, Speech and Language, 10, 1996.