Dynamic nonlocal language modeling via hierarchical topic-based adaptation

Proceedings of the Annual Meeting of the Association for Computational Linguistics

Volumn 1999-June, Issue , 1999, Pages 167-174

  Florian, Radu ^a   Yarowsky, David ^a  

^a Johns Hopkins University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

MODELING LANGUAGES; NATURAL LANGUAGE PROCESSING SYSTEMS;

BROADCAST NEWS; COMBINED MODELING; ESTIMATION TECHNIQUES; LANGUAGE MODEL; LEXICAL DEPENDENCY; NEWS CORPORA; NONLOCAL; NOVEL METHODS; PROBABILITY ESTIMATION;

COMPUTATIONAL LINGUISTICS;

EID: 85149138459     PISSN: 0736587X     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (19)

1. P. Brown, J. Cocke, S. Della Pietra, V. Della Pietra, F. Jelinek, J. Lafferty, R. Mercer, and P. Roossin'. 1990. A statistical approach to machine translation. Computational Linguistics, 16(2).
2. Ciprian Chelba and Fred Jelinek. 1998. Exploiting syntactic structure for language modeling. In Proceedings COLING-ACL, volume 1, pages 225-231, August.
3. Stanley F. Chen and Joshua Goodman. 1998. An empirical study of smoothing techinques for language modeling. Technical Report TR-10-98, Center for Research in Computing Technology, Harvard University, Cambridge, Massachusettes, August.
4. Richard O. Duda and Peter E. Hart. 1973. Patern Classification and Scene Analysis. John Wiley & Sons.
5. R ~ u Florian. 1998. Exploiting nonlocal word relationships in language models. Technical report, Computer Science Department, Johns Hopkins University. http://nlp.cs.jhu.edu/-rflorian/papers/topiclm-tech-rep.ps.
6. J. Good. 1953. The population of species and the estimation of population parameters. Biometrica, 40, parts 3,4:237-264.
7. Rukmini Iyer and Mari Ostendorf. 1996. Modeling long distance dependence in language: Topic mixtures vs. dynamic cache models. In Proceedings of the International Conferrence on Spoken Language Processing, volume 1, pages 236-239.
8. Rukmini Iyer, Mari Ostendorf, and J. Robin Rohlicek. 1994. Language modeling with sentence-level mixtures. In Proceedings ARPA Workshop on Human Language Technology, pages 82-87.
9. Slava Katz. 1987. Estimation of probabilities from sparse data for the language model component of a speech recognizer. In IEEE Transactions on Acoustics, Speech, and Signal Processing, 1987, volume ASSP-35 no 3, pages 400-401, March 1987.
10. Sanjeev Khudanpur and Jun Wu. 1999. A maximum entropy language model integrating n-gram and topic dependencies for conversational speech recognition. In Proceedings on ICASSP.
11. R. Kuhn and R. de Mori. 1992. A cache based natural language model for speech recognition. IEEE Transaction PAMI, 13:570-583.
12. R. Lau, Ronald Rosenfeld, and Salim Roukos. 1993. Trigger based language models: a maximum entropy approach. In Proceedings ICASSP, pages 45-48, April.
13. S. Lowe. 1995. An attempt at improving recognition accuracy on switchboard by using topic identification. In 1995 Johns Hopkins Speech Workshop, Language Modeling Group, Final Report.
14. Lidia Mangu. 1997. Hierarchical topic-sensitive language models for automatic speech recognition. Technical report, Computer Science Department, Johns Hopkins University. http://nlp.cs.jhu.edu/-lidia/papers/tech-repl .ps.
15. Ronald Rosenfeld. 1994. A hybrid approach to adaptive statistical language modeling. In Proceedings ARPA Workshop on Human Language Technology, pages 76-87.
16. G. Salton and M. McGill. 1983. An Introduction to Modern Information Retrieval. New York, McGram-Hill.
17. Kristie Seymore and Ronald Rosenfeld. 1997. Using stow topics for language model adaptation. In EuroSpeech97, volume 4, pages 1987-1990.
18. Kristie Seymore, Stanley Chen, and Ronald Rosenfeld. 1998. Nonlinear interpolation of topic models for language model adaptation. In Proceedings of ICSLP98.
19. J. H. Wright, G. J. F. Jones, and H. Lloyd-Thomas. 1993. A consolidated language model for speech recognition. In ProceedingsEuroSpeech, volume 2, pages 977-980.