A hierarchical nonparametric Bayesian approach to statistical language model domain adaptation

Journal of Machine Learning Research

Volumn 5, Issue , 2009, Pages 607-614

  Wood, Frank ^a   Teh, Yee Whye ^a  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

BAYESIAN INFERENCE; BOTTOM LAYERS; LANGUAGE MODEL; MULTIPLE LANGUAGES; NEW MODEL; NON-PARAMETRIC BAYESIAN; OVERALL-MODEL; POTENTIAL BENEFITS; PROCESS LANGUAGES; SHARED LANGUAGE; STATISTICAL LANGUAGE MODELS; STATISTICAL STRENGTH;

ARTIFICIAL INTELLIGENCE; BAYESIAN NETWORKS; INFERENCE ENGINES;

COMPUTATIONAL LINGUISTICS;

EID: 84862279215     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Conference Paper

References (15)

1. M. Bacchiani, M. Riley, B. Roark, and R. Sproat. MAP adaptation of stochastic grammars. Computer Speech and Language, 20:41-68, 2006.
2. J. R. Bellegarda. Statistical language model adaptation: review and perspectives. Speech Communication, 42:93- 108, 2004.
3. J. Carletta. Unleashing the killer corpus: experiences in creating the multi-everything AMI meeting corpus. Language Resources and Evaluation Journal, 41:181-190, 2007.
4. S. F. Chen and J. T. Goodman. An empirical study of smoothing techniques for language modeling. Technical Report TR-10-98, Dept. of Comp. Sci., Harvard, 1998.
5. S. Della Pietra, V. Della Pietra, R. Mercer, and S. Roukos. Adaptive language model estimation using minimum discriminatioon estimation. In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, pages 633-636, 1992.
6. S. Goldwater, T. L. Griffiths, and M. Johnson. Interpolating between types and tokens by estimating power law generators. In Advances in Neural Information Processing Systems 19, pages 459-466. MIT Press, 2007.
7. R. Iyer, M. Ostendorf, and H. Gish. Using out-of-domain data to improve in-domain language models. IEEE Signal processing letters, 4:221-223, 1997.
8. R. Kneser and H. Ney. Improved backing-off for m-gram language modeling. In Proceedings of the IEEE International Conference on Acoustics Speech and Signal Processing, volume 1, pages 181-184, 1995.
9. R. Kneser and V. Steinbiss. On the dynamic adaptation of stochastic language models. In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, pages 586-589, 1993.
10. H. Kucera and W. N. Francis. Computational analysis of present-day American English. Brown University Press, Providence, RI, 1967.
11. R. Rosenfeld. Two decades of statistical language modeling: where do we go from here? In Proceedings of the IEEE, volume 88, pages 1270-1278, 2000.
12. SOUCorpus. http://www.c-span.org/executive/stateoftheunion.asp.
13. Y. W. Teh. A hierarchical Bayesian language model based on Pitman-Yor processes. In Proc. of the Association for Computational Linguistics, pages 985-992, 2006.
14. Y. W. Teh, M. I. Jordan, M. J. Beal, and D. M. Blei. Hierarchical Dirichlet processes. Journal of the American Statistical Association, 101(476):1566-1581, 2006.
15. X. Zhu and R. Rosenfeld. Improving trigram language modeling with the world wide web. In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, volume 1, pages 533-536, 2001.