A comparative study on language model adaptation techniques using new evaluation metrics

HLT/EMNLP 2005 - Human Language Technology Conference and Conference on Empirical Methods in Natural Language Processing, Proceedings of the Conference

Volumn , Issue , 2005, Pages 265-272

  Suzuki, Hisami ^a   Gao, Jianfeng ^b  

^a MICROSOFT RESEARCH   (United States)

^b MICROSOFT RESEARCH ASIA   (China)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS;

CHARACTER ERROR RATES; COMPARATIVE STUDIES; DISCRIMINATIVE METHODS; DISCRIMINATIVE TRAINING; EVALUATION METRICS; JAPANESE KANA-KANJI CONVERSION; LANGUAGE MODEL ADAPTATION; MAXIMUM A POSTERIORI;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 80053285293     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.3115/1220575.1220609     Document Type: Conference Paper

References (19)

1. Bacchiani, M. and B. Roark. 2003. Unsupervised Language Model Adaptation. Proceedings of ICASSP, pp.224-227.
2. Bacchiani, M., B. Roark and M. Saraclar. 2004. Language Model Adaptation with MAP Estimation and the Perceptron Algorithm. Proceedings of HLTNAACL, pp.21-24.
3. Bellegarda, J.R. 2001. An Overview of Statistical Language Model Adaptation. ITRW on Adaptation Methods for Speech Recognition, pp. 165-174.
4. Chen, S.F., K. Seymore and R. Rosenfeld. 1998. Topic Adaptation for Language Modeling Using Unnormalized Exponential Models. Proceedings of ICASSP.
5. Clarkson, P.R., and A.J. Robinson. 1997. Language Model Adaptation Using Mixtures and an Exponentially Decaying Cache. Proceedings of ICASSP.
6. Collins, M. 2000. Discriminative Reranking for Natural Language Parsing. ICML 2000.
7. Collins, M. 2002. Discriminative Training Methods for Hidden Markov Models: Theory and Experiments with Perceptron Algorithm. Proceedings of EMNLP, pp.1-8.
8. Freund, Y., R. Iyer, R.E. Shapire and Y. Singer. 1998 An Efficient Boosting Algorithm for Combining Preferences. ICML'98.
9. Gao, J., J. Goodman, M. Li and K.-F. Lee. 2002a. Toward a unified approach to statistical language modeling for Chinese. ACM Transactions on Asian Language Information Processing, 1-1: 3-33.
10. Gao, J, H. Suzuki and Y. Wen. 2002b. Using Headword Dependency and Predictive Clustering for Language Modeling. Proceedings of EMNLP: 248-256.
11. Gao, J., H. Yu, P. Xu and W. Yuan. 2005. Minimum Sample Risk Methods for Language Modeling. Proceedings of EMNLP 2005.
12. Hastie, T., R. Tibshirani and J. Friedman. 2001. The Elements of Statistical Learning. Springer-Verlag, New York.
13. Iyer, R., M. Ostendorf and H. Gish. 1997. Using Out-of-Domain Data to Improve In-Domain Language Models. IEEE Signal Processing Letters, 4-8: 221-223. (Pubitemid 127554973)
14. Mitchell, Tom M. 1997. Machine learning. The McGraw-Hill Companies, Inc.
15. Och, F. J. 2003. Minimum Error Rate Training in Statistical Machine Translation. Proceedings of ACL: 160-167.
16. Roark, B., M. Saraclar and M. Collins. 2004. Corrective Language Modeling for Large Vocabulary ASR with the Perceptron Algorithm. Proceedings of ICASSP: 749-752.
17. Rosenfeld, R. 1996. A Maximum Entropy Approach to Adaptive Statistical Language Modeling. Computer, Speech and Language, 10: 187-228.
18. Seymore, K. and R. Rosenfeld. 1997. Using Story Topics For Language Model Adaptation. Proceedings of Eurospeech '97.
19. Yuan, W., J. Gao and H. Suzuki. 2005. An Empirical Study on Language Model Adaptation Using a Metric of Domain Similarity. Proceedings of IJCNLP 05.