K-component adaptive recurrent neural network language models

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 8082 LNAI, Issue , 2013, Pages 311-318

  Shi, Yangyang ^a   Larson, Martha ^a   Wiggers, Pascal ^b   Jonker, Catholijn M ^a  

^a DELFT UNIVERSITY OF TECHNOLOGY   (Netherlands)

^b AMSTERDAM UNIVERSITY OF APPLIED SCIENCES   (Netherlands)

Author keywords

Latent Dirichlet Allocation; N best rescoring; Recurrent Neural Networks

Indexed keywords

AUTOMATIC SPEECH RECOGNITION; COMPONENT MODEL; LATENT DIRICHLET ALLOCATION; LONG-DISTANCE DEPENDENCIES; MODELING ABILITIES; N-BEST RESCORING; N-GRAM LANGUAGE MODELS; WALL STREET JOURNAL;

COMPUTATIONAL LINGUISTICS; EXPERIMENTS; SPEECH RECOGNITION; STATISTICS;

RECURRENT NEURAL NETWORKS;

EID: 84884938651     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-40585-3_40     Document Type: Conference Paper

References (17)

1. Rosenfeld, R.: Two decades of statistical language modeling: where do we go from here? Proceedings of the IEEE 88, 1270-1278 (2000)
2. Mikolov, T., Karafiát, M., Burget, L., Cernocký, J., Khudanpur, S.: Recurrent neural network based language model. In: INTERSPEECH, pp. 1045-1048 (2010)
3. Mikolov, T., Kombrink, S., Burget, L., Cernocky, J., Khudanpur, S.: Extensions of recurrent neural network language model. In: 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 5528-5531 (2011)
4. Mikolov, T., Zweig, G.: Context dependent recurrent neural network language model. In: SLT, pp. 234-239 (2012)
5. Shi, Y., Wiggers, P., Jonker, C.M.: Towards recurrent neural networks language models with linguistic and contextual features. In: 13th Annual Conference of the International Speech Communication Association (2012)
6. Iyer, R., Ostendorf, M., Rohlicek, J.R.: Language modeling with sentence-level mixtures. In: Proceedings of the Workshop on Human Language Technology, pp. 82-87. Association for Computational Linguistics, Morristown (1994)
7. Iyer, R., Ostendorf, M.: Modeling long distance dependence in language: Topic mixtures vs. dynamic cache models. In: Proc. ICSLP 1996, Philadelphia, PA, vol. 1, pp. 236-239 (1996)
8. Kneser, R., Peters, J.: Semantic clustering for adaptive language modeling. In: 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 1997, vol. 2, pp. 779-782 (1997)
9. Clarkson, P., Robinson, A.: Language model adaptation using mixtures and an exponentially decaying cache. In: 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 1997, vol. 2, pp. 799-802 (1997)
10. Ostendorf, M., Kannan, A., Austin, S., Kimball, O., Schwartz, R., Rohlicek, J.R.: Integration of diverse recognition methodologies through reevaluation of n-best sentence hypotheses. In: Proceedings of the Workshop on Speech and Natural Language, HLT 1991, pp. 83-87. Association for Computational Linguistics, Stroudsburg (1991)
11. Chin, H.S., Chen, B.: Word topical mixture models for dynamic language model adaptation. In: IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2007, vol. 4, pp. IV-169 -IV-172 (2007)
12. Blei, D.M., Ng, A.Y., Jordan, M.I.: Latent dirichlet allocation. J. Mach. Learn. Res. 3, 993-1022 (2003)
13. Hoekstra, H., Moortgat, M., Schuurman, I., van der Wouden, T.: Syntactic annotation for the Spoken Dutch Corpus Project (CGN). In: Computational Linguistics in the Netherlands 2000, pp. 73-87 (2001)
14. Nelleke, O.N., Wim, G.W., Van Eynde, F., Boves, L., Martens, J.P., Moortgat, M., Baayen, H.: Experiences from the Spoken Dutch Corpus project. In: Proceedings of the Third International Conference on Language Resources and Evaluation, LREC 2002, pp. 340-347 (2002)
15. Wang, W., Harper, M.P.: The SuperARV language model: Investigating the effectiveness of tightly integrating multiple knowledge sources. In: Proceedings of the ACL 2002 Conference on Empirical Methods in Natural Language Processing, EMNLP 2002, vol. 2, pp. 238-247 (2002)
16. den Bosch, V.: Scalable classification-based word prediction and confusible correction. Traitement Automatique des Langues 46, 39-63 (2006)
17. Shi, Y., Wiggers, P., Jonker, C.M.: Socio-situational setting classification based on language use. In: IEEE Workshop on Automatic Speech Recognition and Understanding, pp. 455-460 (2011)