Towards recurrent neural networks language models with linguistic and contextual features

13th Annual Conference of the International Speech Communication Association 2012, INTERSPEECH 2012

Volumn 2, Issue , 2012, Pages 1662-1665

  Shi, Yangyang ^a   Wiggers, Pascal ^a   Jonker, Catholijn M ^a  

^a DELFT UNIVERSITY OF TECHNOLOGY   (Netherlands)

Author keywords

Lemma; Part of speech; Recurrent neural networks; Socio situational setting; Topic

Indexed keywords

BASELINE MODELS; CONTEXTUAL FEATURE; IMPROVE PERFORMANCE; LEMMA; PART OF SPEECH; SOCIO-SITUATIONAL SETTINGS; TOPIC; TRADITIONAL MODELS;

COMPUTATIONAL LINGUISTICS;

RECURRENT NEURAL NETWORKS;

EID: 84878413383     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (14)

1. T. Mikolov, M. Karafiat, L. Burget, J. Cernocky, and S. Khudanpur, "Recurrent neural network based language model, " in INTERSPEECH, 2010, pp. 1045-1048.
2. T. Mikolov, S. Kombrink, L. Burget, J. Cernocky, and S. Khudanpur, "Extensions of recurrent neural network language model, " in Acoustics, Speech and Signal Processing (ICASSP), 2011 IEEE International Conference on, may 2011, pp. 5528-5531.
3. Y. Shi, P. Wiggers, and C. M. Jonker, "Language modelling with dynamic bayesian networks using conversation types and part of speech information, " in The 22nd Benelux Conference on Artificial Intelligence (BNAIC), 2010.
4. R. Rosenfeld, "Two decades of statistical language modeling: Where do we go from here?" Proceedings of the Ieee, vol. 88, no. 8, pp. 1270-1278, 2000.
5. P. Wiggers and L. Rothkrantz, "Combining topic information and structure information in a dynamic language model, " in Text, Speech and Dialogue, 2009.
6. Y. Bengio, R. Ducharme, P. Vincent, and C. Janvin, "A neural probabilistic language model, " J. Mach. Learn. Res., vol. 3, pp. 1137-1155, Mar. 2003.
7. Improved backing-off for M-gram language modeling, vol. 1, 1995.
8. P. F. Brown, V. J. D. Pietra, P. V. deSouza, J. C. Lai, and R. L. Mercer, "Class-based n-gram models of natural language, " Computational Linguistics, vol. 18, no. 4, pp. 467-479, 1992.
9. J. A. Bilmes and K. Kirchhoff, "Factored language models and generalized parallel backoff, " in Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology: companion volume of the Proceedings of HLT-NAACL 2003-short papers-Volume 2, ser. NAACL-Short '03. Stroudsburg, PA, USA: Association for Computational Linguistics, 2003, pp. 4-6.
10. Y. Shi, P. Wiggers, and C. M. Jonker, "Socio-situational setting classification based on language use, " in IEEE workshop on automatic speech recognition and understanding, 2011.
11. R. Baeza-Yates and B. Ribeiro-Neto, Modern Information Retrieval. Addison Wesley, May 1999.
12. O. Nelleke, G. Wim, E. Frank Van, B. Louis, M. Jean-pierre, M. Michael, and B. Harald, "Experiences from the spoken dutch corpus project, " in Proceedings of the third international conference on language resources and evaluation, 2002, pp. 340-347.
13. A. van den Bosch, "Scalable classification-based word prediction and confusible correction, " Traitement Automatique des Langues, vol. 46, no. 2, pp. 39-63, 2006.
14. A. Stolcke, "Srilm-an extensible language modeling toolkit, " in Proc. Int. Conf. Spoken Language Processing (ICSLP 2002), 2002.