Recurrent neural network based language model personalization by social network crowdsourcing

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn , Issue , 2013, Pages 2703-2707

  Wen, Tsung Hsien ^a   Heidel, Aaron ^a   Lee, Hung Yi ^b   Tsao, Yu ^b   Lee, Lin Shan ^a  

^a NATIONAL TAIWAN UNIVERSITY   (Taiwan)

^b ACADEMIA SINICA   (Taiwan)

Author keywords

LM adaptation; Personalized language modeling; Recurrent neural network; Social network

Indexed keywords

EXPERIMENTS; RECURRENT NEURAL NETWORKS; SMARTPHONES; SOCIAL NETWORKING (ONLINE); SPEECH RECOGNITION; STATISTICAL TESTS;

AUTOMATIC SPEECH RECOGNITION; DATA SPARSENESS PROBLEM; DISTRIBUTED REPRESENTATION; IMPORTANT FEATURES; LANGUAGE MODEL; LINGUISTIC PATTERNS; LM ADAPTATION; UNSOLVED PROBLEMS;

COMPUTATIONAL LINGUISTICS;

EID: 84906228355     PISSN: 2308457X     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (46)

1. G. Zweig and C. Shuangyu, "Personalizing model m for voicesearch, " in Proc. on InterSpeech, 2011.
2. M. Speretta and S. Gauch, "Personalized search based on user search histories, " in Proc. on Web Intelligence, 2005.
3. Y. H. Cho, J. K. Kim, and S. H. Kim, "A personalized recommender system based on web usage mining and decision tree induction, " Expert Systems with Applications, 2002.
4. Y. Koren, R. Bell, and C. Volinsky, "Matrix factorization techniques for recommender systems, " Computer, 2009.
5. F. Walter, S. Battiston, and F. Schweitzer, "A model of a trustbased recommendation system on a social network, " Autonomous Agents and Multi-Agent Systems, 2008.
6. M.-H. Park, J.-H. Hong, and S.-B. Cho, "Location-based recommendation system using bayesian users preference model in mobile devices, " in Ubiquitous Intelligence and Computing, 2007.
7. C. J. Leggetter and P. C. Woodland, "Maximum likelihood linear regression for speaker adaptation of continuous density hidden markov models, " Computer Speech and Language, 1995.
8. P. C. Woodland, "Speaker adaptation for continuous density hmms: A review, " in Proc. on ITRW on Adaptation Methods for Speech Recognition, 2001.
9. l. G. Jean and C.-H. Lee, "Maximum a posteriori estimation for multivariate gaussian mixture observations of markov chains, " IEEE Transactions on Speech and Audio Processing, 1994.
10. J. R. Bellegarda, "Statistical language model adaptation: review and perspectives, " Speech Communication, 2004.
11. A. Heidel and L.-S. Lee, "Robust topic inference for latent semantic language model adaptation, " in Proc. on ASRU, 2007.
12. H. Bo-June and J. Glass, "Style and topic language model adaptation using hmm-lda, " in Proc. on EMNLP, 2006.
13. D. Hakkani-Tur, G. Tur, and L. Heck, "Research challenges and opportunities in mobile applications, " Signal Processing Magazine, IEEE, 2011.
14. X. Sun and A. May, "The role of spatial contextual factors in mobile personalization at large sports events, " Personal and Ubiquitous Computing, 2009.
15. S. Arbanowski, P. Ballon, K. David, O. Droegehorn, H. Eertink, W. Kellerer, H. van Kranenburg, K. Raatikainen, and R. Popescu-Zeletin, "I-centric communications: personalization, ambient awareness, and adaptability for future mobile services, " Communications Magazine, 2004.
16. P. F. Brown, P. V. deSouza, R. L. Mercer, V. J. D. Pietra, and J. C. Lai, "Class-based n-gram models of natural language, " Computational Linguistics, 1992.
17. A. Stolcke, "Entropy-based pruning of backoff language models, " in Proc. of the DARPA Broadcast News Transcription and Understanding Workshop, 2000.
18. T.-H. Wen, H.-Y. Lee, T.-Y. Chen, and L.-S. Lee, "Personalized language modeling by crowd sourcing with social network data for voice access of cloud applications, " in Proc. on IEEE SLT workshop, 2012.
19. J. Wu and S. Khudanpur, "Combining nonlocal, syntactic and n-gram dependencies in language modeling, " in Proc. on EuroSpeech, 1999.
20. S. Khudanpur and J. Wu, "Maximum entropy techniques for exploiting syntactic, semantic and collocational dependencies in language modeling, " Computer Speech and Language, 2000.
21. H. S. Le, A. Allauzen, and Y. Fran, "Measuring the influence of long range dependencies with neural network language models, " in Proc. on NAACL-HLT Workshop, 2012.
22. I. Oparin, M. Sundermeyer, H. Ney, and J. Gauvain, "Performance analysis of neural networks in combination with n-gram language models, " in Proc. on ICASSP, 2012.
23. Y. Bengio, R. Ducharme, P. Vincent, and C. Janvin, "A neural probabilistic language model, " Journal of Machine Learning Research, 2003.
24. J. Park, X. Liu, M. J. F. Gales, and P. C. Woodland, "Improved neural network based language modeling and adaptation, " in Proc. on InterSpeech, 2010.
25. H.-S. Le, I. Oparin, A. Allauzen, J.-L. Gauvain, and F. Yvon, "Structured Output Layer neural network language model, " in Proc. on ICASSP, 2011.
26. T. Mikolov, M. Karafit, L. Burget, J. Cernock, and S. Khudanpur, "Recurrent neural network based language model, " in Proc. on InterSpeech, 2010.
27. T. Mikolov, S. Kombrink, L. Burget, J. Cernocky, and S. Khudanpur, "Extensions of recurrent neural network language model, " in Proc. on ICASSP, 2011.
28. T. Mikolov and G. Zweig, "Context dependent recurrent neural network language model, " in Proc. on IEEE SLT workshop, 2012.
29. Y. Shi, P. Wiggers, and C. M. Jonker, "Towards recurrent neural networks language models with linguistic and contextual features, " in Proc. on InterSpeech, 2012.
30. A. Doan, R. Ramakrishnan, and A. Y. Halevy, "Crowdsourcing systems on the world-wide web, " Communications of the ACM, 2011.
31. Munro and Robert, "Crowdsourcing and language studies: The new generation of linguistic data, " in Proc. on NAACL, 2010.
32. K. Berberich, S. Bedathur, O. Alonso, and G. Weikum, "A language modeling approach for temporal information needs, " in Advances in Information Retrieval, 2010.
33. J. Liu, S. Cyphers, P. Pasupat, I. McGraw, and J. Glass, "A conversational movie search system based on conditional random field, " in Proc. on InterSpeech, 2012.
34. I. McGraw, S. Cyphers, P. Pasupat, J. Liu, and J. Glass, "Automating crowd-supervised learning for spoken language systems, " in Proc. on InterSpeech, 2012.
35. R. Iyer and M. Ostendorf, "Modeling long distance dependence in language: Topic mixtures versus dynamic cache models, " IEEE Transactions on Speech and Audio Processing, 1999.
36. A. Heidel, H.-A. Chang, and L.-S. Lee, "Language model adaptation using latent dirichlet allocation and an efficient topic inference algorithm, " in Proc. on InterSpeech, 2007.
37. M. Federico, "Efficient language model adaptation through mdi estimation, " in Proc. on EuroSpeech, 1999.
38. C. Chelba and F. Jelinek, "Structured language modeling, " Computer Speech and Language, 2000.
39. X. Liu, M. J. F. Gales, and P. C. Woodland, "Improving lvcsr system combination using neural network language model cross adaptation, " in Proc. on InterSpeech, 2011.
40. J. Paolillo, "The virtual speech community: Social network and language variation on irc, " Journal of Computer-Mediated Communication, 1999.
41. D. Rosen and M. Corbit, "Social network analysis in virtual environments, " in Proc. on ACM Hypertext, 2009.
42. T. K. Landauer, P. W. Foltz, and D. Laham, "An Introduction to Latent Semantic Analysis, " Discourse Processes, 1998.
43. F. James, "Modified kneser-ney smoothing of n-gram models modified kneser-ney smoothing of n-gram models, " Tech. Rep., 2000.
44. A. Stolcke, "Srilm - An extensible language modeling toolkit, " in Proc. on Spoken Language Processing, 2002.
45. T. Mikolov, S. Kombrink, A. Deoras, L. Burget, and J. Cernocky, "Rnnlm - recurrent neural network language modeling toolkit, " in Proc. on ASRU, 2011.
46. S. J. Young, D. Kershaw, J. Odell, D. Ollason, V. Valtchev, and P.Woodland, The HTK Book Version 3.4. Cambridge University Press, 2006.