Topic tracking language model for speech recognition

Computer Speech and Language

Volumn 25, Issue 2, 2011, Pages 440-461

  Watanabe, Shinji ^a   Iwata, Tomoharu ^a   Hori, Takaaki ^a   Sako, Atsushi ^b   Ariki, Yasuo ^b  

^a NTT Communication Science Laboratories   (Japan)

^b KOBE UNIVERSITY   (Japan)

Author keywords

Language model; Latent topic model; On line algorithm; Speech recognition; Topic tracking

Indexed keywords

CHANGING ENVIRONMENT; CORPUS OF SPONTANEOUS JAPANESE; INCREMENTAL TRACKING; LANGUAGE FEATURES; LANGUAGE MODEL; LANGUAGE MODEL ADAPTATION; LATENT TOPIC MODEL; ON CURRENTS; ON-LINE ALGORITHM; REAL ENVIRONMENTS; SPEAKING STYLES; TEXT INFORMATION; TOPIC MODEL; TOPIC TRACKING; TRACK CHANGES;

COMPUTATIONAL LINGUISTICS; MODELS;

SPEECH RECOGNITION;

EID: 78049521179     PISSN: 08852308     EISSN: 10958363     Source Type: Journal    
DOI: 10.1016/j.csl.2010.07.006     Document Type: Article

References (38)

1. Y. Akita, and T. Kawahara Language model adaptation based on PLSA of topics and speakers Proc. ICSLP'04 2004 1045 1048
2. A. Asuncion, M. Welling, P. Smyth, and Y. Teh On smoothing and inference for topic models Proc. UAI'09 2009
3. J. Bellegarda Exploiting latent semantic information in statistical language modeling Proceedings of IEEE 88 8 2000 1279 1296
4. J. Bellegarda Statistical language model adaptation: review and perspectives Speech Communication 42 1 2004 93 108
5. D.M. Blei, and J.D. Lafferty Dynamic topic models Proc. ICML'06 2006 113 120
6. D.M. Blei, A.Y. Ng, and M.I. Jordan Latent Dirichlet allocation Journal of Machine Learning Research 3 2003 993 1022
7. H. Chen, S. Branavan, R. Barzilay, and D. Karger Global models of document structure using latent permutations Proc. NAACL/HLT'09 2009 371 379
8. S. Deerwester, S. Dumais, G. Furnas, T. Landauer, and R. Harshman Indexing by latent semantic analysis Journal of the American society for information science 41 6 1990 391 407
9. M. Federico Bayesian estimation methods of n-gram language model adaptation Proc. ICSLP'96 1996 240 243
10. M. Fujimoto, K. Ishizuka, and H. Kato Noise robust voice activity detection based on statistical model and parallel non-linear Kalman filtering Proc. ICASSP'07. Vol. 4 2007 797 800
11. S. Furui, K.H. Maekawa, and M. Isahara A Japanese national project on spontaneous speech corpus and processing technology Proc. ASR'00 2000 244 248
12. D. Gildea, and T. Hofmann Topic-based language models using EM Proc. Eurospeech'99 1999 2167 2170
13. J. Glass, T.J. Hazen, S. Cyphers, I. Malioutov, D. Huynh, and R. Barzilay Recent progress in the MIT spoken lecture processing project Proc. Interspeech'07 2007 2553 2556
14. Griffiths, T., Steyvers, M., 2004. Finding scientific topics. In: Proc. of the National Academy of Sciences 101 (Suppl.1), 5228-5235.
15. T. Griffiths, M. Steyvers, D. Blei, and J. Tenenbaum Integrating topics and syntax Advances in Neural Information Processing Systems 17 2005 537 544
16. A. Gruber, M. Rosen-Zvi, and Y. Weiss Hidden topic Markov models Proc. AISTATS'07, vol. 2 2007 163 170
17. T. Hofmann Probabilistic latent semantic analysis Proc. UAI'99 1999 289 296
18. Hori, T., 2004. NTT Speech recognizer with OutLook On the Next generation: SOLON. In: Proceedings of the NTT Workshop on Communication Scene Analysis, vol. 1, SP-6.
19. T. Hori, K. Sudoh, H. Tsukada, and A. Nakamura World-wide media browser - multilingual audio-visual content retrieval and browsing system NTT Technical Review 7 2 2009
20. B.J. Hsu, and J. Glass Style & topic language model adaptation using HMMLDA Proc. EMNLP 2006 2006 373 381
21. S. Huang, and S. Renals Unsupervised language model adaptation based on topic and role information in multiparty meeting Proc. Interspeech'08 2008 833 836
22. T. Iwata, S. Watanabe, T. Yamada, and N. Ueda Topic tracking model for analyzing consumer purchase behavior Proc. IJCAI'09 2009 1427 1432
23. Iwata, T., Yamada, T., Sakurai, Y., Ueda, N., 2010. Online multiscale dynamic topic models. In: Proc. of 16th ACM SIGKDD International Conference on Knowledge Discovery and Data Minig (KDD2010), 663-672.
24. R. Iyer, and M. Ostendorf Modeling long distance dependence in language: topic mixtures vs. dynamic cache models Proc. ICSLP'96, vol. 1 1996 236 239
25. R. Kneser, J. Peters, and D. Klakow Language model adaptation using dynamic marginals Proc. Eurospeech'97 1997 1971 1974
26. R. Kuhn, and R. De Mori A cache-based natural language model for speech recognition IEEE Transactions on Pattern Analysis and Machine Intelligence 12 6 1990 570 583
27. J. Makhoul, F. Kubala, T. Leek, D. Liu, L. Nguyen, R. Schwartz, and A. Srivastava Speech and language technologies for audio indexing and retrieval Proceedings of IEEE 88 8 2000 1338 1353
28. H. Masataki, Y. Sagisaka, K. Hisaki, and T. Kawahara Task adaptation using map estimation in n-gram language modeling Proc. ICASSP'97, vol. 2 1997 783 786
29. Minka, T., 2000. Estimating a Dirichlet distribution. Tech. rep., MIT.
30. A. Nakamura, T. Oba, S. Watanabe, K. Ishizuka, M. Fujimoto, T. Hori, E. Mc-Dermott, and Y. Minami Evaluation of the SOLON speech recognition system: 2006 benchmark using the Corpus of Spontaneous Japanese IPSJ SIG Notes 2006 136 2006 251 256 (in Japanese)
31. T. Niesler, and D. Willett Unsupervised language model adaptation for lecture speech transcription Proc. Interspeech'02 2002 1413 1416
32. C. Rasmussen The infinite Gaussian mixture model Advances in Neural Information Processing Systems 12 2000 554 560
33. R. Rosenfeld Two decades of statistical language modeling: where do we go from here Proceedings of IEEE 88 8 2000 1270 1278
34. A. Sako, T. Takiguchi, and Y. Ariki Language modeling using PLSA-based topic HMM IEICE Transactions on Information and Systems E91-D 2008 522 528
35. Y. Teh, M. Jordan, M. Beal, and D. Blei Hierarchical dirichlet processes Journal of the American Statistical Association 101 476 2006 1566 1581
36. H.M. Wallach Topic modeling: beyond bag-of-words Proc. ICML'06 2006 977 984
37. C. Wang, D. Blei, and D. Heckerman Continuous time dynamic topic models Proc. UAI'08 2008 579 586
38. X. Wei, J. Sun, and X. Wang Dynamic mixture models for multiple timeseries Proc. IJCAI'07 2007 2909 2914