Bayesian linear regression for hidden Markov model based on optimizing variational bounds

IEEE International Workshop on Machine Learning for Signal Processing

Volumn , Issue , 2011, Pages

  Watanabe, Shinji ^a   Nakamura, Atsushi ^a   Juang, Biing Hwang ^b  

^a Nippon Telegraph and Telephone Corporation   (Japan)

^b GEORGIA INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTIVE TRAINING; LARGE VOCABULARY CONTINUOUS SPEECH RECOGNITION; LOG LIKELIHOOD; LOWER BOUNDS; NON-PARAMETRIC; OBJECTIVE FUNCTIONS; TIME SERIES PATTERNS; TUNING PARAMETER; VARIATIONAL BOUNDS;

CONTINUOUS SPEECH RECOGNITION; HIDDEN MARKOV MODELS; LEARNING SYSTEMS; OPTIMIZATION; SIGNAL PROCESSING; SPEECH PROCESSING; TIME SERIES; TIME SERIES ANALYSIS; TOPOLOGY; VARIATIONAL TECHNIQUES;

LINEAR REGRESSION;

EID: 82455212515     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/MLSP.2011.6064605     Document Type: Conference Paper

References (24)

1. C. J. Leggetter and P. C. Woodland, "Maximum likelihood linear regression for speaker adaptation of continuous density hidden Markov models," Computer Speech and Language, vol. 9, pp. 171-185, 1995.
2. V. Digalakis, D. Ritischev, and L. Neumeyer, "Speaker adaptation using constrained reestimation of Gaussian mixtures," IEEE Transactions on Speech and Audio Processing, vol. 3, pp. 357-366, 1995.
3. C. Chesta, O. Siohan, and C.-H. Lee, "Maximum a posteriori linear regression for hidden Markov model adaptation," in Proc. Eurospeech1999, 1999, vol. 1, pp. 211-214.
4. O. Siohan, TA. Myrvoll, and C.H. Lee, "Structural maximum a posteriori linear regression for fast HMM adaptation," Computer Speech & Language, vol. 16, no. 1, pp. 5-24,2002.
5. M.I. Jordan, Z. Ghahramani, TS. Jaakkola, and L.K. Saul, " An introduction to variational methods for graphical models," Machine learning, vol. 37, no. 2, pp. 183-233, 1999. (Pubitemid 30544678)
6. H. Attias, "Inferring parameters and structure of latent variable models by variational Bayes," in Proc. Uncertainty in Artificial Intelligence (UAI) 15, 1999.
7. N. Veda and Z. Ghahramani, "Bayesian model search for mixture models based on optimizing variational bounds," Neural Networks, vol. 15, pp. 1223-1241, 2002.
8. S. Watanabe, Y. Minami, A. Nakamura, and N. Veda, Application of variational Bayesian approach to speech recognition, NIPS 2002, MIT Press, 2002.
9. F. Valente and C. Wellekens, "Variational Bayesian GMM for speech recognition," in Proc. Eurospeech2003, 2003, pp. 441-444.
10. S. Watanabe, Y. Minami, A. Nakamura, and N. Veda, "Variational Bayesian estimation and clustering for speech recognition," IEEE Transactions on Speech and Audio Processing, vol. 12, pp. 365-381, 2004.
11. P. Somervuo, "Comparison of ML, MAP, and VB based acoustic models in large vocabulary speech recognition," in Proc. ICSLP2004, 2004, vol. 1, pp. 830-833.
12. T. Jitsuhiro and S. Nakamura, "Automatic generation of non-uniform HMM structures based on variational Bayesian approach," in Proc. ICASSP2004, 2004, vol. 1, pp. 805-808.
13. K. Hashimoto, H. Zen, Y. Nankaku, A. Lee, and K. Tokuda, "Bayesian context clustering using cross valid prior distribution for hmm-based speech recognition," in Proc. Interspeech'08, 2008.
14. A. Ogawa and S. Takahashi, "Weighted distance measures for efficient reduction of gaussian mixture components in hmm-based acoustic model," in Acoustics, Speech and Signal Processing, 2008. ICASSP 2008. IEEE International Conference on. IEEE, 2008, pp. 4173-4176.
15. N. Ding and Z. Ou, "Variational non parametric bayesian hidden markov model," in Acoustics Speech and Signal Processing (ICASSP), 2010 IEEE International Conference on. IEEE, 2010, pp. 2098-2101.
16. S. Watanabe and A. Nakamura, "Acoustic model adaptation based on coarse/fine training of transfer vectors and its application to a speaker adaptation task," in Proc. ICSLP, 2004, pp. 2933-2936.
17. K. Yu and M. J. F. Gales, "Incremental adaptation using Bayesian inference," in Proceedings of IEEE International Conference on Acoustics, Speech. & Signal Processing (ICASSP 2006), 2006, vol. 1, pp. 217-220.
18. M. J. F. Gales and P. C. Woodland, "Variance compensation within the MLLR framework," Tech. Rep. 242, Cambridge Vniversity Engineering Department, 1996.
19. K. Shinoda and C.-H. Lee, "A structural Bayes approach to speaker adaptation," IEEE Transactions on Speech and Audio Processing, vol. 9, pp. 276-287, 2001. (Pubitemid 32286597)
20. K. Maekawa, H. Koiso, S. Furui, and H. Isahara, "Spontaneous speech corpus of Japanese," in Proceedings of LREC2000, 2000, vol. 2, pp. 947-952.
21. A. Nakamura, T. Oba, S. Watanabe, K. Ishizuka, M. Fujimoto, T. Hori, E. McDermott, and Y. Minami, "Evaluation of the SOLON speech recognition system : 2006 benchmark using the Corpus of Spontaneous Japanese," IPSJ SIG Notes, vol. 2006, no. 136, pp. 251-256, 2006, (in Japanese).
22. E. McDermott, T.J. Hazen, J. Le Roux, A. Nakamura, and S. Katagiri, "Discriminative training for large-vocabulary speech recognition using minimum classification error," IEEE Transactions on Audio, Speech, and Language Processing, vol. 15, no. 1, pp. 203-223, 2007.
23. T. Hori, "NTT Speech recognizer with OutLook On the Next generation: SOLON," in Proc. NTT Workshop on Communication Scene Analysis, 2004, vol. 1. SP-6.
24. D.M. Blei and M.I. Jordan, "Variational inference for dirichlet process mixtures," Bayesian Analysis, vol. 1, no. 1, pp. 121-144,2006.