Bayesian context clustering using cross validation for speech recognition

IEICE Transactions on Information and Systems

Volumn E94-D, Issue 3, 2011, Pages 668-678

  Hashimoto, Kei ^a   Heiga, Zen ^b   Nankaku, Yoshihiko ^a   Lee, Akinobu ^a   Tokuda, Keiichi ^a  

^a NAGOYA INSTITUTE OF TECHNOLOGY   (Japan)

^b Toshiba Europe   (United Kingdom)

Author keywords

Bayesian approach; Context clustering; Cross validation; HMM; Speech recognition

Indexed keywords

BAYESIAN NETWORKS; DECISION TREES; DEEP NEURAL NETWORKS; HIDDEN MARKOV MODELS; MARKOV PROCESSES; PARAMETER ESTIMATION; SPEECH;

BAYESIAN APPROACHES; CONTEXT CLUSTERING; CONVENTIONAL METHODS; CROSS VALIDATION; POSTERIOR DISTRIBUTIONS; PREDICTIVE DISTRIBUTIONS; STATISTICAL TECHNIQUES; VARIATIONAL BAYESIAN METHODS;

SPEECH RECOGNITION;

EID: 79952166575     PISSN: 09168532     EISSN: 17451361     Source Type: Journal    
DOI: 10.1587/transinf.E94.D.668     Document Type: Conference Paper

References (22)

1. B.H. Juang and L.R. Rabiner, "Hidden Markov models for speech recognition" Technometrics, vol.33, no.3, pp.251-272, 1991.
2. A. Gelman, J.B. Carlin, H.S. Stern, and D.B. Rubin, Bayesian data analysis, Chapman & Hall, 1995.
3. H. Jiang, K. Hirose, and Q. Huo, "Robust speech recognition based on a Bayesian prediction approach" IEEE Trans. Speech Audio Process., vol.7, no.4, pp.426-440, 1999.
4. Q. Huo and C.H. Lee, "A Bayesian predictive classification approach to robust speech recognition" IEEE Trans. Speech Audio Process., vol.8, no.2, pp.200-204, 2000. (Pubitemid 30578374)
5. S.Watanabe and A. Nakamura, "Effects of Bayesian predictive classification using variational Bayesian posteriors for sparse training data in speech recognition" Proc. Interspeech, pp.1105-1108, 2005. (Pubitemid 43908259)
6. H. Attias, "Inferring parameters and structure of latent variable models by variational Bayes" Proc. UAI 15, 1999.
7. S. Watanabe, Y. Minami, A. Nakamura, and N. Ueda, "Variational Bayesian estimation and clustering for speech recognition" IEEE Trans. Speech Audio Process., vol.12, no.4, pp.365-381, 2004.
8. S. Watanabe, A. Sako, and A. Nakamura, "Automatic determination of acoustic model topology using variational Bayesian estimation and clustering" Proc. ICASSP 2004, vol.1, pp.813-816, 2004.
9. K.F. Lee, "Context-dependent phonetic hidden Markov models for speaker-independent continuous speech recognition" IEEE Trans. Acoust. Speech Signal Process., vol.38, no.4, pp.599-609, 1990.
10. J.J. Odell, The use of context in large vocabulary speech recognition, PhD dissertation, Cambridge University, 1995.
11. S. Young, J.J. Odell, and P. Woodland, "Tree-based state tying for high accuracy acoustic modelling" Proc. ARPA Workshop on Human Language Technology, pp.307-312, 1994.
12. K. Shinoda and T. Watanabe, "Acoustic modeling based on the MDL criterion for speech recognition" Proc. Eurospeech, pp.99-102, 1997.
13. G. Schwarz, "Estimating the dimension of a model" The Annals of Staistics, vol.6, no.2, pp.461-464, 1978.
14. H. Robbins, "An empirical Bayes approach to statistics" Proc. 3rd Berkeley Symp. Math. Statist. Probab., vol.1, pp.157-163, 1956.
15. R. Kohavi, "A study of cross-valication and bootstrap for accuracy estimation and model selection" Proc. International Joint Conference on AI, pp.1137-1145, 1995.
16. S. Arlot and A. Celisse, "A survey of cross-valication procedures for model selection" Statistics Surveys, vol.4, pp.40-79, 2010.
17. T. Shinozaki, "HMM state clustering based on efficient crossvalidation" Proc. ICASSP, vol.1, pp.1157-1160, 2006.
18. K. Hashimoto, H. Zen, Y. Nankaku, A. Lee, and K. Tokuda, "Bayesian context clustering using cross valid prior distribution for HMM-based speech recognition" Proc. Interspeech, pp.936-939, 2008.
19. A.P. Dempster, N.M. Laird, and D.B. Rubin, "Maximum-likelihood from incomplete data via the EM algorithm" J. Royal Statist. Coc. Ser. B (methodological), vol.39, pp.1-38, 1977.
20. J.L. Gauvain and C.H. Lee, "Maximum a posteriori estimation for multivariate Gaussian mixture observations of Markov chains" IEEE Trans. Speech Audio Process., vol.2, no.2, pp.291-298, 1994.
21. S. Kullback and R.A. Leibler, "On information and sufficiency" Annals of Mathematical Statistics, vol.22, pp.79-86, 1951.
22. K. Ito, M. Yamamoto, K. Takeda, T. Takezawa, T. Matsuoka, T. Kobayashi, K. Shikano, and S. Itahashi, "JNAS: Japanese speech corpus for large vocabulary continuous speech recognition research" J. Acoust. Soc. Jpn. (E), vol.20, no.3, pp.199-206, 1999.