Variational Bayesian estimation and clustering for speech recognition

IEEE Transactions on Speech and Audio Processing

Volumn 12, Issue 4, 2004, Pages 365-381

  Watanabe, Shinji ^a   Minami, Yasuhiro ^a   Nakamura, Atsushi ^a   Ueda, Naonori ^a  

^a NTT Communication Science Laboratories   (Japan)

Author keywords

Acoustic model selection; Bayesian predictive classification; Speech recognition; Total Bayesian framework; Variational Bayes

Indexed keywords

ACOUSTICS; APPROXIMATION THEORY; MARKOV PROCESSES; MATHEMATICAL MODELS; MAXIMUM LIKELIHOOD ESTIMATION; PARAMETER ESTIMATION; PROBABILITY; PROBLEM SOLVING;

ACOUSTIC MODEL SELECTION; BAYESIAN PREDICTIVE CLASSIFICATION; TOTAL BAYESIAN FRAMEWORK; VARIATIONAL BAYES;

SPEECH RECOGNITION;

EID: 3042741069     PISSN: 10636676     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSA.2004.828640     Document Type: Conference Paper

References (20)

1. S. Furui, "Recent advances in spontaneous speech recognition and understanding," in Proc. SSPR, 2003, pp. 1-6.
2. G. Schwarz, "Estimating the dimension of a model," Ann. Statist., vol. 6, pp. 461-464, 1978.
3. J. Rissanen, "Universal coding, information, prediction and estimation," IEEE Trans. Inform. Theory, vol. IT-30, pp. 629-636, 1984.
4. J.-L. Gauvain and C.-H. Lee, "Maximum a posteriori estimation for multivariate Gaussian mixture observations of markov chains," IEEE Trans. Speech Audio Processing, vol. 2, pp. 291-298, Mar. 1994.
5. K. Shinoda and T. Watanabe, "MDL-based context-dependent subword modeling for speech recognition," J. Acoust. Soc. Jpn. (E), vol. 21, pp. 79-86, 2000.
6. W. Chou and W. Reichl, "Decision tree state tying based on penalized Bayesian information criterion," in Proc. ICASSP, vol. 1, 1999, pp. 345-348.
7. S. Chen and R. Gopinath, "Model selection in acoustic modeling," in Proc. Eurospeech, vol. 3, 1999, pp. 1087-1090.
8. K. Shinoda and K. Iso, "Efficient reduction of Gaussian components using MDL criterion for HMM-based speech recognition," in Proc. ICASSP, vol. 1, 2001, pp. 869-872.
9. H. Jiang, K. Hirose, and Q. Huo, "Robust speech recognition based on a Bayesian prediction approach," IEEE Trans. Speech Audio Processing, vol. 7, pp. 426-440, July 1999.
10. Q. Huo and C.-H. Lee, "A Bayesian predictive classification approach to robust speech recognition," IEEE Trans. Speech Audio Processing, vol. 8, pp. 200-204, Mar. 2000.
11. S. Waterhouse, D. MacKay, and T. Robinson, Bayesian Methods for Mixtures of Experts. Cambridge, MA: MIT Press, 1995.
12. H. Attias, "Inferring parameters and structure of latent variable models by variational Bayes," in Proc. UAI 15, 1999.
13. Z. Ghahramani and M. J. Beal, Variational Inference for Bayesian Mixtures of Factor Analyzers. Cambridge, MA: MIT Press, 1999.
14. N. Ueda and Z. Ghahramani, "Bayesian model search for mixture models based on optimizing variational bounds," Neural Networks, vol. 15, pp. 1223-1241, 2002.
15. S. Watanabe, Y. Minami, A. Nakamura, and N. Ueda, Application of Variational Bayesian Approach to Speech Recognition. Cambridge, MA: MIT Press, 2003.
16. S. Kullback and R. A. Leibler, "On information and sufficiency," Ann. Math. Stat., vol. 22. pp. 79-86, 1951.
17. A. Dempster, N. Laird, and D. Rubin, "Maximum likelihood from incomplete data via the EM algorithm," J. Roy. Statist. Soc. Ser. B, vol. 39, pp. 1-38, 1976.
18. J. Odell, "The use of context in large vocabulary speech recognition," Ph.D. dissertation, Cambridge Univ., Cambridge, U.K., 1995.
19. S. Watanabe, Y. Minami, A. Nakamura, and N. Ueda, "Constructing shared-state hidden Markov models based on a Bayesian approach," in Proc. ICSLP, vol. 4, 2002, pp. 2669-2672.
20. _, "Application of variational Bayesian estimation and clustering to acoustic model adaptation," in Proc. ICASSP, vol. 1, 2003, pp. 568-571.