Online Hierarchical Transformation of Hidden Markov Models for Speech Recognition

IEEE Transactions on Speech and Audio Processing

Volumn 7, Issue 6, 1999, Pages 656-667

  Chien, Jen Tzung ^a  

^a NATIONAL CHENG KUNG UNIVERSITY   (Taiwan)

Author keywords

Approximate bayesian estimate; Em algorithm; Hidden markov models; Online hierarchical transformation; Speaker adaptation; Speech recognition

Indexed keywords

EID: 0001365754     PISSN: 10636676     EISSN: None     Source Type: Journal    
DOI: 10.1109/89.799691     Document Type: Article

References (43)

1. V. Abrash, A. Sankar, H. Franco, and M. Cohen, "Acoustic adaptation using nonlinear transformations of HMM parameters," in Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing, 1996, pp. 729-732.
2. P. Baldi and Y. Chauvin, "Smooth on-line learning algorithms for hidden Markov models," Neural Comput., vol. 6, pp. 307-318, 1994.
3. J.-T. Chien and H.-C. Wang, "Telephone speech recognition based on Bayesian adaptation of hidden Markov models," Speech Commun., vol. 22, pp. 369-384, Sept. 1997.
4. J.-T. Chien, C.-H. Lee, and H.-C. Wang, "Improved Bayesian learning of hidden Markov models for speaker adaptation," in Proc. Int. Conf. Acoustics, Speech, and Signal Processing, Munich, Germany, Apr. 1997, vol. 2, pp. 1027-1030.
5. "A hybrid algorithm for speaker adaptation using MAP trans-formation and adaptation," IEEE Signal Processing Lett., vol. 4, pp. 167-169, June 1997.
6. J.-T. Chien, H.-C. Wang, and C.-H. Lee, "Bayesian affine transformation of HMM parameters for instantaneous and supervised adaptation in telephone speech recognition," in Proc. 5th Eur. Conf. Speech Communication and Technology, Rhodes, Greece, Sept. 1997, vol. 5, pp. 2575-2578.
7. M. H. DeGroot, Optimal Statistical Decisions. New York: McGraw-Hill, 1970.
8. A. P. Dempster, N. M. Laird, and D. B. Rubin, "Maximum likelihood from incomplete data via the EM algorithm," J. R. Stat. Soc. B, vol. 39, pp. 1-38, 1977.
9. V. Digalakis, "On-line adaptation of hidden Markov models using incremental estimation algorithms," in Proc. 5th Eur. Conf. Speech Communication and Technology, Sept. 1997, vol. 4, pp. 1859-1862.
10. V. Digalakis, D. Rtischev, and L. G. Neumeyer, "Speaker adaptation using constrained estimation of Gaussian mixtures," IEEE Trans. Speech Audio Processing, vol. 3, pp. 357-366, 1995.
11. R. O. Duda and P. E. Hart, Pattern Classification and Scene Analysis. New York: Wiley, 1973.
12. K. Fukunaga, Introduction to Statistical Pattern Recognition. New York: Academic, 1990.
13. M. J. F. Gales, "Transformation smoothing for speaker and environmental adaptation," in Proc. 5th Eur. Conf. Speech Communication and Technology, Sept. 1997, vol. 4, pp. 2067-2070.
14. J. L. Gauvain and C.-H. Lee, "Maximum a posteriori estimation for multivariate Gaussian mixture observations of Markov chains," IEEE Trans. Speech Audio Processing, vol. 2, pp. 291-298, 1994.
15. Y. Gotoh, M. M. Hochberg, D. J. Mashao, and H. F. Silverman, "Incremental MAP estimation of HMM's for efficient training and improved performance," in Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing, May 1995, pp. 457-460.
16. Q. Huo and C.-H. Lee, "On-line adaptive learning of the continuous density hidden Markov model based on approximate recursive Bayes estimate," IEEE Trans. Speech Audio Processing, vol. 5, pp. 161-172, Mar. 1997.
17. "On-line adaptive learning of the correlated continuous density hidden Markov models for speech recognition," IEEE Trans. Speech Audio Processing, vol. 6, pp. 386-397, July 1998.
18. Q. Huo, C. Chan, and C.-H. Lee, "Bayesian adaptive learning of the parameters of hidden Markov model for speech recognition," IEEE Trans. Speech Audio Processing, vol. 3, pp. 334-344, 1995.
19. M. I. Jordan and R. A. Jacobs, "Hierarchical mixtures of experts and the EM algorithm," Neural Comput., vol. 6, pp. 181-214, 1994.
20. B.-H. Juang, S. E. Levinson, and M. M. Sondhi, "Maximum likelihood estimation for multivariate mixture observations of Markov chains," IEEE Trans. Inform. Theory, vol. IT-32, pp. 307-309, 1986.
21. T. Kosaka, S. Matsunaga, and S. Sagayama, "Speaker-independent speech recognition based on tree-structured speaker clustering," Comput. Speech Lang., vol. 10, pp. 55-74, 1996.
22. V. Krishnamurthy and J. B. Moor, "On-line estimation of hidden Markov model parameters based on the Kullback-Leibler information measure," IEEE Trans. Signal Processing, vol. 41, pp. 2557-2573, 1993.
23. C.-H. Lee, C.-H. Lin, and B.-H. Juang, "A study on speaker adaptation of the parameters of continuous density hidden Markov models," IEEE Trans. Signal Processing, vol. 39, pp. 806-814, 1991.
24. C.-H. Lee et al., "Improved acoustic modeling for large vocabulary continuous speech recognition," Comput. Speech Lang., vol. 6, pp. 103-127, 1992.
25. C.-H. Lee, F. K. Soong, and K. K. Paliwal, Automatic Speech and Speaker Recognition: Advanced Topics. Boston, MA: Kluwer, 1996.
26. C. J. Leggetter and P. C. Woodland, "Maximum likelihood linear regression for speaker adaptation of continuous density hidden Markov models," Comput. Speech Lang., vol. 9, pp. 171-185, 1995.
27. T. Matsuoka and C.-H. Lee, "A study of on-line Bayesian adaptation for HMM-based speech recognition," in Proc. 3rd Eur. Conf. Speech Communication and Technology, 1993, pp. 815-818.
28. P. J. Moreno, B. Raj, and R. M. Stem, "A vector Taylor series approach for environment-independent speech recognition," in Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing, 1996, pp. 733-736.
29. M. Padmanabhan, L. R. Bahl, D; Nahamoo, and M. A. Picheny, "Speaker clustering and transformation for speaker adaptation in speech recognition systems," IEEE Trans, Speech Audio Processing, vol. 6, pp. 71-77, 1998.
30. M. G. Rahim and B.-H. Juang, "Signal bias removal by maximum likelihood estimation for robust telephone speech recognition," IEEE Trans. Speech Audio Processing, vol. 4, pp. 19-30, Jan. 1996.
31. H. Robbins, "The empirical Bayes approach to statistical decision problems," Ann. Math. Stat., vol. 35, pp. 1-20, 1964.
32. A. Sankar and C.-H. Lee, "A maximum-likelihood approach to stochastic matching for robust speech recognition," IEEE Trans. Speech Audio Processing, vol. 4, pp. 190-202, 1996.
33. K. Shinoda and T. Watanabe, "Speaker adaptation with autonomous model complexity control by MDL principle," in Proc. IEEE Int. Conf. Acoustics, Speech and Signal Processing, 1996, pp. 717-720.
34. K. Shinoda and C.-H. Lee, "Structural MAP speaker adaptation using hierarchical priors," in Proc. IEEE Workshop on Automatic Speech Recognition and Understanding, 1997.
35. K. Shinoda and C.-H. Lee, "Unsupervised adaptation using structural Bayes approach," in Proc. IEEE Int. Conf. Acoustic, Speech and Signal Processing, May 1998, vol. 2, pp. 793-796.
36. A. F. M. Smith and U. E. Makov, "A quasi-Bayes sequential procedure for mixtures," J. R. Stat. Soc. B, vol. 40, pp. 106-112, 1978.
37. J. Spragins, "A note on the iterative application of Bayes' rule," IEEE Trans. Inform. Theory, vol. IT-11, pp. 544-549, 1965.
38. J.-I. Takahashi and S. Sagayama, "Vector-field-smoothed Bayesian learning for incremental speaker adaptation," in Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing, May 1995, vol. 1, pp. 696-699.
39. J.-T. Tou and R. C. Gonzalez, Pattern Recognition Principles. Reading, MA: Addison-Wesley, 1974.
40. A. J. Viterbi, "Error bounds for convolutional codes and an asymptotically optimal decoding algorithm," IEEE Trans. Inform. Theory, vol. 13, pp. 260-269, 1967.
41. E. Weinstein, M. Feder, and A. V. Oppenheim, "Sequential algorithms for parameter estimation based on the Kullback-Leibler information measure," IEEE Trans. Acoust., Speech, Signal Processing, vol. 38, pp. 1652-1654, 1990.
42. G. Zavaliagkos, R. Schwartz, and J. Makhoul, "Batch, incremental and instantaneous adaptation techniques for speech recognition," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Processing, May 1995, pp. 676-679.
43. Y. Zhao, "Self-learning speaker and channel adaptation based on spectral variation source decomposition," Speech Commun., vol. 18, pp. 65-77, 1996.