Predictor—Corrector Adaptation by Using Time Evolution System With Macroscopic Time Scale

IEEE Transactions on Audio, Speech and Language Processing

Volumn 18, Issue 2, 2010, Pages 395-406

  Watanabe, Shinji ^a   Nakamura, Atsushi ^a  

^a Nippon Telegraph and Telephone Corporation   (Japan)

Author keywords

Acoustic model; incremental adaptation; macroscopic time evolution; predictor corrector algorithm; speech recognition

Indexed keywords

EID: 85008538758     PISSN: 15587916     EISSN: 15587924     Source Type: Journal    
DOI: 10.1109/TASL.2009.2029717     Document Type: Article

References (36)

1. C.-H. Lee and Q. Huo, “On adaptive decision rules and decision parameter adaptation for automatic speech recognition,” Proc. IEEE, vol. 88, no. 8, pp. 1241–1269, Aug. 2000.
2. K. Ohkura, M. Sugiyama, and S. Sagayama “Speaker adaptation based on transfer vector field smoothing method with continuous mixture density HMMs,” IEICE(D-II), vol. J76-D-II, pp. 2469–2476, 1993.
3. K. Shinoda and T. Watanabe, “Speaker adaptation with autonomous control using tree structure,” in Proc. Eurospeech'95, 1995, pp. 1143–1146.
4. M. Rahim and B.-H. Juang “Signal bias removal by maximum likelihood estimation for robust telephone speech recognition,” IEEE Trans. Speech Audio Process., vol. 4, no. 1, pp. 19–30, Jan. 1996.
5. C. J. Leggetter and P. C. Woodland “Maximum likelihood linear regression for speaker adaptation of continuous density hidden Markov models,” Comput. Speech Lang., vol. 9, pp. 171–185, 1995.
6. V. Digalakis, D. Ritischev, and L. Neumeyer “Speaker adaptation using constrained estimation of Gaussian mixtures,” IEEE Trans. Speech Audio Process., vol. 3, no. 5, pp. 357–366, Sep. 1995.
7. C. Chesta, O. Siohan, and C.-H. Lee, “Maximum a posteriori linear regression for hidden Markov model adaptation,” in Proc. Eurospeech'99, 1999, vol. 1, pp. 211–214.
8. W. Chou, “Maximum a posterior linear regression with elliptically symmetric matrix variate priors,” in Proc. Eurospeech'99, 1999, vol. 1, pp. 1–4.
9. K. Shinoda and C.-H. Lee, “A structural Bayes approach to speaker adaptation,” IEEE Trans. Speech Audio Process., vol. 9, no. 3, pp. 276–287, Mar. 2001.
10. C. J. Leggetter and P. C. Woodland, “Flexible speaker adaptation using maximum likelihood linear regression,” in Proc. ARPA Spoken Lang. Technol. Workshop, 1995, pp. 104–109.
11. V. Digalakis, “Online adaptation of hidden Markov models using incremental estimation algorithms,” IEEE Trans. Speech Audio Process., vol. 7, no. 3, pp. 253–261, May 1999.
12. J.-T. Chien, “Online hierarchical transformation of hidden Markov models for speech recognition,” IEEE Trans. Speech Audio Process., vol. 7, no. 6, pp. 656–667, Nov. 1999.
13. J. T. Chien, “Quasi-Bayes linear regression for sequential learning of hidden Markov models,” IEEE Trans. Speech Audio Process., vol. 10, no. 5, pp. 268–278, Jul. 2002.
14. K. Yu and M. J. F. Gales, “Bayesian adaptive inference and adaptive training,” IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 6, pp. 1932–1943, Aug. 2007.
15. C.-H. Lee, C. H. Lin, and B.-H. Juang “A study on speaker adaptation of the parameters of continuous density hidden Markov models,” IEEE Trans.Signal Process., vol. 39, no. 4, pp. 806–814, Apr. 1991.
16. J.-L. Gauvain and C.-H. Lee “Maximum a posteriori estimation for multivariate Gaussian mixture observations of Markov chains,” IEEE Trans. Speech Audio Process., vol. 2, no. 2, pp. 291–298, Apr. 1994.
17. T. Matsuoka and C.-H. Lee, “A study of on-line Bayesian adaptation for HMM-based speech recognition,” in Proc. Eurospeech'93, 1993, pp. 815–818.
18. G. Zavaliagkos, R. Schwartz, and J. Makhoul, “Batch, incremental and instantaneous adaptation techniques for speech recognition,” in Proc. ICASSP'95, 1995, vol. 1, pp. 676–679.
19. Q. Huo and C.-H. Lee, “On-line adaptive learning of the continuous density hidden Markov model based on approximate recursive Bayes estimate,” IEEE Trans. Speech Audio Process., vol. 5, no. 5, pp. 161–172, Sep. 1997.
20. Q. Huo and C.-H. Lee “On-line adaptive learning of the correlated continuous density hidden Markov models for speech recognition,” IEEE Trans. Speech Audio Process., vol. 6, no. 4, pp. 386–397, Jul. 1998.
21. S. Watanabe and A. Nakamura, “Incremental adaptation based on a macroscopic time evolution system,” in Proc. ICASSP'07, 2007, vol. 4, pp. 769–772.
22. G. Welch and G. Bishop, “An Introduction to the Kalman Filter,” Univ. of North Carolina at Chapel Hill, Tech. Rep. TR95-041, 1995.
23. S. Watanabe and A. Nakamura, “A unified interpretation of adaptation techniques based on a macroscopic time evolution system with indirect/direct approaches,” in Proc. ICASSP'08, 2008, pp. 4285–4288.
24. Q. Huo and B. Ma, “Online adaptive learning of continuous-density hidden Markov models based on multiple-stream prior evolution and posterior pooling,” IEEE Trans. Speech Audio Process., vol. 9, no. 4, pp. 388–398, May 2001.
25. J. Takahashi and S. Sagayama “Vector-field-smoothed Bayesian learning for fast and incremental speaker/telephone-channel adaptation,” Computer Speech and Language, vol. 11, pp. 127–146, 1997.
26. V. Digalakis and L. Neumeyer “Speaker adaptation using combined transformation and Bayesian methods,” IEEE Trans. Speech Audio Process., vol. 4, no. 4, pp. 294–300, Jul. 1996.
27. O. Siohan, C. Chesta, and C.-H. Lee, “Joint maximum a posteriori adaptation of transformation and HMM parameters,” IEEE Trans. Speech Audio Process., vol. 9, no. 4, pp. 417–428, May 2001.
28. A. P. Dempster, N. M. Laird, and D. B. Rubin “Maximum likelihood from incomplete data via the EM algorithm,” J. R. Statist. Soc. B, vol. 39, pp. 1–38, 1976.
29. M. Ostendorf, V. Digalakis, and O. A. Kimball “From HMMs to segment models,” IEEE Trans. Speech Audio Process., vol. 4, no. 5, pp. 360–378, Sep. 1996.
30. J. Bridle, L. Deng, J. Picone, H. Richards, J. Ma, T. Kamm, M. Schuster, S. Pike, and R. Regan, “An investigation of segmental hidden dynamic models of speech coarticulation for automatic speech recognition,” in Proc. CLSP/JHU Summer Workshop Lang. Eng., 1998.
31. Y. Minami, E. McDermott, A. Nakamura, and S. Katagiri, “A recognition method with parametric trajectory synthesized using direct relations between static and dynamic feature vector time series,” in Proc. ICASSP'02, 2002, vol. 1, pp. 957–960.
32. T. Kawahara, A. Lee, T. Kobayashi, K. Takeda, N. Minematsu, K. Itou, A. Ito, M. Yamamoto, A. Yamada, T. Utsuro, and K. Shikano “Japanese dictation toolkit—1997 version,” J. Acoust. Soc. Japan (E), vol. 20, pp. 233–239, 1999.
33. S. Furui, K. Maekawa, and M. H. Isahara, “A Japanese national project on spontaneous speech corpus and processing technology,” in Proc. ASR2000, 2000, pp. 244–248.
34. T. Hori, “NTT Speech recognizer with outlook on the next generation: SOLON,” in Proc. NTT Workshop Commun. Scene Anal., 2004, vol. 1, SP-6.
35. S. Watanabe and A. Nakamura, “On-line adaptation and Bayesian detection of environmental changes based on a macroscopic time evolution system,” in Proc. ICASSP'09, 2009, pp. 4373–4376.
36. H. Kameoka, “Statistical approach to multipitch analysis,” Ph.D. dissertation, Univ. of Tokyo, Tokyo, Japan, 2007.