Integration of articulatory and spectrum features based on the hybrid HMM/BN modeling framework

Speech Communication

Volumn 48, Issue 2, 2006, Pages 161-175

  Markov, Konstantin ^a   Dang, Jianwu ^b   Nakamura, Satoshi ^a  

^a ADVANCED TELECOMMUNICATIONS RESEARCH INSTITUTE INTERNATIONAL   (Japan)

^b JAPAN ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY   (Japan)

Author keywords

Articulatory modeling; HMM BN; Multiple feature integration

Indexed keywords

ACCELERATION; DATA ACQUISITION; DATABASE SYSTEMS; MATHEMATICAL MODELS; SPEECH COMMUNICATION;

ARTICULATORY MODELING; BAYESIAN NETWORKS (BN); HMM/BN; MULTIPLE FEATURE INTEGRATION;

SPEECH RECOGNITION;

EID: 29444436962     PISSN: 01676393     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.specom.2005.07.003     Document Type: Article

References (26)

1. H. Bourlard, and N. Morgan Connectionist Speech Recognition: A Hybrid Approach 1994 Kluwer Academic Publishers Boston
2. Chen, S., Gopalakrishnan, P., 1998. Clustering via the Bayesian information criterion with applications in speech recognition. In: Proc. ICASSP, May, Vol. 2, pp. 645-648.
3. R. Cowell Introduction to inference for Bayesian Networks M. Jordan Learning in Graphical Models 1998 Kluwer Academic Publishers 9 26
4. Daoudi, K., Fohr, D., Antoine, C., 2001. Continuous multi-band speech recognition using Bayesian Networks. In: Proc. ASRU.
5. Dean, T., Kanazawa, K., 1988. Probabilistic temporal reasoning. In: AAAI, pp. 524-528.
6. L. Deng A generalized hidden Markov model with state-conditioned trend functions of time for the speech signal Signal Process. 27 1992 65 78
7. L. Deng A dynamic, feature-based approach to the interface between phonology and phonetics for speech modeling and recognition Speech Comm. 24 4 1998 299 323
8. Deng, L., Ramsay, G., Sun, D., 1996. Production models as a structural basis for automatic speech recognition. In: ESCA Tutorial and Research Workshop on Speech Production Modeling, pp. 69-80.
9. Erler, K., Freeman, J., 1995. Using articulatory features for speech recognition. In: Proc. IEEE Conference on Communications, Computers and Signal Processing, pp. 562-566.
10. Gao, Y., Bakis, R., Huang, J., Xiang, B., 2000. Multistage co-articulation model combining articulatory, formant and cepstral features. In: Proc. ICSLP, pp. 25-28.
11. D. Heckerman A tutorial on learning with Bayesian Networks M. Jordan Learning in Graphical Models 1998 Kluwer Academic Publishers 301 354
12. S. Hiroya, and M. Honda Estimation of articulatory movements from speech acoustics using a HMM-based speech production model IEEE Trans. SAP 12 2 2004 175 185
13. Hogden, J., Valdez, P., 2000. Bridging the gap between speech production and speech recognition. In: Proc. of the 5th Seminar on Speech Production, Germany.
14. Hogden, J., Valdez, P., 2001. A stochastic articulatory-to-acoustic mapping as a basis for speech recognition. In: Proc. IEEE IMTC, Vol. 2, pp. 1105-1110.
15. F. Jensen An Introduction to Bayesian Networks 1998 UCL Press
16. Kirchhoff, K., 1998. Robust speech recognition using articulatory information, Tech. Rep. TR-98-037, International Computer Science Institute.
17. Kirchhoff, K., Fink, G., Sagerer, G., 2000. Conversational speech recognition using acoustic and articulatory input. In: Proc. ICASSP, Vol. III, p. 1435.
18. S. Liu Landmark detection for distinctive feature-based speech recognition J. Acoust. Soc. Amer. 1996 3417 3430
19. K. Markov, and S. Nakamura A hybrid HMM/BN acoustic model for automatic speech recognition IEICE Trans. Inf. Systems E86-D 3 2003 438 445
20. Markov, K., Nakamura, S., 2003b. Hybrid HMM/BN LVCSR system integrating multiple acoustic features. In: Proc. ICASSP, Vol. I, pp. 888-891.
21. Markov, K., Dang, J., Iizuka, Y., Nakamura, S., 2003. Hybrid HMM/BN ASR system integrating spectrum and articulatory features. In: Proc. Eurospeech, pp. 965-968.
22. T. Okadome, and M. Honda Generation of articulatory movements by using a kinetic triphone model J. Acoust. Soc. Amer. 110 2001 453 463
23. G. Papcun, J. Hochberg, T. Thomas, F. Larouche, J. Zacks, and S. Levy Inferring articulation and recognizing gestures from acoustics with a neural network trained in X-ray microbeam data J. Acoust. Soc. Amer. 1992 688 700
24. Stephenson, T., Mathew, M., Bourlard, H., 2001. Modeling auxiliary information in Bayesian Network based ASR. In: Proc. Eurospeech, pp. 2765-2768.
25. S. Young The HTK Book 1999 Entropic Ltd.
26. J. Zacks, and T. Thomas A new neural network for articulatory speech recognition and its application to vowel identification Computer Speech Lang. 8 3 1994 189 209