Continuous stochastic feature mapping based on trajectory HMMs

IEEE Transactions on Audio, Speech and Language Processing

Volumn 19, Issue 2, 2011, Pages 417-430

  Zen, Heiga ^a   Nankaku, Yoshihiko ^b   Tokuda, Keiichi ^b  

^a TOSHIBA CORPORATION   (Japan)

^b NAGOYA INSTITUTE OF TECHNOLOGY   (Japan)

Author keywords

Gaussian mixture model (GMM) based mapping; speech recognition; trajectory hidden Markov model (HMM); voice conversion

Indexed keywords

ARTICULATORY INVERSION; DYNAMIC CHARACTERISTICS; GAUSSIAN MIXTURE MODEL; GAUSSIAN MIXTURE MODEL (GMM)-BASED MAPPING; LEVEL TRANSFORMATION; MAPPING TECHNIQUES; NEW APPROACHES; NOISE-COMPENSATION; STATIC AND DYNAMIC; STOCHASTIC FEATURES; VOICE CONVERSION;

GAUSSIAN DISTRIBUTION; HIDDEN MARKOV MODELS; MAPPING; OBJECT RECOGNITION; SPEECH PROCESSING; STOCHASTIC MODELS; STOCHASTIC SYSTEMS; TRAJECTORIES;

SPEECH RECOGNITION;

EID: 78149260085     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2010.2049685     Document Type: Article

References (49)

1. M. Abe, S. Nakamura, K. Shikano, and H. Kuwabara, "Voice conversion through vector quantization", J. Acoust. Soc. Jpn. (E), vol. 11, no. 2, pp. 71-76, 1990.
2. M. Afify, X.-D. Cui, and Y. Gao, "Stereo-based stochastic mapping for robust speech recognition", in Proc. ICASSP, 2007, pp. 377-380.
3. Y. Chen, M. Chu, E. Chang, and J. Liu, "Voice conversion with smoothed GMM and MAP adaptation", in Proc. Interspeech, 2003, pp. 2413-2416.
4. X.-D. Cui, M. Afify, and Y. Gao, "MMSE-based stereo feature stochastic mapping for noise robust speech recognition", in Proc. ICASSP, 2008, pp. 4077-4080.
5. L. Deng, A. Acero, L. Jiang, J. Droppo, and X. Huang, "High-performance robust speech recognition using stereo training data", in Proc. ICASSP, 2001, pp. 301-304.
6. J. Droppo, A. Acero, and L. Deng, "Uncertainty decoding with SPLICE for noise robust speech recognition", in Proc. ICASSP, 2002, pp. 57-60.
7. W. Fujitsuru, H. Sekimoto, T. Toda, H Saruwatari, and K. Shikano, "Bandwidth extension of cellular phone speech based on maximum likelihood estimation with GMM", in Proc. NCSP, 2008, pp. 283-286.
8. T. Fukada, K. Tokuda, T. Kobayashi, and S. Imai, "An adaptive algorithm for mel-cepstral analysis of speech", in Proc. ICASSP, 1992, pp. 137-140.
9. S. Furui, "Speaker independent isolated word recognition using dynamic features of speech spectrum", IEEE Trans. Acoust., Speech, Signal Process., vol. 34, pp. 52-59, 1986.
10. S. Hiroya and M. Honda, "Estimation of articulatory movements from speech acoustics using an HMM-based speech production model", IEEE Trans. Speech Audio Process., vol. 12, no. 2, pp. 175-185, Mar. 2004.
11. H. Hirsch and D. Pearce, "The AURORA experimental framework for the performance evaluations of speech recognition systems under noisy conditions", in Proc. ISCA ITRW ASR'00, 2000, pp. 181-188.
12. S. Imai, "Cepstral analysis synthesis on the mel frequency scale", in Proc. ICASSP, 1983, pp. 93-96.
13. A. Kain and M. Macon, "Spectral voice conversion for text-to-speech synthesis", in Proc. ICASSP, 1998, pp. 285-288.
14. A. Kain, X. Niu, J.-P. Hosom, Q. Miao, and J. van Santen, "Formant re-synthesis of dysarthric speech", in Proc. ISCA SSW5, 2003, pp. 25-30.
15. K. Koishida, K. Tokuda, T. Masuko, and T. Kobayashi, "Vector quantization of speech spectral parameters using statistics of dynamic features", in Proc. Int. Conf. Signal Process.'97, 1997, pp. 247-252.
16. J. Kominek and A. Black, "CMU ARCTIC databases for speech synthesis", Carnegie Mellon Univ., Pittsburgh, PA, Tech. Rep. CMU-LTI-03-177, 2003.
17. Z.-H. Ling and R.-H. Wang, "HMM-based unit selection using frame sized speech segments", in Proc. Interspeech, 2006, pp. 2034-2037.
18. D. Liu and J. Nocedal, "On the limited memory BFGS method for large scale optimization", Math. Program. B, vol. 45, no. 3, pp. 503-528, 1989.
19. T. Muramatsu, Y. Ohtani, T. Toda, H. Saruwatari, and K. Shikano, "Low-delay voice conversion based on maximum likelihood estimation of spectral parameter trajectory", in Proc. Interspeech, 2008, pp. 1076-1079.
20. M. Nakagiri, T. Toda, H. Kashioka, and K. Shikano, "Improving body transmitted unvoiced speech with statistical voice conversion", in Proc. Interspeech, 2006, pp. 2270-2273.
21. K. Nakamura, T. Toda, Y. Nankaku, and K. Tokuda, "On the use of phonetic information for mapping from articulatory movements to vocal tract spectrum", in Proc. ICASSP, 2006, pp. 93-96.
22. K. Nakamura, T. Toda, H. Saruwatari, and K. Shikano, "Speaking aid system for total laryngectomees using voice conversion of body transmitted artificial speech", in Proc. Interspeech, 2006, pp. 1395-1398.
23. Y. Nankaku, K. Nakamura, T. Toda, and K. Tokuda, "Spectral conversion based on statistical models including time-frequency matching", in Proc. ISCA SSW6, 2007, pp. 333-338.
24. K.-Y. Park and H.-S. Kim, "Narrowband to wideband conversion of speech using GMM based transformation", in Proc. ICASSP, 2000, pp. 1847-1850.
25. K. Richmond, "Estimating articulatory parameters from the acoustic speech signal", Ph. D. dissertation, Centre for Speech Technol. Res., Edinburgh Univ., Edinburgh, U. K., 2002.
26. K. Richmond, "Trajectory mixture density network with multiple mixtures for acoustic-articulatory inversion", in Proc. NOLISP, 2007, pp. 67-70.
27. K. Richmond, S. King, and P. Taylor, "Modelling the uncertainty in recovering articulation from acoustics", Comput. Speech Lang., vol. 17, pp. 153-172, 2003.
28. H. Rue and L. Held, Gaussian Markov Random Fields: Theory and Applications. Boca Raton, FL: Chapman & Hall/CRC, 2005.
29. M. Seltzer, A. Acero, and J. Droppo, "Robust bandwidth extension of noise-corrupted narrowband speech", in Proc. Interspeech, 2005, pp. 1509-1512.
30. Y. Shiga and S. King, "Accurate spectral envelope estimation for articulation-to-speech synthesis", in Proc. ISCA SSW5, 2004, pp. 19-24.
31. Y. Stylianou, O. Cappe, and E. Moulines, "Continuous probabilistic transform for voice conversion", IEEE Trans. Speech Audio Process., vol. 6, no. 2, pp. 131-142, Mar. 1998.
32. D. Talkin, "A robust algorithm for pitch tracking (RAPT)", in Speech Coding and Synthesis, W. Kleijn and K. Paliwal, Eds. Amsterdam, The Netherlands: Elsevier, 1995.
33. T. Toda, A. W. Black, and K. Tokuda, "Mapping from ariticulatory movements to vocal tract spectrum with Gaussian mixture model for ariticulatory speech synthesis", in Proc. ISCA SSW5, 2004, pp. 31-36.
34. T. Toda, A. Black, and K. Tokuda, "Voice conversion based on maximum-likelihood estimation of spectral parameter trajectory", IEEE Trans. Acoust. Speech, Lang. Process., vol. 15, no. 8, pp. 2222-2235, Nov. 2007.
35. T. Toda, A. Black, and K. Tokuda, "Statistical mapping between articulatory movements and acoustic spectrum using a Gaussian mixture model", Speech Comm., vol. 50, no. 3, pp. 215-227, 2008.
36. T. Toda and K. Shikano, "NAM-to-speech conversion with Gaussian mixture models", in Proc. Interspeech, 2005, pp. 1957-1960.
37. K. Tokuda, T. Kobayashi, and S. Imai, "Speech parameter generation from HMM using dynamic features", in Proc. ICASSP, 1995, pp. 660-663.
38. K. Tokuda, T. Masuko, Y. Yamada, T. Kobayashi, and S. Imai, "An algorithm for speech parameter generation from continuous mixture HMMs with dynamic features", in Proc. Eurospeech, 1995, pp. 757-760.
39. K. Tokuda, T. Yoshimura, T. Masuko, T Kobayashi, and T. Kitamura, "Speech parameter generation algorithms for HMM-based speech synthesis", in Proc. ICASSP, 2000, pp. 1315-1318.
40. A. Wrench, The MOCHA-TIMIT Database, 1999. [Online]. Available: http://www.cstr.ed.ac.uk/artic/mocha.html
41. T. Yoshimura, K. Tokuda, T. Masuko, T. Kobayashi, and T. Kitamura, "Simultaneous modeling of spectrum, pitch and duration in HMM-based speech synthesis", in Proc. Eurospeech, 1999, pp. 2347-2350.
42. S. Young, G. Evermann, M. Gales, T. Hain, D. Kershaw, X.-Y. Liu, G. Moore, J. Odell, D. Ollason, D. Povey, V. Valtchev, and P. Woodland, The Hidden Markov Model Toolkit (HTK) Version 3.4, 2006. [Online]. Available: http://htk.eng.cam.ac.uk/
43. H. Zen, Y. Nankaku, and K. Tokuda, "Model-space MLLR for trajectory HMMs", in Proc. Interspeech, 2007, pp. 2065-2068.
44. H. Zen, Y. Nankaku, K. Tokuda, and T. Kitamura, "Speaker adaptation of trajectory HMMs using feature-space MLLR", in Proc. Interspeech, 2006, pp. 2274-2277.
45. H. Zen, K. Tokuda, and T. Kitamura, "Estimating trajectory HMM parameters by Monte Carlo EM with Gibbs sampler", in Proc. ICASSP, 2006, pp. 1173-1176.
46. H. Zen, K. Tokuda, and T. Kitamura, "Reformulating the HMM as a trajectory model by imposing explicit relationships between static and dynamic features", Comput. Speech Lang., vol. 21, no. 1, pp. 153-173, 2007.
47. L. Zhang, "Modelling speech dynamics with trajectory-HMMs", Ph. D. dissertation, Univ. of Edinburgh, Edinburgh, U. K., 2009.
48. L. Zhang and S. Renals, "Acoustic-articulatory modelling with the trajectory HMM", IEEE Signal Process. Lett., vol. 15, pp. 245-248, 2008.
49. Y. Zheng, Z. Liu, Z. Zhang, M. Sinclair, J. Droppo, L. Deng, A. Acero, and X Huang, "Air-and bone-conductive integrated microphones for robust speech detection and enhancement", in Proc. ASRU, 2003, pp. 249-254.