Statistical voice conversion based on noisy channel model

IEEE Transactions on Audio, Speech and Language Processing

Volumn 20, Issue 6, 2012, Pages 1784-1794

  Saito, Daisuke ^a   Watanabe, Shinji ^b,c   Nakamura, Atsushi ^b   Minematsu, Nobuaki ^a  

^a UNIVERSITY OF TOKYO   (Japan)

^b Nippon Telegraph and Telephone Corporation   (Japan)

^c MITSUBISHI ELECTRIC RESEARCH LABORATORIES   (United States)

Author keywords

Joint density model; noisy channel model; probabilistic integration; speaker model; voice conversion (VC)

Indexed keywords

JOINT DENSITIES; NOISY CHANNEL; PROBABILISTIC INTEGRATION; SPEAKER MODEL; VOICE CONVERSION;

SPEECH RECOGNITION;

SPEECH PROCESSING;

EID: 84859768504     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2012.2188628     Document Type: Article

References (37)

1. H. Ye and S. Young, "Quality-enhanced voice morphing using maximum likelihood transformations," IEEE Trans. Audio, Speech, Lang. Process., vol. 14, no. 4, pp. 1301-1312, Jul. 2006. (Pubitemid 46547625)
2. Y. Stylianou, O. Cappé, and E. Moulines, "Continuous probabilistic transform for voice conversion," IEEE Trans. Speech Audio Process., vol. 6, no. 2, pp. 131-142, Mar. 1998. (Pubitemid 128720639)
3. A. Kain and M. W. Macon, "Spectral voice conversion for text-tospeech synthesis," in Proc. ICASSP, 1998, vol. 1, pp. 285-288.
4. L. Deng, A. Acero, L. Jiang, J. Droppo, and X. Huang, "High-performance robust speech recognition using stereo training data," in Proc. ICASSP, 2001, pp. 301-304. (Pubitemid 32839247)
5. J. Droppo, A. Acero, and L. Deng, "Uncertainty decoding with SPLICE for noise robust speech recognition," in Proc. ICASSP, 2002, pp. 57-60.
6. K. Y. Park and H. S. Kim, "Narrowband to wideband conversion of speech using GMM based transformation," in Proc. ICASSP, 2000, pp. 1847-1850.
7. K. Nakamura, T. Toda, H. Saruwatari, and K. Shikano, "Speaking aid system for total laryngectomees using voice conversion of body transmitted artificial speech," in Proc. Interspeech, 2006, pp. 1395-1398.
8. A. Kunikoshi, Y. Qiao, N. Minematsu, and K. Hirose, "Speech generation from hand gestures based on space mapping," in Proc. Interspeech, 2009, pp. 308-311.
9. A. Mousa, "Voice conversion using pitch shifting algorithm by time stretching with PSOLA and re-sampling," J. Elect. Eng., vol. 61, no. 1, pp. 57-61, 2010.
10. M. Narendranath, H. A. Murthy, S. Rajendran, and B. Yegnanarayana, "Transformation of formants for voice conversion using artificial neural networks," Speech Commun., vol. 16, no. 2, pp. 207-216, 1995.
11. S. Desai, E. V. Raghavendra, B. Yegnanarayana, A. W. Black, and K. Prahallad, "Voice conversion using artificial neural networks," in Proc. ICASSP, 2009, pp. 3893-3896.
12. M. Abe, S. Nakamura, K. Shikano, and H. Kuwabara, "Voice conversion through vector quantization," in Proc. ICASSP, 1988, pp. 655-658. (Pubitemid 18666100)
13. A. Mouchtaris, J. V. der Spiegel, and P. Mueller, "Nonparallel training for voice conversion based on a parameter adaptation approach," IEEE Trans. Audio, Speech, Lang. Process., vol. 14, no. 3, pp. 952-963, Mar. 2006. (Pubitemid 46547656)
14. C. H. Lee and C. H.Wu, "Map-based adaptation for speech conversion using adaptation data selection and non-parallel training," in Proc. Interspeech, 2006, pp. 2254-2257.
15. T. Toda, Y. Ohtani, and K. Shikano, "Eigenvoice conversion based on Gaussian mixture model," in Proc. Interspeech, 2006, pp. 2446-2449.
16. C. J. Leggetter and P. C. Woodland, "Maximum likelihood linear regression for speaker adaptation of continuous density hidden Markov models," Comput. Speech Lang., vol. 9, pp. 171-185, 1995.
17. M. J. F. Gales, "Maximum likelihood linear transformations for HMMbased speech recognition," Comput. Speech Lang., vol. 12, pp. 75-98, 1998. (Pubitemid 128383747)
18. C.-H. Lee, C.-H. Lin, and B.-H. Juang, "A study on speaker adaptation of the parameters of continuous density hidden Markov models," IEEE Trans. Audio, Speech, Lang. Process., vol. 39, no. 4, pp. 806-814, Apr. 1991.
19. R. Kuhn, J.-C. Junqua, P. Nguyen, and N. Niedzielski, "Rapid speaker adaptation in eigenvoice space," IEEE Trans. Speech Audio Process., vol. 8, no. 6, pp. 695-707, Nov. 2000. (Pubitemid 32025317)
20. F. Jelinek, "Continuous speech recognition by statistical methods," Proc. IEEE, vol. 64, no. 4, pp. 532-556, Apr. 1976. (Pubitemid 8019230)
21. P. F. Brown, J. Cocke, S. A. Della Pietra, V. J. Della Pietra, F. Jelinek, J. D. Lafferty, R. L. Mercer, and P. S. Roossin, "A statistical approach to machine translation," Comput. Linguist., vol. 16, no. 2, pp. 79-85, 1990.
22. D. A. Reynolds, T. F. Quatieri, and R. B. Dunn, "Speaker verification using adapted Gaussian mixture models," Digital Signal Process., vol. 10, no. 1-3, pp. 19-41, 2000. (Pubitemid 30592166)
23. P. Kenny, P. Ouellet, N. Dehak, V. Gupta, and P. Dumouchel, "A study of interspeaker variability in speaker verification," IEEE Trans. Audio, Speech, Lang. Process., vol. 16, no. 5, pp. 980-988, Jul. 2008.
24. D. Saito, S.Watanabe, A. Nakamura, and N. Minematsu, "Probabilistic integration of joint density model and speaker model for voice conversion," in Proc. Interspeech, 2010, pp. 1728-1731.
25. S. Furui, "Speaker-independent isolated word recognition using dynamic features of speech spectrum," IEEE Trans. Acoust., Speech, Signal Process., vol. ASSP-34, no. 1, pp. 52-59, Feb.. 1986. (Pubitemid 16575387)
26. T. Toda, A. W. Black, and K. Tokuda, "Voice conversion based on maximum-likelihood estimation of spectral parameter trajectory," IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 8, pp. 2222-2235, Nov. 2007.
27. K. Tokuda, T. Kobaayashi, and S. Imai, "Speech parameter generation from HMM using dynamic features," in Proc. ICASSP, 1995, pp. 660-663.
28. Y. Chen, M. Chu, E. Chang, J. Jiu, and R. Liu, "Voice conversion with smoothedGMM and MAP adaptation," in Proc. Eurospeech, 2003, pp. 2413-2416.
29. J. Kominek and A. W. Black, "CMU ARCTIC databases for speech synthesis," Lang. Technol. Inst., Carnegie Mellon Univ., Pittsburgh, PA, 2003[Online].Available: http://festvox.org/cmu-arctic/index.html
30. A. Kurematsu, K. Takeda, Y. Sagisaka, S. Katagiri, H. Kuwabara, and K. Shikano, "ATR Japanese speech database as a tool of speech recognition and synthesis," Speech Commun., vol. 9, pp. 357-363, 1990.
31. H. Zen, K. Tokuda, and T. Kitamura, "An introduction of trajectory model into HMM-based speech synthesis," in Proc. 5th ISCA Speech Synth. Workshop, 2004, pp. 191-196.
32. S. Watanabe, Y. Minami, A. Nakamura, and N. Ueda, "Variational Bayesian estimation and clustering for speech recognition," IEEE Trans. Speech Audio Process., vol. 12, no. 4, pp. 365-381, Jul. 2004.
33. D. Saito, S. Watanabe, A. Nakamura, and N. Minematsu, "High accurate model-integration-based voice conversion using dynamic features and model structure optimization," in Proc. ICASSP, 2011, pp. 4576-4579.
34. H. Kawahara, I. Masuda-Katsuse, and A. de Cheveigné, "Restructuring speech representations using a pitch-adaptive time-frequency smoothing and an instantaneous-frequency-based F0 extraction: Possible role of a repetitive structure in sounds," Speech Commun., vol. 27, pp. 187-207, 1999.
35. H. Duxans, A. Bonafonte, A. Kain, and J. Van Santen, "Including dynamic and phonetic information in voice conversion systems," in Proc. ICSLP, 2004, pp. 1193-1196.
36. C. H. Wu, C. C. Hsia, T. H. Liu, and J. F. Wang, "Voice conversion using duration-embedded bi-HMMs for expressive speech synthesis," IEEE Trans. Audio, Speech, Lang. Process., vol. 14, no. 4, pp. 1109-1116, Jul. 2004.
37. C.-C. Hsia, C.-H.Wu, and J.-Y.Wu, "Exploiting prosody hierarchy and dynamic features for pitch modeling and generation in HMM-based speech synthesis," IEEE Trans. Audio, Speech, Lang. Process., vol. 18, no. 8, pp. 1994-2003, Nov. 2010.