A comparative study of spectral transformation techniques for singing voice synthesis

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn , Issue , 2014, Pages 2499-2503

  Lee, S W ^a   Wu, Zhizheng ^b   Dong, Minghui ^a   Tian, Xiaohai ^b   Li, Haizhou ^a,b  

^a INSTITUTE FOR INFOCOMM RESEARCH   (Singapore)

^b NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

Author keywords

Adaptation; Singing synthesis; Spectral transformation; Speech to singing; Voice conversion

Indexed keywords

COMPUTER MUSIC; MAXIMUM LIKELIHOOD ESTIMATION; SPECTRUM ANALYSIS; SPEECH COMMUNICATION;

ADAPTATION; COMPARATIVE STUDIES; CONTEXT-DEPENDENT MODELS; GAUSSIAN MIXTURE MODEL; SINGING SYNTHESIS; SINGING-VOICE SYNTHESIS; SPECTRAL TRANSFORMATIONS; VOICE CONVERSION;

SPEECH PROCESSING;

EID: 84910071971     PISSN: 2308457X     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (28)

1. Synthesis of Singing Challenge (Special Session), Proc. Interspeech, Aug. 2007.
2. M. Akagi, "Rule-based voice conversion derived from expressive speech perception model: How do computers sing a song joyfully?" in Proc. ISCSLP. Tutorial 01, Nov. 2010.
3. J. Bonada and X. Serra, "Synthesis of the singing voice by performance sampling and spectral models, " IEEE Signal Processing Magazine, vol. 24, pp. 67-79, 2007.
4. K. Saino, H. Zen, Y. Nankaku, A. Lee, and K. Tokuda, "An HMMbased singing voice synthesis system, " in Proc. Interspeech, Sep. 2006, pp. 2274-2277.
5. S. W. Lee, S. T. Ang, M. Dong, and H. Li, "Generalized F0 modeling with absolute and relative pitch features for singing voice synthesis, " in Proc. ICASSP, Mar. 2012, pp. 429-432.
6. S. W. Lee and M. Dong, "Singing voice synthesis: Singerdependent vibrato modeling and coherent processing of spectral envelope, " in Proc. Interspeech, Aug. 2011, pp. 2001-2004.
7. H. Kenmochi and H. Ohshita, "VOCALID - Commercial singing synthesizer based on sample concatenation, " in Proc. Interspeech, Aug. 2007.
8. P. Kirn, "iPhone Day: LaDiDa's Reverse Karaoke Composes Accompaniment to Singing [Online], " Mar. 2014, available: Http://createdigitalmusic.com/2009/10/iphone-day-ladidasreverse-karaoke-composes-accompaniment-to-singing/.
9. "An app with speech-to-singing utility. NDP 2013 Mobile App [Online], " Mar. 2014, available: Https://itunes.apple.com/sg/app/ndp-2013-mobileapp/id524388683?mt=8.
10. M. Goto, T. Nakano, S. Kajita, Y. Matsusaka, S. Nakaoka, and K. Yokoi, "Vocalistener and vocawatcher: Imitating a human singer by using signal processing, " in Proc. ICASSP, Mar. 2012, pp. 5393-5396.
11. J. Wolfe, M. Garnier, and J. Smith, "Vocal tract resonances in speech, singing and playing music instruments, " Human Frontier Science Program Journal, vol. 3, pp. 6-23, 2009.
12. E. Joliveau, J. Smith, and J. Wolfe, "Tuning of vocal tract resonance by sopranos, " Nature, vol. 427, p. 116, Jan. 2004.
13. J. Sundberg, "The acoustics of the singing voice, " Scientific American, vol. 236, pp. 82-91, Mar. 1977.
14. T. Saitou, M. Goto, M. Unoki, and M. Akagi, "Speech-to-singing synthesis: Converting speaking voices to singing voices by controlling acoustic features unique to singing voices, " in Proc. IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, Oct. 2007, pp. 215-218.
15. E. Moulines and Y. Sagisaka, "Voice conversion: State of the art and perspective, " Special Iss. Speech Commun., vol. 16, no. 2, 1995.
16. Y. Stylianou, O. Cappe, and E. Moulines, "Continuous probabilistic transform for voice conversion, " IEEE Trans. Speech & Audio Proc., vol. 6, pp. 131-142, Mar. 1998.
17. T. Toda, H. Saruwatari, and K. Shikano, "Voice conversion algorithm based on Gaussian mixture model with dynamic frequency warping of STRAIGHT spectrum, " in Proc. ICASSP, May 2001, pp. 841-844.
18. A. B. Kain, "High resolution voice transformation, " Ph.D. dissertation, OGI School of Science & Engineering, Oct. 2001.
19. T. Toda, A.W. Black, and K. Tokuda, "Voice conversion based on maximum-likihood estimation of spectral parameter trajectory, " IEEE Trans. Audio, Speech, & Lang. Proc., vol. 15, pp. 2222- 2235, Nov. 2007.
20. D. Erro, A. Moreno, and A. Bonafonte, "Voice conversion based on weighted frequency warping, " IEEE Trans. Audio, Speech, & Lang. Proc., vol. 18, pp. 922-931, Jul. 2010.
21. K. Tokuda, T. Yoshimura, T. Masuko, T. Kobayashi, and T. Kitamura, "Speech parameter generation algorithms for HMM-based speech synthesis, " in Proc. ICASSP, Jun. 2000, pp. 1315-1318.
22. M. Tamura, T. Masuko, K. Tokuda, and T. Kobayashi, "Adaptation of pitch and spectrum for HMM-based speech synthesis using MLLR, " in Proc. ICASSP, May 2011, pp. 805-808.
23. J. Yamagishi, T. Masuko, and T. Kobayashi, "HMM-based expressive speech synthesis - Towards TTS with arbitrary speaking styles and emotions, " in Proc. Special Workshop in Maui (SWIM), Jan. 2004.
24. J. Yamagishi and T. Kobayashi, "Average-voice-based speech synthesis using HSMM-based speaker adaptation and adaptive training, " IEICE Trans. Inf. & Syst., vol. E90-D, pp. 533-543, Feb. 2007.
25. T. Toda, M. Nakagiri, and K. Shikano, "Statistical voice conversion techniques for body-conducted unvoiced speech enhancement, " IEEE Trans. Audio, Speech, & Lang. Proc., vol. 20, pp. 2505-2517, Sep. 2012.
26. H. Kawahara, M. Morise, T. Takahashi, R. Nisimura, T. Irino, and H. Banno, "Tandem-STRAIGHT: A temporally stable power spectral representation for periodic signals and applications to interference-free spectrum, F0 and aperiodicity estimation, " in Proc. ICASSP, Mar. 2008, pp. 3933-3936.
27. J. Yamagishi, T. Kobayashi, Y. Nakano, K. Ogata, and J. Isogai, "Analysis of speaker adaptation algorithms for HMM-based speech synthesis and a constrained SMAPLR adaptation algorithm, " IEEE Trans. Audio, Speech, & Lang. Proc., vol. 17, pp. 66-83, Jan. 2009.
28. H. Zen, K. Oura, T. Nose, J. Yamagishi, S. Sako, T. Toda, T. Masuko, A. W. Black, and K. Tokuda, "Recent development of the HMM-based speech synthesis system (HTS), " in Proc. APSIPA ASC, Oct. 2009, pp. 121-130.