Singing voice conversion method based on many-to-many eigenvoice conversion and training data generation using a singing-to-singing synthesis system

2012 Conference Handbook - Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2012

Volumn , Issue , 2012, Pages

  Doi, Hironori ^a   Toda, Tomoki ^a   Nakano, Tomoyasu ^b   Goto, Masataka ^b   Nakamura, Satoshi ^a  

^a NARA INSTITUTE OF SCIENCE AND TECHNOLOGY   (Japan)

^b NATIONAL INSTITUTE OF ADVANCED INDUSTRIAL SCIENCE AND TECHNOLOGY AIST   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

EIGENVOICES; MANY-TO-MANY; PARALLEL DATA; SINGING VOICES; TRAINING DATA; VOICE CONVERSION; VOICE QUALITY;

DATA HANDLING; SIGNAL PROCESSING;

SPEECH PROCESSING;

EID: 84874403435     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (20)

1. H. Kenmochi and H. Ohshita, "VOCALOID - Commericial singing synthesizer based on sample concatenation," Proc. INTERSPEECH, pp. 4011-4012, Aug. 2007.
2. K. Oura, A. Mase, T. Yamada, S. Muto, Y. Nankaku, and K. Tokuda, "Recent development of the HMM-based singing voice synthesis system - Sinsy," SSW7, pp. 211-216, Sept. 2010.
3. H. Kenmochi, "VOCALOID and Hatsune Miku phenomenon in Japan,"Proc. InterSinging, pp. 1-4, Oct. 2010.
4. H. Kawahara, R. Nisimura, T. Irino, M. Morise, T. Takahashi, and H. Banno, "Temporally variable multi-aspect auditory morphing enabling extrapolation without objective and perceptual breakdown," Proc. ICASSP, pp. 3905-3908, Apr. 2009.
5. F. Villavicencio and J. Bonada, "Applying voice conversion to concate-native singing-voice synthesis," INTERSPEECH, pp. 2162-2165, Sept. 2010.
6. T. Nakano and M. Goto, "Vocalistener2: A singing synthesis sytem able to mimic a user's singing in terms of voice timbre changes as well as pitch and dynamics," Proc. ICASSP, pp. 453-456, May 2012.
7. Y. Yoshida, R. Nishimura, T. Irino, and H. Kawahara, "Vowel-based voice conversion and its application to singing-voice manipulation,"Proc. AES 35th International Conference: Audio for Games, no. 6, Feb. 2009.
8. Y. Kawakami, H. Banno, and F. Itakura, "GMM voice conversion of singing voice using vocal tract area function," IEICE technical report. Speech 110(297) (Japanese edition), pp. 71-76, Nov. 2010.
9. Y. Stylianou, O. Cappe, and E. Moulines, "Continuous probabilistic transform for voice conversion," IEEE Trans. SAP, vol. 6, no. 2, pp. 131-142, Mar. 1998.
10. A. Kain and M. W. Macon, "Spectral voice conversion for text-to-speech synthesis," Proc. ICASSP, pp. 285-288, May 1998.
11. T. Toda, A. W. Black, and K. Tokuda, "Voice conversion based on maximum likelihood estimation of spectral parameter trajectory," IEEE Trans. ASLP, vol. 15, no. 8, pp. 2222-2235, Nov. 2007.
12. Y. Ohtani, T. Toda, H. Saruwatari, and K. Shikano, "Many-to-many eigenvoice conversion with reference voice," INTERSPEECH, pp. 1623-1626, Sept. 2009.
13. T. Nakano and M. Goto, "VocaListener: A singing-to-singing synthesis system based on iterative parameter estimation," Proc. SMC 2009, pp. 343-348, May 2009.
14. T. Toda, Y. Ohtani, and K. Shikano, "One-to-many and many-to-one voice conversion based on eigenvoices," Proc. ICASSP, pp. 1249-1252, Apr. 2007.
15. Y. Ohtani, T. Toda, H. Saruwatari, and K. Shikano, "Adaptive training for voice conversion based on eigenvoices," IEICE Trans. Inf. and Syst., vol. E93-D, no. 6, pp. 1589-1598, June 2010.
16. T. Saitou, M. Goto, M. Unoki, and M. Akagi, "Speech-to-singing synthesis: Converting speaking voices to singing voices by controlling acoustic features unique to singing voice," Proc. WASPAA, pp. 215-218, Oct. 2007.
17. T. Muramatsu, Y. Ohtani, T. Toda, H. Saruwatari, and K. Shikano, "Low-delay voice conversion based on maximum likelihood estimation of spectral parameter trajectory," Proc. INTERSPEECH, pp. 1076-1079, Sept. 2008.
18. M. Goto, T. Nishimura, H. Hashiguchi, and R. Oka, "RWC Music Database: Music genre database and musical instrument sound database," Proc. ISMIR, pp. 229-230, Oct. 2003.
19. Crypton Future Media, "What is the "HATSUNE MIKU movement"?"2012. [Online]. Available: http://www.crypton.co.jp/miku- eng
20. H. Kawahara, I. Masuda-Katsuse, and A. Cheveigne, "Restructuring speech representations using a pitch-adaptive time-frequency smoothing and an instantaneous-frequency-based f0 extraction: Possible role of a repetitive structure in sounds," Speech Communication, vol. 27, no. 3-4, pp. 187-207, Apr. 1999.