SpeakBySinging: Converting singing voices to speaking voices while retaining voice timbre

Proceedings of the International Conference on Digital Audio Effects, DAFx

Volumn , Issue , 2010, Pages

  Aso, Shimpei ^a   Saitou, Takeshi ^b   Goto, Masataka ^b   Itoyama, Katsutoshi ^a   Takahashi, Toru ^a   Komatani, Kazunori ^a   Ogata, Tetsuya ^a   Okuno, Hiroshi G ^a  

^a KYOTO UNIVERSITY   (Japan)

^b NATIONAL INSTITUTE OF ADVANCED INDUSTRIAL SCIENCE AND TECHNOLOGY AIST   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

ACOUSTIC FEATURES; F0 CONTOURS; FUNDAMENTAL FREQUENCIES; POWER; SINGING VOICES; SYSTEM CONTROL; TARGET VALUES; TEXT-TO-SPEECH SYSTEM;

MUSIC;

EID: 85139271179     PISSN: 24136700     EISSN: 24136689     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (15)

1. A. W. Black and N. Campbell, "Optimising selection of units from speech databases for concatenative synthesis," in Proc. Eurospeech, 1995, pp. 581-584.
2. D. Schwarz, "A system for data-driven concatenative sound synthesis," in Proc. Digital Audio Effects, 2000, pp. 97-102.
3. T. Yoshimura, K. Tokuda, T. Masuko, T. Kobayashi, and T. Kitamura, "Simultaneous modeling of spectrum, pitch and duration in HMM-based speech synthesis," IEICE Transactions on Information and Systems (in Japanese), vol. J83-D2, no. 11, pp. 2099-2107, 2000.
4. K. Saino, H. Zen, Y. Nankaku, A. Lee, and K. Tokuda, "An HMM-based singing voice synthesis system," in Proc. International Conference on Spoken Language Processing, 2006, pp. 1141-1144.
5. H. Zen, K. Tokuda, T. Masuko, T. Kobayashi, and T. Kitamura, "A hidden semi-Markov model-based speech synthesis system," IEICE Transactions on Information and Systems, vol. E90-D, no. 5, pp. 825-834, 2007.
6. T. Saitou, M. Goto, M. Unoki, and M. Akagi, "Speech-to-singing synthesis: Converting speaking voices to singing voices by controlling acoustic features unique to singing voices," in Proc. IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, 2007, pp. 215-218.
7. Y. Ohishi, M. Goto, K. Itou, and K. Takeda, "Discrimination between singing and speaking voices," in Proc. Eurospeech, 2005, pp. 1141-1144.
8. J. Sundberg, The Science of the Singing Voice, Northern Illinois University Press, 1987.
9. J. Sundberg, "Articulatory interpretation of the "singing formant"," The Journal of the Acoustical Society of America, vol. 55, pp. 838-844, 1974.
10. P. B. Oncley, "Frequency, amplitude, and waveform modulation in the vocal vibrato," The Journal of the Acoustical Society of America, vol. 49, no. 1A, pp. 136-136, 1971.
11. H. Kawahara, I. Masuda-Katsuse, and A. De Cheveignè, "Restructuring speech representations using a pitch-adaptive time-frequency smoothing and an instantaneous-frequency-based F0 extraction: Possible role of a repetitive structure in sounds," Speech Communication, vol. 27, no. 3, pp. 187-207, 1999.
12. H. Fujihara, M. Goto, J. Ogata, K. Komatani, T. Ogata, and H. G. Okuno, "Automatic synchronization between lyrics and music CD recordings based on Viterbi alignment of segregated vocal signals," in Proc. IEEE International Symposium on Multimedia, 2006, pp. 257-264.
13. J. Odell, D. Ollason, P. Woodland, S. Young, and J. Jansen, The HTK Book for HTK V2.0, Cambridge University Press, Cambridge, UK, 1995.
14. M. Goto and T. Nishimura, "AIST Humming Database: Music database for singing research," IPSJ SIG Technical Reports (in Japanese), vol. 2005, no. 82, pp. 7-12, 2005.
15. E. Keogh and C. A. Ratanamahatana, "Exact indexing of dynamic time warping," Knowledge and Information Systems, vol. 7, no. 3, pp. 358-386, 2005.