Synthesis of the singing voice by performance sampling and spectral models

IEEE Signal Processing Magazine

Volumn 24, Issue 2, 2007, Pages 67-79

  Bonada, Jordi ^a   Serra, Xavier ^a  

^a UNIVERSITAT POMPEU FABRA   (Spain)

Author keywords

[No Author keywords available]

Indexed keywords

ACOUSTIC EQUIPMENT; SOUND REPRODUCTION; SPECTRUM ANALYSIS; SPEECH SYNTHESIS;

PERFORMANCE SAMPLING; SINGING VOICE SYNTHESIZER;

COMPUTER MUSIC;

EID: 85032751318     PISSN: 10535888     EISSN: None     Source Type: Journal    
DOI: 10.1109/MSP.2007.323266     Document Type: Review

References (43)

1. D. Schwarz, "Corpus-based concatenative synthesis," IEEE Signal Processing Mag., vol. 24, no. 2, pp. 92-104, Mar. 2007.
2. E. Lindemann, "Music synthesis with reconstructive phrase modeling," IEEE Signal Processing Mag., vol. 24, no. 2, pp. 80-91, Mar. 2007.
3. J. Bonada, A. Loscos, and M. Blaauw, "Unisong: A choir singing synthesizer," presented at the 121st AES Conv., convention paper 6933, San Francisco, CA, Oct. 2006.
4. J. Sundberg, The Science of the Singing Voice. DeKalb, IL: Northern Illinois Univ. Press, 1987.
5. M. Kob, "Singing voice modeling as we know it today," Acta Acust. united with Acustica, vol. 90, no. 4, pp. 649-661, 2004.
6. X. Rodet, "Synthesis and processing of the singing voice," in Proc. 1st IEEE Benelux Workshop on Model based Processing and Coding of Audio, Leuven, Nov. 2002.
7. P.R. Cook, "Singing voice synthesis: History, current work, and future directions," Computer Music J., vol. 20, no. 3, pp. 38-46, Fall 1996.
8. J. Kelly and C. Lochbaum, "Speech synthesis," in Proc. 4th Int. Congr. Acoustics, 1962, Copenhagen, Denmark, pp. 1-4.
9. J.O. Smith, "Physical modeling using digital waveguides," Computer Music J., vol. 16, no. 4, pp. 74-87, 1992.
10. P. Cook, "SPASM: A real-time vocal tract physical model editor/ controller and singer; The Companion Software Synthesis System," Computer Music J., vol. 17, no. 1, pp. 30-44, 1992.
11. J. Mullen, D.M. Howard, and D.T. Murphy, "Acoustical simulations of the human vocal tract using the 1D and 2D digital waveguide software model," in Proc. 4th Int. Conf. Digital Audio Effects, Naples, Italy, pp. 311-314, Oct. 2004.
12. J. Mullen, D.M. Howard, and D.T. Murphy, "Waveguide physical modeling of vocal tract acoustics: Flexible formant bandwidth control from increased model dimensionality," IEEE Trans. Audio, Speech, Language Processing, vol. 14, no. 3, pp. 964-971, May 2006.
13. B.H. Story, I.R. Titze, and E.A. Hoffman, "Vocal tract area functions from magnetic resonance imaging," J. Acoust. Soc. Amer., vol. 104, no. 1, pp. 471-487, 1996.
14. B.H. Story, "Using imaging and modeling techniques to understand the relation between vocal tract shape to acoustic characteristics," in Proc. Stockholm Music Acoustics Conf., 2003, SMAC-03, pp. 435-438.
15. C. Cooper, D. Murphy, D. Howard, and A. Tyrrell, "Singing synthesis with an evolved physical model," IEEE Trans. Audio, Speech, Language Processing, vol. 14, no. 4, pp. 1454-1461, July 2006.
16. M. Macon, L. Jensen-Link, J. Oliverio, M. Clements, and E. George, "A singing voice synthesis system based on sinusoidal modeling," in Proc. Int. Conf. Acoustics, Speech, Signal Processing, Munich, Germany, vol. 1, 199, pp. 435-4387.
17. D.H. Klatt, "Review of text-to-speech conversion for English," J. Acoust. Soc. Amer., vol. 82, no. 3, pp. 737-793, 1987.
18. G. Bennett and X. Rodet, "Synthesis of the singing voice," in Current Directions in Computer Music Research, M.V. Mathews and J.R. Pierce, Eds., Cambridge, MA: MIT Press, pp. 19-44, 1989.
19. J. Bonada, A. Loscos, P. Cano, X. Serra, and H. Kenmochi, "Spectral approach to the modeling of the singing voice," presented at the 111th AES Conv., convention paper 5452, New York, Sept. 2001.
20. D.G. Childers, "Measuring and modeling vocal source-tract interaction," IEEE Trans. Biomed. Eng., vol. 41, no. 7, pp. 663-671, July 1994.
21. X. Serra, "A system for sound analysis-transformation-synthesis based on a deterministic plus stochastic decomposition," Ph.D. dissertation, CCRMA, Dept. Music, Stanford Univ., Stanford, CA, 1989.
22. J. Laroche and M. Dolson, "New phase-vocoder techniques for real-time pitch-shifting, chorusing, harmonizing, and other exotic audio effects," J. Audio Eng. Soc., vol. 47, no. 11, pp. 928-936, Nov. 1999.
23. J. Bonada, A. Loscos., O. Mayor, and H. Kenmochi, "Sample-based singing voice synthesizer using spectral models and source-filter decomposition," in Proc. 3rd Int. Workshop Models and Analysis of Vocal Emissions for Biomedical Applications, Firenze, Italy, 2003, pp. 175-178.
24. J. Laroche, "Frequency-domain techniques for high-quality voice modification," in Proc. 6th Int. Conf. Digital Audio Effects, London, UK, Sept. 2003.
25. R. DiFederico, "Waveform preserving time stretching and pitch shifting for sinusoidal models of sound," in Proc. 1st Int. Conf. Digital Audio Effects, Barcelona, Spain, Nov. 1998, pp. 44-48.
26. R. Smits and B. Yegnanarayana, "Determination of instants of significant excitation in speech using group delay function," IEEE Trans. Speech Audio Processing, vol. 3, no. 5, pp. 325-333, Sept. 1995.
27. B. Yegnanarayana and R. Veldhuis, "Extraction of vocal-tract system characteristics from speech signal," IEEE Trans. Speech Audio Processing, vol. 6, no. 4, pp. 313-327, July 1998.
28. J. Bonada, "High quality voice transformations based on modeling radiated voice pulses in frequency domain," in Proc. 7th Int. Conf. Digital Audio Effects, Naples, Italy, Oct. 2004, pp. 291-295.
29. A. Loscos and J. Bonada, "Emulating rough and growl voice in spectral domain," in Proc. 7th Int. Conf. Digital Audio Effects, Naples, Italy, Oct. 2004, pp. 49-52.
30. M. Kob, "Physical modeling of the singing voice," Ph.D. dissertation, Institute of Technical Acoustics, Aachen Univ., Aachen, Germany, 2002.
31. A. Röbel, "A new approach to transient processing in the phase vocoder," in Proc. 6th Int. Conf. Digital Audio Effects, London, UK, Sept. 2003, pp. 344-349.
32. X. Rodet, Y. Potard, and J.B.B. Barrire, "The CHANT Project: From the synthesis of the singing voice to synthesis in general," Computer Music J., vol. 8, no. 3, pp. 15-31, 1984.
33. W. Kaegi and S. Tempelaars, "VOSIM - A new sound synthesis system," J. Audio Eng. Soc., vol. 26, no. 6, pp. 418-425, 1978.
34. R. Bresin and A. Friberg, "Emotional coloring of computer-controlled music performances," Computer Music J., vol. 24, no. 4, pp. 44-63, 2000.
35. J. Sundberg, A. Askenfelt, and L. Fryd'n, "Musical performance: A synthesisby-rule approach," Computer Music J., vol. 7, no. 1, pp. 37-43, 1983.
36. G. Widmer and W. Goebl, "Computational models of expressive music performance: The state of the art," J. New Music Res., vol. 33, no. 3, pp. 203-216, 2004.
37. M. Laurson, V. Norilo, and M. Kuuskankare, "PWGLSynth: A visual synthesis language for virtual instrument design and control," Computer Music J., vol. 29, no. 3, pp. 29-41, 2005.
38. A. Black, "Perfect synthesis for all of the people all of the time," in Proc. IEEE TTS Workshop 2002, Santa Monica, CA, Sept. 2002, pp. 167-170.
39. J. Llisterri and J.B. Mariño, "Spanish adaptation of SAMPA and automatic phonetic transcription," ESPRIT Project 6819 (SAM-A Speech Technology Assessment in Multilingual Applications), 1993.
40. J. Bonada, A. Loscos, and M. Blaauw, "Improvements to a sample-concatenation based singing voice synthesizer," presented at the 121st AES Conv., convention paper 6900, San Francisco, CA, Oct. 2006.
41. J. Ross and J. Sundberg, "Syllable and tone boundaries in singing," in Proc. 4th Pan European Voice Conf., Stockholm, Sweden, Aug. 2001.
42. L. Fabig and J. Janer, "Transforming singing voice expression: The sweetness effect," in Proc. 7th Int. Conf. Digital Audio Effects, Naples, Italy, 2004, pp. 70-75.
43. J. Bonada, A. Loscos, and H. Kenmochi, "Sample-based singing voice synthesizer by spectral concatenation," in Proc. Stockholm Music Acoustics Conf., Stockholm, Sweden, 2003, pp. 439-442.