Music synthesis with reconstructive phrase modeling

IEEE Signal Processing Magazine

Volumn 24, Issue 2, 2007, Pages 80-91

  Lindemann, Eric ^a  

^a Synful ^*

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER SIMULATION; DATABASE SYSTEMS; TECHNOLOGY;

MUSIC SYNTHESIS; RECONSTRUCTIVE PHRASE MODELING;

ACOUSTIC WAVES;

EID: 85032751560     PISSN: 10535888     EISSN: None     Source Type: Journal    
DOI: 10.1109/MSP.2007.323267     Document Type: Article

References (46)

1. J. Chowning, "The synthesis of complex audio spectra by means of frequency modulation," J. Audio Eng. Soc., vol. 21, no. 7, 1973.
2. J.O. Smith, "Music applications of digital waveguides," Center for Computer Research in Music and Acoustics (CCRMA), Stanford Univ., CCRMA Tech. Report STAN-M-39, 1987.
3. P. Schaeffer, Traite des Objets Musicaux, 1st ed. Paris, France: Editions du Seuil, 1966.
4. E. Lindemann, Synful Orchestra, www.synful.com, 2004-2006.
5. H. Fletcher, Speech and Hearing in Communication, J, Allen, Ed., Acoustical Society of America, 1995.
6. B.C.J. Moore, An Introduction to the Psychology of Hearing. New York: Academic, 1989.
7. S. Hawking, God Created the Integers. Running Press, 2005. p. 496.
8. A. Freed, "Inverse transform narrow band/broad band sound synthesis," U.S. Patent 5686683, 1997.
9. A. Dembo and D. Malah, "Signal synthesis from modified discrete short-time transform," IEEE Trans. Acoust., Speech, Signal Processing, vol. ASSP-36, pp. 168-181, Feb. 1988.
10. J. Laroche, "Synthesis of sinusoids via non-overlapping inverse Fourier transform," IEEE Trans. Speech and Audio Processing, vol. 8, pp. 471-477, July 2000.
11. X. Rodet and P. Depalle, "Spectral envelopes and inverse FFT synthesis," in Proc. 93rd Conv. Audio Engineering Society, San Francisco, CA, Preprint 3393 (H-3), 1992.
12. M. Goodwin and X. Rodet, "Efficient Fourier synthesis of nonstationary sinusoids," presented at Int. Computer Music Conf., 1994.
13. R.J. McAulay and T.F. Quatieri, "Computationally efficient sine-wave synthesis and its application to sinusoidal transform coding," presented at IEEE Int. Conf. Acoustics, Speech, and Signal Processing, New York, NY, 1998.
14. P. Kleczkowski, "Group additive synthesis," Computer Music J., vol. 13, no. 1, pp. c12-20, 1989.
15. A. Horner, J. Beauchamp, and L. Haken, "Methods for multiple wavetable synthesis of musical instrument tones," J. Audio Eng. Soc., vol. 41, no. 5, May 1993.
16. J.-C. Risset and M. Mathews, "Analysis of instrument tones," Physics Today, vol. 22, no. 2, pp. 23-40, 1969.
17. J.B. Allen, "Short term spectral analysis, synthesis, and modification by discrete Fourier transform," IEEE Trans. Acoust., Speech, Signal Processing, vol. ASSP-25, no. 3, pp. 235-238, 1977.
18. P.P. Vaidyanathan, Multirate Systems and Filter Banks. New York: Prentice-Hall 1993.
19. F.J. Harris, "On the use of windows for harmonic analysis with the discrete Fourier transform," Proc. IEEE, vol. 66, pp. 51-83, 1978.
20. J.O. Smith and X. Serra, "PARSHL: An analysis/synthesis program for non-harmonic sounds based on a sinusoidal representation," in Proc. Int. Computer Music Conf., Tokyo, Japan, 1987.
21. R.J. McAulay and T.F. Quatieri, "Speech analysis/synthesis based on a sinusoidal representation," IEEE Transactions Acoust., Speech, Signal Processing, vol. ASSP-34, pp. 744-754, Aug. 1986.
22. T.F. Quatieri and R.J. McAulay, "Audio signal processing based on sinusoidal analysis/synthesis," in Applications of DSP to Audio & Acoustics, Boston: Kluwer, pp. 343-416, 1998.
23. X. Serra and J.O. Smith, "Spectral modeling synthesis: A sound analysis/synthesis system based on a deterministic plus stochastic decomposition," Computer Music J., vol. 14, pp. 12-24, 1990.
24. J. Laroche, Y. Stylianou, and E. Moulines, "HNS: Speech modification based on a harmonic + noise model," in Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing, Minneapolis, MN, 1993.
25. G. Evangelista, "Pitch-synchronous wavelet representations of speech and music signals," IEEE Trans. Signal Processing, vol. 41, no. 12, Dec. 1993.
26. T. Dutoit, An Introduction to Text-to-Speech Synthesis. Norwell, MA: Kluwer, 1997.
27. A.J. Hunt, A.W. Black, "Unit selection in a concatenative speech synthesis system using a large speech database," in Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing, Atlanta, GA, pp. 373-376, May 1996.
28. Y. Sagisaka, "Speech synthesis by rule using an optimal selection of non-uniform synthesis units," in Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing, New York, NY, pp. 679-682, 1988.
29. R. Kobayashi, "Sound clustering synthesis using spectral data," in Proc. Int. Computer Music Conf., Singapore, 2003.
30. G. Beller, Gregory, D. Schwarz, T. Hueber, and X. Rodet, "A hybrid concate-native synthesis system on the intersection of music and speech," in Journees d'Informatique Musicale (JIM), St. Denis, France: MSH Paris Nord, 2005.
31. J. Bonada and X. Serra, "Synthesis of the singing voice by performance sampling and spectral models," IEEE Signal Processing Mag., vol. 24, no. 2, 67-79, Mar. 2007.
32. D. Schwarz, "Corpus-based concatenative synthesis," IEEE Signal Processing Mag., vol. 24, no. 2, 92-104, Mar. 2007.
33. D. Schwarz, "A system for data-driven concatenative sound synthesis," in Proc. COST-G6 Conf. Digital Audio Effects (DAFx), Verona, Italy, pp. 97-102, Dec. 2, 2000.
34. M. Puckette, "Low-dimensional parameter mapping using spectral envelopes," in Proc. Int. Computer Music Conf., Miami, Florida. Nov. 2004.
35. J. Bonada, O. Celma, A. Loscos, J. Ortol, and X. Serra, "Singing voice synthesis combining excitation plus resonance and sinusoidal plus residual models," in Proc. ICMC, Havana, Cuba, 2001.
36. E. Lindemann, "Encoding and synthesis of tonal audio signals using dominant sinusoids and a vector quantized residual tonal signal," U.S. Patent 6298322, May 6, 1999.
37. E. Lindemann, "Music synthesizer capable of expressive phrasing," U.S. Patent 6316710, Sept. 27, 1999.
38. E. Lindemann, "Audio signal synthesis system based on probabilistic estimation of time-varying spectra," U.S. Patent 6111183, Sept. 7, 1999.
39. S. Haykin, Neural Networks, A Comprehensive Foundation. New York: Macmillan, 1994.
40. V.N. Vapnik, The Nature of Statistical Learning Theory. New York: Springer, 2000.
41. M. Clynes, "SuperConductor - The Global Music Interpretation and Performance Program." Available: www.superconductor.com.
42. R. Bresin and A. Friberg, "Emotional coloring of computer-controlled music performances," Computer Music J., vol. 24, no. 4, pp. 44-63, 2000.
43. A. Friberg, "pDM: An expressive sequencer with real-time control of the KTH music performance rules," Computer Music J., vol. 30, no. 1, pp. 37-48, 2006.
44. M. Laurson, V. Norilo, and M. Kuuskankare, "PWGLSynth: A visual synthesis language for virtual instrument design and control," Computer Music J., vol. 29, no. 3, pp. 29-41, 2005.
45. N. Cristianini and J. Shawe-Taylor, Vector Support Machines. Cambridge, U.K.: Cambridge Univ. Press, 2000.
46. A. Gersho and R.M. Gray, Vector Quantization and Signal Compression. Norwell, MA: Kluwer, 1992.