Toward synthesized environments: A survey of analysis and synthesis methods for sound designers and composers

Proceedings of the 2009 International Computer Music Conference, ICMC 2009

Volumn , Issue , 2009, Pages 155-162

  Misra, Ananya ^a   Cook, Perry R ^a,b  

^a Princeton University   (United States)

^b PRINCETON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER MUSIC; SURVEYS;

ANALYSIS AND SYNTHESIS; DIGITAL AUDIO; REAL-WORLD; SOUND DESIGNS; SOURCE MATERIAL;

AUDIO ACOUSTICS;

EID: 84872714035     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (99)

1. "SuperCollider 3 Plugins," [Software] http://sourceforge.net/projects/sc3-plugins/, retrieved 4 February 2009.
2. X. Amatriain and P. Arumi, "Developing crossplatform audio and music applications with the CLAM framework," in Proc. ICMC, 2005.
3. D. Arfib, "Digital synthesis of complex spectra by means of multiplication of non-linear distorted sine waves," J. Audio Eng. Soc., vol. 27, no. 10, pp. 757-779, 1979.
4. B. S. Atal, "Speech analysis and synthesis by linear prediction of the speech wave," J. Acoust. Soc. Am., vol. 47, no. 65(A), 1970.
5. M. Athineos and D. P. W. Ellis, "Sound texture modeling with linear prediction in both time and frequency domains," in Proc. IEEE ICASSP, vol. 5, 2003, pp. 648-651.
6. J. P. Bello, L. Daudet, S. Abdallah, C. Duxbury, M. Davies, and M. B. Sandler, "A tutorial on onset detection in music signals," IEEE T. Speech Audio Proc., vol. 13, no. 5, 2005.
7. J. R. Beltrán and F. Beltrán, "Additive synthesis based on the continuous wavelet transform: A sinusoidal plus transient model," in Proc. DAFx, 2003.
8. O. Ben-Tal, J. Berger, B. Cook, M. Daniels, G. P. Scavone, and P. R. Cook, "SonART: The Sonification Application Research Toolbox," in Proc. Int. Conf. Audit. Disp., 2002.
9. D. Birchfield, N. Mattar, and H. Sundaram, "Design of a generative model for soundscape creation," in Proc. ICMC, 2005.
10. N. Bogaards, A. Robel, and X. Rodet, "Sound analysis and processing with AudioSculpt 2," in Proc. ICMC, 2004.
11. G. J. Brown and M. Cooke, "Computational auditory scene analysis," Comput. Speech Lang., vol. 8, no. 4, pp. 297-336, 1994.
12. J.-F. Cardoso, "Blind signal separation: Statistical principles," Proc. IEEE, vol. 86, no. 10, pp. 2009-2025, 1998.
13. M. A. Casey, R. Veltcamp, M. Goto, M. Leman, C. Rhodes, and M. Slaney, "Content-based music information retrieval: Current directions and future challenges," Proc. IEEE, vol. 96, no. 4, pp. 668-696, 2008.
14. J. Chowning, "The synthesis of complex audio spectra by means of frequency modulation," J. Audio Eng. Soc., vol. 21, no. 7, pp. 526-534, 1973.
15. J. Chowning, "Frequency modulation synthesis of the singing voice," in Current Directions in Computer Music Research, M. Mathews and J. Pierce, Eds. Cambridge, MA: The MIT Press, 1989, pp. 57-64.
16. N. Collins, "Errant sound synthesis," in Proc. ICMC, 2008.
17. P. R. Cook, "SPASM: A real-time vocal tract physical model editor/controller and Singer: the companion software synthesis system," Comput. Music J., vol. 20, no. 3, pp. 38-46, 1992.
18. P. R. Cook, "Physically informed sonic modeling (PhISM): Percussive synthesis," in Proc. ICMC, 1996.
19. P. R. Cook, "Singing voice synthesis: History, current work, and future directions," Comput. Music J., vol. 20, no. 3, pp. 38-46, 1996.
20. P. R. Cook, "Physically informed sonic modeling (PhISM): Synthesis of percussive sounds," Comput. Music J., vol. 21, no. 3, pp. 38-49, 1997.
21. P. R. Cook, "Modeling BILL'S GAIT: Analysis and parametric synthesis of walking sounds," in Proc. Audio Eng. Soc. Conf. Virt. Synthet. Ent. Audio, 2002.
22. P. R. Cook, Real Sound Synthesis for Interactive Applications. Wellesley, MA: AK Peters, 2002.
23. P. R. Cook and G. P. Scavone, "The Synthesis ToolKit (STK)," in Proc. ICMC, 1999.
24. R. Dannenberg, "Abstract time warping of compound events and signals," Comput. Music J., vol. 21, no. 3, pp. 61-70, 1997.
25. J. Dattoro, "Effect design: Part 3 oscillators: Sinusoidal and pseudonoise," J. Audio Eng. Soc., vol. 50, no. 3, pp. 115-146, 2002.
26. A. DiScipio, "Composition by exploration of nonlinear dynamic systems," in Proc. ICMC, no. 324-327, 1990.
27. M. B. Dolson, "The phase vocoder: A tutorial," Comput. Music J., vol. 10, no. 4, pp. 14-27, 1986.
28. S. Dubnov, Z. Bar-Joseph, R. El-Yaniv, D. Lischinski, and M. Werman, "Synthesizing sound textures through wavelet tree learning," IEEE Comput. Graph. App., vol. 22, no. 4, 2002.
29. H. Dudley, "The vocoder," Bell Lab. Records, 1939.
30. D. P. W. Ellis, "A computer implementation of psychoacoustic grouping rules," in Proc. Int. Conf. Pattern Recog., 1994.
31. D. P. W. Ellis and B. L. Vercoe, "A perceptual representation of sound for auditory signal separation," in Proc. 123rd meeting Acoust. Soc. Am., 1992.
32. G. Essl, "Mathematical structure and sound synthesis," in Proc. Sound Music Computing Conf., 2005.
33. G. Essl, "Circle maps as simple oscillators for complex behavior: I. Basics," in Proc. ICMC, 2006.
34. G. Essl, "Circle maps as simple oscillators for complex behaviors: II. Experiments," in Proc. DAFx, 2006.
35. G. Essl, S. Serafin, P. R. Cook, and J. O. Smith III, "Theory of banded waveguides," Comput. Music J., vol. 28, no. 1, pp. 37-50, 2004.
36. A. Farnell, Designing Sound. Applied Scientific Press, 2009, retrieved 7 February 2009 from [Online] http://aspress.co.uk/ds/bookInfo.html.
37. C. Fevotte and S. J. Godsill, "A Bayesian approach for blind separation of sparse sources," IEEE T. Audio Speech Lang. Proc., vol. 14, no. 6, pp. 2174-2188, 2006.
38. K. Fitz and L. Haken, "Sinusoidal modeling and manipulation using Lemur," Comput. Music J., vol. 20, no. 4, 1996.
39. F. Fontana and D. Rocchesso, "Physical modeling of membranes for percussion instruments," Acustica, vol. 84, no. 3, pp. 529-542, 1998.
40. M. Fröjd and A. Horner, "Fast sound texture synthesis using overlap-add," in Proc. ICMC, 2007.
41. S. W. Hainsworth, "Techniques for the automated analysis of musical audio," Ph.D. dissertation, University of Cambridge, UK, 2003.
42. L. Hiller and P. Ruiz, "Synthesizing musical sounds by solving the wave equation for vibrating objects," J. Audio Eng. Soc., vol. 19, pp. 462-472, 1971.
43. M. Hoffman and P. R. Cook, "Feature-based synthesis: Mapping from acoustic and perceptual features to synthesis parameters," in Proc. ICMC, 2006.
44. R. Hoskinson and D. K. Pai, "Manipulation and resynthesis with natural grains," in Proc. ICMC, 2001.
45. D. Jaffe and J. O. Smith III, "Extensions of the Karplus-Strong plucked-string algorithm," Comput. Music J., vol. 7, no. 2, pp. 56-69, 1983.
46. K. Karplus and A. Strong, "Digital synthesis of plucked-string and drum timbres," Comput. Music J., vol. 7, no. 2, pp. 43-55, 1983.
47. A. Klapuri, "Signal processing methods for the automatic transcription of music," Ph.D. dissertation, Tampere University of Technology, Finnland, 2004.
48. M. Klingbeil, "Software for spectral analysis, editing, and synthesis," in Proc. ICMC, 2005.
49. G. Kramer, Ed., Auditory Display: Sonification, Audification, and Auditory Interfaces, ser. Santa Fe Institute Studies in the Sciences of Complexity Proc. Vol. 17. Reading, MA: Addison-Wesley, 1994.
50. P. Lansky, "Compositional applications of linear predictive coding," in Current Directions in Computer Music Research, M. Mathews and J. Pierce, Eds. Cambridge, MA: MIT Press, 1989, pp. 5-8.
51. A. Lazier and P. R. Cook, "MOSIEVIUS: Featuredriven interactive audio mosaicing," in Proc. DAFx, 2003.
52. M. LeBrun, "Digital waveshaping synthesis," J. Audio Eng. Soc., vol. 27, no. 4, pp. 250-266, 1979.
53. S. N. Levine and J. O. Smith III, "A sines+transients+noise audio representation for data compression and time/pitch scale modifications," in Audio Eng. Soc. Conv., 1998.
54. J. Makhoul, "Linear prediction: A tutorial review," in Proc. IEEE, vol. 63, 1975, pp. 561-580.
55. J. A. Maurer, "The influence of chaos on computer-generated music," [Online] http: //ccrma-www.stanford.edu/_blackrse/chaos.html, 1999, retrieved 27 January 2009.
56. R. McAulay and T. Quatieri, "Speech analysis/ synthesis based on a sinusoidal representation," IEEE T. Acoust. Speech Sig. Proc., vol. 34, no. 4, pp. 744-754, 1986.
57. K. Melih and R. Gonzalez, "Source segmentation for structured audio," in IEEE Int. Conf. Multim. Expo (II), 2000, pp. 811-814.
58. N. E. Miner and T. P. Caudell, "A wavelet synthesis technique for creating realistic virtual environment sounds," Presence, vol. 11, no. 5, pp. 493-507, 2002.
59. A. Misra, G. Wang, and P. R. Cook, "Musical tapestries: Re-composing natural sounds," J. New Music Res., vol. 36, no. 4, 2007.
60. J. F. O'Brien, P. R. Cook, and G. Essl, "Synthesizing sounds from physically based motion," in Proc. ACM SIGGRAPH, 2001, pp. 529-536.
61. T. H. Park, "Towards automatic musical instrument timbre recognition," Ph.D. dissertation, Princeton University, NJ, 2004.
62. S. Pauletto and A. Hunt, "A toolkit for interactive sonification," in Proc. Int. Conf. Audit. Disp., 2004.
63. J. R. Pierce and S. A. Van Duyne, "A passive nonlinear digital filter design which facilitates physics-based sound synthesis of highly nonlinear musical instruments," J. Acoust. Soc. Am., vol. 101, no. 2, pp. 1120-1126, 1997.
64. S. T. Pope, "A taxonomy of computer music," Contemp. Music Rev., vol. 13, no. 2, pp. 137-145, 1996.
65. Y. Qi, T. P. Minka, and R. W. Picard, "Bayesian spectrum estimation of unevenly sampled nonstationary data," in Proc. IEEE ICASSP, 2002.
66. T. Quatieri and R. McAulay, "Speech transformations based on a sinusoidal representation," IEEE T. Acoust. Speech Sig. Proc., vol. 34, no. 6, pp. 1449-1464, 1986.
67. J.-C. Risset, "Computer music experiments, 1964" Comput. Music J., vol. 9, pp. 11-18, 1985.
68. D. Rocchesso, "Physically-based sounding objects, as we develop them today," J. New Music Res., vol. 33, no. 3, pp. 305-313, 2004.
69. X. Rodet, "Time-domain formant-wave-function synthesis," Comput. Music J., vol. 8, no. 3, pp. 9-14, 1984.
70. D. Schwarz, "Concatenative sound synthesis: The early years," J. New Music Res., vol. 35, no. 1, pp. 3-22, 2006.
71. D. Schwarz, "Corpus-based concatenative synthesis," IEEE Sig. Proc. Mag., pp. 92-104, 2007.
72. X. Serra, "A system for sound analysis / transformation / synthesis based on a deterministic plus stochastic decomposition," Ph.D. dissertation, Stanford University, 1989.
73. J. O. Smith III, "Efficient simulation of the reed-bore and bow-string mechanisms," in Proc. ICMC, 1986, pp. 275-280.
74. J. O. Smith III, "Musical applications of digital waveguides," Center for Computer Research in Music and Acoustics, Music Department, Stanford University, Tech. Rep. STAN-M-39, 1987.
75. J. O. Smith III, "Waveguide filter tutorial," in Proc. ICMC, 1987, pp. 9-16.
76. J. O. Smith III, "Viewpoints on the History of Digital Synthesis (keynote paper)," in Proc. ICMC, 1991.
77. J. O. Smith III, "Waveguide simulation of non-cylindrical acoustic tubes," in Proc. ICMC, 1991, pp. 304-307.
78. J. O. Smith III and P. R. Cook, "The second-order digital waveguide oscillator," in Proc. ICMC, 1992.
79. K. Steiglitz and P. Lansky, "Synthesis of timbral families by warped linear prediction," Comput. Music J., vol. 5, no. 3, pp. 45-49, 1981.
80. D. Stowell and M. Plumbley, "Adaptive whitening for improved real-time audio onset detection," in Proc. ICMC, 2007.
81. G. Strobl and E. Gerhard, "Sound texture modeling: A survey," in Proc. Sound Music Computing Conf., 2006.
82. B. L. Sturm, C. Roads, A. McLeran, and J. J. Shynk, "Analysis, visualization, and transformation of audio signals using dictionary-based methods," in Proc. ICMC, 2008.
83. T. Takala and J. Hahn, "Sound rendering," in Proc. ACM SIGGRAPH, 1992, pp. 211-220.
84. T. Tolonen, V. Välimäki, and M. Karjalainen, "Evaluation of modern sound synthesis methods," Laboratory of Acoustics and Audio Signal Processing, Helsinki University of Technology, Espoo, Finland, Tech. Rep. 48, 1998.
85. B. Truax, "Chaotic non-linear systems and digital synthesis: An exploratory study," in Proc. ICMC, 1990, pp. 100-103.
86. B. Truax, "Composing with real-time granular sound," Persp. New Music, vol. 28, no. 2, 1990.
87. D. Trueman and R. L. DuBois, "PeRColate: A collection of synthesis, signal processing, and image processing objects for Max/MSP," [Software] http://www. music.columbia.edu/PeRColate/, retrieved 4 February 2009.
88. G. Tzanetakis and P. R. Cook, "MARSYAS: A framework for audio analysis," Org. Sound, vol. 4, no. 3, 2000.
89. G. Tzanetakis and P. R. Cook, "Musical genre classification of audio signals," IEEE T. Speech Audio Proc., vol. 10, no. 5, pp. 293-302, 2002.
90. K. van den Doel, P. G. Kry, and D. K. Pai, "FOLEYAUTOMATIC: Physically-based sound effects for interactive simulation and animation," in Proc. ACM SIGGRAPH, 2001.
91. S. A. Van Duyne and J. O. Smith III, "The 2-D digital waveguide mesh," in IEEE Workshop App. Sig. Proc. Audio Acoust., 1993.
92. S. A. Van Duyne and J. O. Smith III, "The 3D tetrahedral digital waveguide mesh with musical applications," in Proc. ICMC, 1996.
93. B. L. Vercoe, W. G. Gardner, and E. D. Scheirer, "Structured audio: Creation, transmission, and rendering of parametric sound representations," in Proc. IEEE, vol. 86, no. 5, 1998, pp. 922-940.
94. T. S. Verma and T. H. Meng, "An analysis/synthesis tool for transient signals that allows a flexible sines+transients+noise model for audio," in Proc. IEEE ICASSP, 1998, pp. 12-15.
95. G. Wang and P. R. Cook, "ChucK: A concurrent, onthe- fly, audio programming language," in Proc. ICMC, 2003, pp. 219-226.
96. G. Widmer, D. Rocchesso, V. Välimäki, C. Erkut, F. Gouyon, D. Pressnitzer, H. Penttinen, P. Polotti, and G. Volpe, "Sound and music computing: Research trends and some key issues," J. New Music Res., vol. 36, no. 3, pp. 169-184, 2007.
97. M. Wright, A. Chaudhary, A. Freed, S. Khoury, and D. Wessel, "Audio applications of the Sound Description Interchange Format standard," in Audio Eng. Soc. Conv., 1999.
98. W. S. Yeo and J. Berger, "Application of image sonification methods to music," in Proc. ICMC, 2005.
99. X. Zhu and L. Wyse, "Sound texture modeling and time-frequency LPC," in Proc. DAFx, 2004, pp. 345-349.