State of the art in sound texture synthesis

Proceedings of the International Conference on Digital Audio Effects, DAFx

Volumn , Issue , 2011, Pages 221-232

  Schwarz, Diemo ^a  

^a SORBONNE UNIVERSITÉ   (France)

Author keywords

[No Author keywords available]

Indexed keywords

ADDITIVE SYNTHESIS; AUTOMATIC METHOD; CORPUS-BASED; GRANULAR SYNTHESIS; SOFTWARE IMPLEMENTATION; STATE OF THE ART; SUBTRACTIVE SYNTHESIS; SYNTHESIS MODELS; TEXTURE SYNTHESIS; WAVELET MODELING;

COMPUTER MUSIC;

EID: 84871388729     PISSN: 24136700     EISSN: 24136689     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (94)

1. W. Ahmad, H. Hacihabiboglu, and A.M. Kondoz. Analysis-Synthesis Model for Transient Impact Sounds by Stationary Wavelet Transform and Singular Value Decomposition. In Proceedings of the International Computer Music Conference (ICMC), 2008.
2. X Anguera and J Hernando. Xbic: Real-time cross probabilities measure for speaker segmentation, 2005.
3. D. Arfib. Gestural strategies for specific filtering processes. Proceedings of the COST-G6 Conference on Digital Audio Effects (DAFx), 2002. URL http://www2.hsuhh.de/EWEB/ANT/dafx2002/papers/DAFX02-Arfib-Couturier-Kessous- gestural-stategies.pdf.
4. M. Athineos and D.P.W. Ellis. Sound texture modelling with linear prediction in both time and frequency domains. Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 5:V-648-51 vol.5, April 2003. ISSN 1520-6149.
5. C Bascou. Modélisation de sons bruités par la synthese granulaire. Rapport de stage de DEA ATIAM, Université Aix-Marseille II, 2004.
6. C. Bascou and L. Pottier. New sound decomposition method applied to granular synthesis. In Proceedings of the International Computer Music Conference (ICMC), Barcelona, Spain, 2005.
7. C. Bascou and L. Pottier. GMU, a flexible granular synthesis environment in Max/MSP. In Proceedings of the International Conference on Sound and Music Computing (SMC), 2005.
8. D. Birchfield, N. Mattar, and H. Sundaram. Design of a generative model for soundscape creation. In Proceedings of the International Computer Music Conference (ICMC), Barcelona, Spain, 2005.
9. D. Birchfield, N. Mattar, H. Sundaram, A. Mani, and B. Shevade. Generative Soundscapes for Experiential Communication. Society for Electro Acoustic Music in the United States (SEAMUS), 2005.
10. P. Cano, L. Fabig, F. Gouyon, M. Koppenberger, A. Loscos, and A. Barbosa. Semi-automatic ambiance generation. In Proceedings of the COST-G6 Conference on Digital Audio Effects (DAFx), Naples, Italy, 2004.
11. Marc Cardle. Automated Sound Editing. Technical report, Computer Laboratory, University of Cambridge, UK, May 2004. URL http://www.cl.cam.ac.uk/ users/mpc33/Cardle-Sound-Synthesis-techreport-2004-low-quality.pdf.
12. P Cook. Physically informed sonic modeling (PhISM): Percussive synthesis. Proceedings of the International Computer Music Conference (ICMC), 1996. URL http://scholar.google.com/scholar?hl=en&q=cook+phism&bav=on.2,or.r-gc. r-pw.&biw=1584&bih=783&um=1&ie=UTF-8&sa=N&tab=ws#3.
13. PR Cook. Physically informed sonic modeling (phism): Synthesis of percussive sounds. Computer Music Journal, 1997. URL http://www.jstor.org/ stable/3681012.
14. P.R. Cook. Din of an"iquity": Analysis and synthesis of environmental sounds. In Proceedings of the International Conference on Auditory Display (ICAD2007), pages 167-172, 2007.
15. Richard Corbett, Kees van den Doel, John E. Lloyd, and Wolfgang Heidrich. Timbrefields: 3d interactive sound models for real-time audio. Presence: Teleoperators and Virtual Environments, 16(6):643-654, 2007. doi: 10.1162/pres.16. 6.643. URL http://www.mitpressjournals.org/doi/abs/10.1162/ pres.16.6.643.
16. M. Desainte-Catherine and P. Hanna. Statistical approach for sound modeling. In Proceedings of the COST-G6 Conference on Digital Audio Effects (DAFx), 2000.
17. A. Di Scipio. Synthesis of environmental sound textures by iterated nonlinear functions. In Proceedings of the COST-G6 Conference on Digital Audio Effects (DAFx), 1999.
18. Yoshinori Dobashi, Tsuyoshi Yamamoto, and Tomoyuki Nishita. Real-time rendering of aerodynamic sound using sound textures based on computational fluid dynamics. ACM Trans. Graph., 22:732-740, July 2003. ISSN 0730-0301. doi: http://doi.acm.org/10.1145/882262.882339. URL http://doi.acm.org/10.1145/882262. 882339.
19. Yoshinori Dobashi, Tsuyoshi Yamamoto, and Tomoyuki Nishita. Synthesizing sound from turbulent field using sound textures for interactive fluid simulation. In Proc. of Eurographics, pages 539-546, 2004.
20. Kees van den Doel. Physically based models for liquid sounds. ACM Trans. Appl. Percept., 2:534-546, October 2005. ISSN 1544-3558. doi: http://doi.acm.org/10.1145/1101530.1101554. URL http://doi.acm.org/10.1145/ 1101530.1101554.
21. S. Dubnov and N. Tishby. Analysis of sound textures in musical and machine sounds by means of higher order statistical features. In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), volume 5, pages 3845-3848. IEEE, 1997. ISBN 0818679190. URL http://ieeexplore.ieee.org/xpls/abs-all.jsp?arnumber=604726.
22. Shlomo Dubnov, Ziz Bar-Joseph, Ran El-Yaniv, Danny Lischinski, and Michael Werman. Synthesis of audio sound textures by learning and resampling of wavelet trees. IEEE Computer Graphics and Applications, 22(4):38-48, 2002.
23. A.A. Efros and T.K. Leung. Texture synthesis by nonparametric sampling. In Proceedings of the International Conference on Computer Vision, volume 2, page 1033, 1999.
24. Aaron Einbond, Diemo Schwarz, and Jean Bresson. Corpusbased transcription as an approach to the compositional control of timbre. In Proceedings of the International Computer Music Conference (ICMC), Montreal, QC, Canada, 2009.
25. R. El-Yaniv, S. Fine, and N. Tishby. Agnostic classification of Markovian sequences. In Proceedings of the 1997 conference on Advances in neural information processing systems 10, pages 465-471. MIT Press, 1998. ISBN 0262100762.
26. Z.B.J.R. El-Yaniv, D.L.M. Werman, and S. Dubnov. Granular Synthesis of Sound Textures using Statistical Learning. In Proceedings of the International Computer Music Conference (ICMC), 1999.
27. D.P.W. Ellis, X. Zeng, and J.H. McDermott. Classifying soundtracks with audio texture features. Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2010. URL http://www.ee.columbia.edu/~{}dpwe/pubs/EllisZM11-texture.pdf.
28. G. Essl and S. O'Modhrain. Scrubber: an interface for friction-induced sounds. In Proceedings of the Conference for New Interfaces for Musical Expression (NIME), page 75. National University of Singapore, 2005.
29. G. Fan and X.G. Xia. Wavelet-based texture analysis and synthesis using hidden Markov models. IEEE Transactions on Circuits and Systems - I: Fundamental Theory and Applications, 50(1), 2003.
30. Andy Farnell. Designing Sound. MIT Press, October 2010. ISBN 9780262014410. URL http://mitpress.mit.edu/catalog/item/default.asp?ttype= 2&tid=12282.
31. J.J. Filatriau and D. Arfib. Instrumental gestures and sonic textures. In Proceedings of the International Conference on Sound and Music Computing (SMC), 2005.
32. J.J. Filatriau, D. Arfib, and JM Couturier. Using visual textures for sonic textures production and control. In Proceedings of the COST-G6 Conference on Digital Audio Effects (DAFx), 2006.
33. N. Finney. Autonomous generation of soundscapes using unstructured sound databases. Master's thesis, MTG, IUA-UPF, Barcelona, Spain, 2009. URL static/media/Finney-Nathan-Master-Thesis-2009.pdf.
34. N. Finney and J. Janer. Soundscape Generation for Virtual Environments using Community-Provided Audio Databases. In W3C Workshop: Augmented Reality on the Web, June 15-16, 2010 Barcelona, 2010. URL http://citeseerx.ist.psu.edu/ viewdoc/download?doi=10.1.1.168.4252&rep=rep1&type=pdfhttp://www.w3.org/ 2010/06/w3car/.
35. M. Fröjd and A. Horner. Sound texture synthesis using an overlap-add/granular synthesis approach. Journal of the Audio Engineering Society, 57(1/2):29-37, 2009. URL http://www.aes.org/e-lib/browse.cfm?elib= 14805.
36. WW Gaver. How do we hear in the world? Explorations in ecological acoustics. Ecological psychology, 1993.
37. T. Grill. Re-texturing the sonic environment. In Proceedings of the 5th Audio Mostly Conference: A Conference on Interaction with Sound, pages 1-7. ACM, 2010. URL http://portal.acm.org/citation.cfm?id=1859805.
38. S. Guidati and Head Acoustics GmbH. Auralisation and psychoacoustic evaluation of traffic noise scenarios. Journal of the Acoustical Society of America, 123(5):3027, 2008.
39. P. Hanna. Statistical modelling of noisy sounds : spectral density, analysis, musical transformtions and synthesis. PhD thesis, Laboratoire de Recherche en Informatique de Bordeaux (LaBRI), 2003. URL http://dept-info.labri. fr/~hanna/phd.html.
40. P. Hanna, N. Louis, M. Desainte-Catherine, and J. Benois- Pineau. Audio features for noisy sound segmentation. In Proceedings of the 5th International Symposium on Music Information Retrieval (ISMIR'04), pages 120-123, 2004.
41. Pierre Hanna and Myriam Desainte-Catherine. A Statistical and Spectral Model for Representing Noisy Sounds with Short-Time Sinusoids. EURASIP Journal on Advances in Signal Processing, 2005(12):1794-1806, 2005. ISSN 1687-6172. doi: 10.1155/ASP.2005.1794. URL http://www.hindawi.com/journals/asp/2005/182056.abs. html.
42. R. Hoskinson. Manipulation and Resynthesis of Environmental Sounds with Natural Wavelet Grains. PhD thesis, The University of British Columbia, 2002. URL https://www.cs.ubc.ca/grads/resources/thesis/May02/Reynald-Hoskinson.pdf.
43. Reynald Hoskinson and Dinesh Pai. Manipulation and resynthesis with natural grains. In Proceedings of the International Computer Music Conference (ICMC), pages 338-341, Havana, Cuba, September 2001.
44. I. Kauppinen and K. Roth. An Adaptive Technique for Modeling Audio Signals. In Proceedings of the COST-G6 Conference on Digital Audio Effects (DAFx), 2001.
45. Stefan Kersten and Hendrik Purwins. Sound texture synthesis with hidden markov tree models in the wavelet domain. In Proceedings of the International Conference on Sound and Music Computing (SMC), Barcelona, Spain, July 2010.
46. Anil Kokaram and Deirdre O'Regan. Wavelet based high resolution sound texture synthesis. In Proceedings of the Audio Engineering Society Conference, 6 2007. URL http://www.aes.org/e-lib/browse.cfm?elib=13952.
47. M. Lagrange, B.L. Giordano, P. Depalle, and S. McAdams. Objective quality measurement of the excitation of impact sounds in a source/filter model. Acoustical Society of America Journal, 123:3746, 2008.
48. Jung Suk Lee, Philippe Depalle, and Gary Scavone. Analysis / synthesis of rolling sounds using a source filter approach. In Proceedings of the COST-G6 Conference on Digital Audio Effects (DAFx), Graz, Austria, September 2010.
49. L. Lu, S. Li, L.Wen-yin, H.J. Zhang, and Y. Mao. Audio textures. In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), volume 2, 2002. URL http://citeseerx.ist.psu.edu/ viewdoc/download?doi=10.1.1.2.4586&rep=rep1&type=pdf.
50. L. Lu, L. Wenyin, and H.J. Zhang. Audio textures: Theory and applications. IEEE Transactions on Speech and Audio Processing, 12(2):156-167, 2004. ISSN 1063-6676. URL http://ieeexplore.ieee.org/xpls/abs-all.jsp?arnumber= 1284343.
51. A. Mallock. Sounds produced by drops falling on water. Proc. R. Soc., 95:138-143, 1919.
52. Aymeric Masurelle. Gestural control of environmental texture synthesis. Rapport de stage de DEA ATIAM, Ircam-Centre Pompidou, Université Paris VI, 2011.
53. J.H. McDermott, A.J. Oxenham, and E.P. Simoncelli. Sound texture synthesis via filter statistics. In IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA), New Paltz, NY, October 18-21 2009.
54. Dylan Menzies. Phya and vfoley, physically motivated audio for virtual environments. Proceedings of the Audio Engineering Society Conference, 2010. URL http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.149.9848&rep= rep1&type=pdf.
55. Dylan Menzies. Physically Motivated Environmental Sound Synthesis for Virtual Worlds. EURASIP Journal on Audio, Speech, and Music Processing, 2011. URL http://www.hindawi.com/journals/asmp/2010/137878.html.
56. Nadine E. Miner and Thomas P. Caudell. Using wavelets to synthesize stochastic-based sounds for immersive virtual environments. ACM Trans. Appl. Percept., 2:521-528, October 2005. ISSN 1544-3558. doi: http://doi.acm.org/10. 1145/1101530.1101552. URL http://doi.acm.org/10.1145/1101530.1101552.
57. Nicolas Misdariis, Antoine Minard, Patrick Susini, Guillaume Lemaitre, Stephen McAdams, and Etienne Parizet. Environmental sound perception: Metadescription and modeling based on independent primary studies. EURASIP Journal on Audio, Speech, and Music Processing, 2010. URL http://articles.ircam. fr/textes/Misdariis10b/.
58. A. Misra and P.R. Cook. Toward synthesized environments: A survey of analysis and synthesis methods for sound designers and composers. In Proceedings of the International Computer Music Conference (ICMC), 2009.
59. A. Misra, P.R. Cook, and G. Wang. A new paradigm for sound design. In Proceedings of the COST-G6 Conference on Digital Audio Effects (DAFx), 2006.
60. A. Misra, P.R. Cook, and G. Wang. Tapestrea: Sound scene modeling by example. In ACM SIGGRAPH 2006 Sketches, page 177. ACM, 2006. ISBN 1595933646.
61. A. Misra, G. Wang, and P. Cook. Musical Tapestry: Recomposing Natural Sounds†. Journal of New Music Research, 36(4):241-250, 2007. ISSN 0929-8215.
62. William Moss, Hengchin (Yero) Yeh, Jeong-Mo Hong, Ming C. Lin, and Dinesh Manocha. Sounding Liquids: Automatic Sound Synthesis from Fluid Simulation. ACM Transactions on Graphics, 28(4):1-12, August 2009. ISSN 07300301. doi: 10.1145/1559755.1559763. URL http://portal.acm.org/citation.cfm?doid=1559755. 1559763.
63. E. Murphy, M. Lagrange, G. Scavone, P. Depalle, and C. Guastavino. Perceptual Evaluation of a Real-time Synthesis Technique for Rolling Sounds. In Conference on Enactive Interfaces, Pisa, Italy, 2008.
64. J.F. O'Brien, C. Shen, and C.M. Gatchalian. Synthesizing sounds from rigid-body simulations. In Proceedings of the 2002 ACM SIGGRAPH/Eurographics symposium on Computer animation, pages 175-181. ACM New York, NY, USA, 2002.
65. S. O'Modhrain and G. Essl. PebbleBox and CrumbleBag: tactile interfaces for granular synthesis. In Proceedings of the Conference for New Interfaces for Musical Expression (NIME), page 79. National University of Singapore, 2004.
66. D. O'Regan and A. Kokaram. Multi-resolution sound texture synthesis using the dual-tree complex wavelet transform. In Proc. 2007 European Signal Processing Conference (EUSIPCO), 2007. URL http://www.eurasip.org/Proceedings/ Eusipco/Eusipco2007/Papers/A3L-B03.pdf.
67. J.R. Parker and B. Behm. Creating audio textures by example: tiling and stitching. Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 4:iv-317-iv-320 vol.4, May 2004. ISSN 1520-6149. doi: 10.1109/ICASSP.2004.1326827.
68. Geoffroy Peeters. A large set of audio features for sound description (similarity and classification) in the Cuidado project. Technical Report version 1.0, Ircam - Centre Pompidou, Paris, France, April 2004. URL http://www.ircam.fr/anasyn/peeters/ARTICLES/Peeters-2003-cuidadoaudiofeatures. pdf.
69. Leevi Peltola, Cumhur Erkut, P.R. Cook, and Vesa Valimaki. Synthesis of hand clapping sounds. Audio, Speech, and Language Processing, IEEE Transactions on, 15(3):1021-1029, March 2007. ISSN 1558-7916. doi: 10.1109/TASL. 2006.885924. URL http://ieeexplore.ieee.org/xpls/abs-all.jsp?arnumber=4100694.
70. Gabriel Peyré. Oriented patterns synthesis. Technical report, Unité Mixte de Recherche du C.N.R.S. No. 7534, 2007. URL http://www.ceremade.dauphine.fr/preprints/consult/cmd-by-years.php.
71. Cecile Picard, Nicolas Tsingos, and François Faure. Retargetting Example Sounds to Interactive Physics-Driven Animations. In AES 35th International Conference, Audio in Games, London, UK, 2009.
72. K. Popat and R. W. Picard. Cluster-based probability model and its application to image and texture processing. IEEE transactions on image processing : a publication of the IEEE Signal Processing Society, 6(2):268-84, January 1997. ISSN 1057-7149. doi: 10.1109/83.551697. URL http://ieeexplore. ieee.org/xpls/abs-all.jsp?arnumber=551697.
73. Xavier Rodet and Phillipe Depalle. A new additive synthesis method using inverse Fourier transform and spectral envelopes. In Proceedings of the International Computer Music Conference (ICMC), October 1992.
74. Nicolas Saint-Arnaud. Classification of Sound Textures. PhD thesis, Universite Laval, Quebec, MIT, 1995.
75. Nicolas Saint-Arnaud and Kris Popat. Analysis and synthesis of sound textures. In in Readings in Computational Auditory Scene Analysis, pages 125-131, 1995.
76. R. Murray Schafer. The Soundscape. Destiny Books, 1993. ISBN 0892814551. URL http://www.amazon.com/Soundscape-R-Murray-Schafer/dp/0892814551.
77. Diemo Schwarz. Data-Driven Concatenative Sound Synthesis. Thèse de doctorat, Université Paris 6 - Pierre et Marie Curie, Paris, 2004. URL http://mediatheque.ircam.fr/articles/textes/Schwarz04a.
78. Diemo Schwarz. Concatenative sound synthesis: The early years. Journal of New Music Research, 35(1):3-22, March 2006. Special Issue on Audio Mosaicing.
79. Diemo Schwarz. Corpus-based concatenative synthesis. IEEE Signal Processing Magazine, 24(2):92-104, March 2007. Special Section: Signal Processing for Sound Synthesis.
80. Diemo Schwarz and Norbert Schnell. Descriptor-based sound texture sampling. In Proceedings of the International Conference on Sound and Music Computing (SMC), pages 510-515, Barcelona, Spain, July 2010.
81. Diemo Schwarz and Norbert Schnell. A modular sound descriptor analysis framework for relaxed-real-time applications. In Proc. ICMC, New York, NY, 2010.
82. Diemo Schwarz, Grégory Beller, Bruno Verbrugghe, and Sam Britton. Real-Time Corpus-Based Concatenative Synthesis with CataRT. In Proceedings of the COST-G6 Conference on Digital Audio Effects (DAFx), pages 279-282, Montreal, Canada, September 2006.
83. Diemo Schwarz, Roland Cahen, and Sam Britton. Principles and applications of interactive corpus-based concatenative synthesis. In Journées d'Informatique Musicale (JIM), GMEA, Albi, France, March 2008. URL http://mediatheque.ircam.fr/articles/textes/Schwarz08a/index.pdf.
84. G. Strobl. Parametric Sound Texture Generator. Msc thesis, Universität für Musik und darstellende Kunst, Graz; Technische Universitäåt Graz, 2007. URL http://en.scientificcommons.org/ 43580321.
85. G. Strobl, G. Eckel, and D. Rocchesso. Sound texture modeling: A survey. In Proceedings of the International Conference on Sound and Music Computing (SMC), 2006.
86. Patrick Susini, Stephen McAdams, SuzanneWinsberg, Yvan Perry, Sandrine Vieillard, and Xavier Rodet. Characterizing the sound quality of air-conditioning noise. Applied Acoustics, 65-8:763-790, 2004. URL http://articles.ircam.fr/textes/Susini04b/.
87. N. Tsingos, E. Gallo, and G. Drettakis. Perceptual audio rendering of complex virtual environments. In ACM SIGGRAPH 2004 Papers, pages 249-258. ACM, 2004.
88. A. Valle, V. Lombardo, and M. Schirosa. Simulating the Soundscape through an Analysis/Resynthesis Methodology. Auditory Display, pages 330-357, 2010.
89. Andrea Valle, Vincenzo Lombardo, and Mattia Schirosa. A graph-based system for the dynamic generation of soundscapes. In Proceedings of the 15th International Conference on Auditory Display, pages 217-224, Copenhagen, 18-21 May 2009.
90. Kees van den Doel, Paul G. Kry, and Dinesh K. Pai. Foleyautomatic: physically-based sound effects for interactive simulation and animation. In Proceedings of the 28th annual conference on Computer graphics and interactive techniques, SIGGRAPH '01, pages 537-544, New York, NY, USA, 2001. ACM. ISBN 1-58113-374-X. doi: http://doi.acm.org/10.1145/383259.383322. URL http://doi.acm.org/10.1145/383259.383322.
91. C. Verron, M. Aramaki, R. Kronland-Martinet, and G. Pallone. Spatialized Synthesis of Noisy Environmental Sounds, pages 392-407. Springer-Verlag, 2010. URL http://www.springerlink.com/index/J3T5177W11376R84.pdf.
92. C. Verron, M. Aramaki, R. Kronland-Martinet, and G. Pallone. Contrôle intuitif d'un synthétiseur d'environnements sonores spatialisés. In 10eme Congres Français d'Acoustique, 2010. URL http://cfa.sfa.asso.fr/cd1/data/articles/000404.pdf.
93. Charles Verron. Synthèse immersive de sons d'environnement. Phd thesis, Université Aix-Marseille I, 2010.
94. X. Zhu and L. Wyse. Sound texture modeling and timefrequency LPC. In Proceedings of the COST-G6 Conference on Digital Audio Effects (DAFx), volume 4, 2004.