A 3-D immersive synthesizer for environmental sounds

IEEE Transactions on Audio, Speech and Language Processing

Volumn 18, Issue 6, 2010, Pages 1550-1561

  Verron, Charles ^a,b   Aramaki, Mitsuko ^c   Kronland Martinet, Richard ^b   Pallone, Grgory ^a  

^a ORANGE LABS   (France)

^b LABORATOIRE DE MÉCANIQUE ET D ACOUSTIQUE   (France)

^c Institut de Microbiologie de la Mediterranee   (France)

Author keywords

Environmental sounds; Frequency domain additive synthesis; Sound analysis synthesis; Sound spatialization; Source spatial extension; Source width evaluation; Spatial sound effects

Indexed keywords

ANALYSIS/SYNTHESIS; ENVIRONMENTAL SOUNDS; FREQUENCY DOMAINS; SOUND SPATIALIZATION; SOURCE WIDTH EVALUATION; SPATIAL EXTENSION; SPATIAL SOUND;

ACOUSTIC GENERATORS; AUDIO SYSTEMS; FREQUENCY DOMAIN ANALYSIS; THREE DIMENSIONAL; VIRTUAL REALITY;

AUDIO ACOUSTICS;

EID: 77955754357     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2009.2037402     Document Type: Article

References (73)

1. C. Roads, The Computer Music Tutorial. Cambridge, U.K.: MIT Press, 2000.
2. R. Kronland-Martinet, P. Guillemain, and S. Ystad, "Modelling of natural sounds by time-frequency andwavelet representations," Organised Sound, vol.2, no.3, pp. 179-191, 1997.
3. P. R. Cook, Real Sound Synthesis for Interactive Applications. Wellesley, MA: A. K Peters, Ltd., 2002.
4. A. Farnell, Designing Sound, Procedural Audio for Games and Film. London, U.K.: Applied Scientific, 2008.
5. D. Rocchesso and F. Fontana, "The Sounding Object," 2003 [Online]. Available: http://www.soundobject.org/
6. "CLOSED Project," [Online]. Available: http://closed.ircam.fr/
7. K. van den Doel, P. G. Kry, and D. K. Pai, "Foleyautomatic: physicallybased sound effects for interactive simulation and animation," in Proc. 28th Annu. Conf. Comput. Graphics Interactive Techniques, 2001, pp. 537-544.
8. J. F. O'Brien, C. Shen, and C. M. Gatchalian, "Synthesizing sounds from rigid-body simulations," in Proc. 2002 ACM SIGGRAPH / Eurographics Symp. Comput. Animation, 2002, pp. 175-181.
9. N. Raghuvanshi and M. C. Lin, "Interactive sound synthesis for large scale environments," in Proc. 2006 Symp. Interactive 3-D Graphics Games, 2006, pp. 101-108.
10. Y. Dobashi, T. Yamamoto, and T. Nishita, "Real-time rendering of aerodynamic sound using sound textures based on computational fluid dynamics," ACM Trans. Graphics (Proc. SIGGRAPH 2003), vol.22, no.3, pp. 732-740, 2003.
11. Y. Dobashi, T. Yamamoto, and T. Nishita, "Synthesizing sound from turbulent field using sound textures for interactive fluid simulation," in Proc. EUROGRAPHICS, 2004, vol. 23, no. 3, pp. 539-546.
12. K. van den Doel, "Physically-based models for liquid sounds," in Proc. ICAD 04-10th Meeting Int. Conf. Auditory Display, 2004.
13. X. Serra and J. O. Smith, "Spectral modeling synthesis: A sound analysis/ synthesis system based on a deterministic plus stochastic decomposition," Comput. Music J., vol.14, no.4, pp. 12-24, 1990.
14. X. Rodet, "Musical sound signal analysis/synthesis: Sinusoidal-residual and elementary waveform models," in Proc. IEEE Time-Frequency and Time-Scale Workshop (TFTS'97), 1997.
15. Y. Stylianou, O. Cappé, and E. Moulines, "Continuous probabilistic transform for voice conversion," IEEE Trans. Speech Audio Process., vol.6, no.2, pp. 131-142, Mar. 1998.
16. T. Funkhouser, J.-M. Jot, and N. Tsingos, "Sounds good to me! computational sound for graphics, virtual reality, and interactive systems," in SIGGRAPH 2002 Course Notes, 2002.
17. J. Daniel, R. Nicol, and S. Moreau, "Further investigations of high order ambisonics and wavefield synthesis for holophonic sound imaging," in Proc. 114th AES Conv., 2003.
18. V. Pulkki, "Virtual sound source positioning using vector base amplitude panning," JAES, vol.45, no.6, pp. 456-466, 1997.
19. J.-M. Jot, V. Larcher, and J.-M. Pernaux, "A comparative study of 3-d audio encoding and rendering techniques," in Proc. 16th Int. Conf. AES, 1999.
20. P. G. Georgiou and C. Kyriakakis, "A multiple input single output model for rendering virtual sound sources in real time," in Proc. IEEE Int. Conf. Multimedia and Expo (ICME), 2000, pp. 253-256.
21. T. Moeck, N. Bonneel, N. Tsingos, G. Drettakis, I. Viaud-Delmon, and D. Aloza, "Progressive perceptual audio rendering of complex scenes," in Proc. ACMSIGGRAPH Symp. Interactive 3-D Graphics and Games, 2007.
22. N. Peters, T. Matthews, J. Braasch, and S. McAdams, "Spatial sound rendering in max/msp with vimic," in Proc. Int. Comput. Music Conf. (ICMC), 2008.
23. C. Ramakrishnan, J. Gossmann, and L. Brümmer, "The zkm klangdom," in Proc. 2006 Int. Conf. New Interfaces Musical Express.( NIME06), 2006.
24. J. Nixdorf and D. Gerhard, "Real-time sound source spatialization as used in challenging bodies: Implementation and performance," in Proc. 2006 Int. Conf. New Interfaces Musical Express. (NIME06), 2006.
25. D. L. James, J. Barbic, and D. K. Pai, "Precomputed acoustic transfer: Output-sensitive, accurate sound generation for geometrically complex vibration sources," ACM Trans. Graphics (Proc. SIGGRAPH 2006), vol.25, no.3, pp. 987-995, 2006.
26. R. Corbett, K. van den Doel, J. E. Lloyd, and W. Heidrich, "Timbrefields- 3D interactive sound models for real-time audio," Presence: Teleoperators and Virtual Environments, vol.16, no.6, 2007.
27. O.Warusfel and N. Misdariis, "Sound source radiation synthesis: From stage performance to domestic rendering," in Proc. 116th AES Conv., 2004.
28. D. Topper, M. Burtner, and S. Serafin, "Spatio-operational spectral (S.O.S.) synthesis," in Proc. 5th Int. Conf. Digital Audio Effects (DAFx'02), 2002.
29. Q. Zhang and J. Shi, "Progressive sound rendering in multimedia applications," in Proc. IEEE Int. Conf. Multimedia Expo (ICME), 2004.
30. C. Verron, M. Aramaki, R. Kronland-Martinet, and G. Pallone, "A spatialized additive synthesizer," in Proc. Inaugural Int. Conf. Music Commun. Science (ICoMCS), 2007.
31. C. Verron, M. Aramaki, R. Kronland-Martinet, and G. Pallone, "Spatialized additive synthesis of environmental sounds," in Proc. 125th AES Conv., 2008.
32. [Online]. Available: www.lma.cnrs-mrs.fr/~kronland/spatsynthIEEE/ index.html
33. N. J. Vanderveer, "Ecological acoustics: Human perception of environmental sounds," Ph.D.dissertation, Georgia Inst. Technol., Atlanta, GA, 1979.
34. B. Gygi and V. Shafiro, "General functions and specific applications of environmental sound research," Frontiers in Biosci., vol.12, pp. 3152-3166, 2007.
35. B. Gygi, G. R. Kidd, and C. S. Watson, "Similarity and categorization of environmental sounds," Percept. Psychophys., vol.69, no.6, pp. 839-855, 2007.
36. M. M. Marcell, D. Borella, M. Greene, E. Kerr, and S. Rogers, "Confrontation naming of environmental sounds," J. Clinical Experimental Neuropsychol., vol.22, no.6, pp. 830-864, 2000.
37. J. A. Ballas, "Common factors in the identification of an assortment of brief everyday sounds," J. Experimental Psychol.: Human Percept. Perform., vol.19, no.2, pp. 250-267, 1993.
38. W. W. Gaver, "What in the world do we hear? an ecological approach to auditory event perception," Ecol. Psychol., vol.5, no.1, pp. 1-29, 1993.
39. W. W. Gaver, "How do we hear in the world? explorations in ecological acoustics," Ecol. Psychol., vol.5, no.4, pp. 285-313, 1993.
40. J. J. Gibson, The Ecological Approach to Visual Perception. Boston, MA: Houghton Mifflin, 1979.
41. B. L. Giordano and S. McAdams, "Material identification of real impact sounds: Effects of size variation in steel, wood, and Plexiglas plates," J. Acoust. Soc. Amer., vol.119, no.2, pp. 1171-1181, 2006.
42. S. Tucker and G. J. Brown, "Investigating the perception of the size, shape and material of damped and free vibrating plates," Dept. Comput. Sci.. Univ. de Sheffield, 2002, Tech. Rep. CS-02-10.
43. Y. Gérard, "Mémoire Sémantique et Sons de L'environnement (Semantic Memory and Environmental Sounds)," Ph.D. dissertation, Bourgogne Univ., Dijon, France, 2004.
44. P. Schaeffer, Traité Des Objets Musicaux. Paris, France: Seuil, 1966.
45. A. Merer, S. Ystad, R. Kronland-Martinet, and M. Aramaki, "Semiotics of Sounds Evoking Motions: Categorization and Acoustic Features," in Computer Music Modeling and Retrieval. Sense of Sounds. Berlin/ Heidelberg, Germany: Springer, 2008, pp. 139-158.
46. M. V. Mathews, J. E. Mille, F. R. Moore, J. R. Pierce, and J. C. Risset, The Technology of Computer Music. Cambridge, MA: MIT Press, 1969.
47. C. Stoelinga and A. Chaigne, "Time-domain modeling and simulation of rolling objects," Acustica united with Acta Acustica, vol.93, no.2, pp. 290-304, 2007.
48. J. M. Chowning, "The synthesis of complex audio spectra by means of frequency modulation," JAES, vol.21, no.7, pp. 526-534, 1973.
49. M. L. Brun, "Digital waveshaping synthesis," JAES, vol.27, no.4, pp. 250-266, 1979.
50. M. Aramaki, R. Kronland-Martinet, T. Voinier, and S. Ystad, "A percussive sound synthetizer based on physical and perceptual attributes," Comput. Music J., vol.30, no.2, pp. 32-41, 2006.
51. G. Peeters, "Modèles et modélisation du signal sonore adaptés à ses caractéristiques locales," Ph.D. dissertation, Univ. Paris VI, Paris, France, 2001.
52. D. R. Perrott and T. N. Buell, "Judgments of sound volume: Effects of signal duration, level, and interaural characteristics on the perceived extensity of broadband noise," JASA, vol.72, no.5, pp. 1413-1417, 1982.
53. R. Mason, T. Brookes, and F. Rumsey, "Frequency dependency of the relationship between perceived auditory source width and the interaural cross-correlation coefficient for time-invariant stimuli," JASA, vol.117, no.3, pp. 1337-1350, 2005.
54. T. Hirvonen and V. Pulkki, "Perceived spatial distribution and width of horizontal ensemble of independent noise signals as function of waveform and sample length," in Proc. 124th AES Conv., 2008.
55. J. Blauert, Spatial Hearing. Cambridge, MA: MIT Press, 1997.
56. G. Kendall, "The decorrelation of audio signals and its impact on spatial imagery," Comput. Music J., vol.19, no.4, pp. 71-87, 1995.
57. M. A. Gerzon, "Signal processing for simulating realistic stereo images," in AES Convention 93, 1992.
58. A. Sibbald, "Method of Synthesizing an Audio Signal," U.S. patent US 6,498,857 B1, Dec. 2002.
59. J.-M. Jot, M. Walsh, and A. Philp, "Binaural simulation of complex acoustic scene for interactive audio," in Proc. 121th AES Conv., 2006.
60. V. Pulkki, "Spatial sound reproduction with directional audio coding," JAES, vol.55, no.6, pp. 503-516, 2007.
61. X. Rodet and D. Schwarz, "Spectral Envelopes and Additive + Residual Analysis/Synthesis," in Analysis, Synthesis, and Perception of Musical Sounds: Sound of Music. New York: Springer, 2007, pp. 175-227.
62. X. Rodet and P. Depalle, "Spectral envelopes and inverse FFT synthesis," in Proc. 93rd AES Conv., 1992.
63. M. Goodwin, "Residual modeling in music analysis-synthesis," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., 1996.
64. A. Freed, "Real-time inverse transform additive synthesis for additive and pitch synchronous noise and sound spatialization," in Proc. 104th AES Conv., 1998.
65. X. Amatriain, J. Bonada, A. Loscos, and X. Serra,DAFX: Digital Audio Effects. New York: Wiley, 2002, pp. 373-438.
66. J. O. Smith and J. S. Abel, "Bark and ERB bilinear transforms," IEEE Trans. Speech Audio Process., vol.7, no.6, pp. 697-708, Nov. 1999.
67. J.-M. Jot, S. Wardle, and V. Larcher, "Approaches to binaural synthesis," in Proc. 105th AES Conv., 1998.
68. A. Misra, P. R. Cook, and G. Wang, "A new paradigm for sound design," in Proc. Int. Conf. Digital Audio Effects (DAFx06), 2006.
69. M. Aramaki and R. Kronland-Martinet, "Analysis-synthesis of impact sounds by real-time dynamic filtering," IEEE Trans. Audio, Speech, Lang. Process., vol.14, no.2, pp. 695-705, Mar. 2006.
70. N. Bonneel, G. Drettakis, N. Tsingos, I. Viaud-Delmon, and D. James, "Fast modal sounds with scalable frequency-domain synthesis," ACM Trans. Graphics (Proc. SIGGRAPH 2008), vol.27, no.3, 2008.
71. H.-A David, The Method of Paired Comparisons. New York: Oxford Univ. Press, 1988.
72. C. Kim, R. Mason, and T. Brookes, "An investigation into head movements made when evaluating various attributes of sound," in Proc. 122th AES Conv., 2007.
73. J.-M. Pernaux, M. Emerit, J. Daniel, and R. Nicol, "Perceptual evaluation of static binaural sound synthesis," in Proc. AES 22nd Int. Conf. Virtual, Synth., Entertain. Audio, 2002.