A synthesis model with intuitive control capabilities for rolling sounds

IEEE Transactions on Audio, Speech and Language Processing

Volumn 22, Issue 8, 2014, Pages 1260-1273

  Conan, Simon ^a   Derrien, Olivier ^b   Aramaki, Mitsuko ^a   Ystad, Sølvi ^a   Kronland Martinet, Richard ^a  

^a AIX MARSEILLE UNIVERSITY   (France)

^b UNIVERSITÉ DE TOULON   (France)

Author keywords

Audio virtual reality; Physics based model; Rolling sounds; Sound analysis; Sound synthesis; Source filter model

Indexed keywords

EXPERIMENTS; REAL TIME CONTROL; VIRTUAL REALITY;

ANALYSIS-SYNTHESIS; INTERACTION FORCES; INTUITIVE CONTROLS; PHYSICS-BASED MODELING; REAL-TIME IMPLEMENTATIONS; SOUND ANALYSIS; SOUND SYNTHESIS; SOURCE-FILTER MODELS;

AUDIO ACOUSTICS;

EID: 84911393121     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASLP.2014.2327297     Document Type: Article

References (52)

1. N. Böttcher, "Current problems and future possibilities of procedural audio in computer games," J. Gaming Virtual Worlds, vol. 5, no. 3, pp. 215-234, 2013.
2. D. B. Lloyd, N. Raghuvanshi, and N. K. Govindaraju, "Sound synthesis for impact sounds in video games," in Proc. Symp. Interactive 3D Graphics Games, 2011, pp. 55-62, ACM.
3. A. Farnell, Designing sound. Cambridge, MA, USA: MIT Press, 2010.
4. G. Dubus and R. Bresin, "A systematic review of mapping strategies for the sonification of physical quantities," PLoS ONE, vol. 8, no. 12, p. e82491, 2013.
5. J. Danna, J.-L. Velay, V. Paz-Villagran, A. Capel, C. Petroz, C. Gondre, E. Thoret, M. Aramaki, S. Ystad, and R. Kronland-Martinet, "Handwriting movement sonification for the rehabilitation of dysgraphia," in Proc. 10th Int. Symp. Comput. Music Multidisciplinary Res. (CMMR), 2013, pp. 200-208.
6. M.W. Rodger, W. R. Young, and C. M. Craig, "Synthesis of walking sounds for alleviating gait disturbances in Parkinson's disease," IEEE Trans. Neural Syst. Rehabil. Eng., vol. 22, no. 3, pp. 543-548, May 2013.
7. R. Kronland-Martinet, S. Ystad, and M. Aramaki, "High-level control of sound synthesis for sonification processes," AI & Soc., vol. 27, no. 2, pp. 245-255, 2012.
8. C.Michaels and C. Carello, Direct perception. Englewood Cliffs, NJ, USA: Prentice-Hall, 1981.
9. W. Warren and R. Verbrugge, "Auditory perception of breaking and bouncing events:Acase study in ecological acoustics," J. Exp. Psychol. Hum Percept. Perform., vol. 10, no. 5, pp. 704-712, 1984.
10. S. McAdams and E. Bigand, Thinking in sound: The cognitive psychology of human audition. Oxford, U.K.: Oxford Science, 1993.
11. G. Lemaitre and L. Heller, "Auditory perception of material is fragile while action is strikingly robust," J. Acoust. Soc. Amer., vol. 131, pp. 1337-1348, 2012.
12. B. Atal and S. Hanauer, "Speech analysis and synthesis by linear prediction of the speech wave," J. Acoust. Soc. Amer., vol. 50, no. 2B, pp. 637-655, 1971.
13. X. Rodet, P. Depalle, and G. Poirot, "Diphone sound synthesis based on spectral envelopes and harmonic/noise excitation functions," in Proc. Int. Comput. Music Conf., 1988, pp. 313-321.
14. C. Stoelinga, "A psychomechanical study of rolling sounds," Ph.D. dissertation, ENSTA ParisTech, Paris, France, 2007.
15. M. Rath and D. Rocchesso, "Continuous sonic feedback from a rolling ball," IEEE Multimedia, vol. 12, no. 2, pp. 60-69, Apr.-Jun. 2005.
16. K. Van Den Doel, P. Kry, and D. Pai, "Foleyautomatic: Physicallybased sound effects for interactive simulation and animation," in Proc. Int. Conf. Computer Graphics and Interactive Techniques, 2001.
17. D.Hermes, Synthesis of the sounds produced by rolling balls Center for User-System Interaction, Eindhoven, The Netherlands, Internal IPO Rep. no. 1226, 1998.
18. M. Lagrange, G. Scavone, and P. Depalle, "Analysis/synthesis of sounds generated by sustained contact between rigid objects," IEEE Trans. Audio, Speech, Lang. Process., vol. 18, no. 3, pp. 509-518, Mar. 2010.
19. J. Lee, P. Depalle, and G. Scavone, "Analysis/synthesis of rolling sounds using a source-filter approach," in Proc. Int. Conf. Digital Audio Effects (DAFx), 2010.
20. W. Gaver, "How do we hear in the world? Explorations in ecological acoustics," Ecol. Psychol., vol. 5, no. 4, pp. 285-313, 1993.
21. S. Conan, M. Aramaki, R. Kronland-Martinet, E. Thoret, and S. Ystad, "Perceptual differences between sounds produced by different continuous interactions," in Proc. Acoust., 2012.
22. S. Conan, E. Thoret, M. Aramaki, O. Derrien, C. Gondre, R. Kron-land- Martinet, and S. Ystad, "Navigating in a space of synthesized in-teraction- sounds: Rubbing, scratching and rolling sounds," in Proc. Int. Conf. Digital Audio Effects (DAFx), 2013.
23. M. Aramaki, C. Gondre, R. Kronland-Martinet, T. Voinier, and S. Ystad, "Thinking the sounds: An intuitive control of an impact sound synthesizer," in Proc. Int. Conf. Auditory Display, 2009.
24. M. Aramaki, M. Besson, R. Kronland-Martinet, and S. Ystad, "Controlling the perceived material in an impact sound synthesizer," IEEE Trans. Audio, Speech, Lang. Process., vol. 19, no. 2, pp. 301-314, Feb. 2011.
25. M. Mathews and J. Smith, "Methods for synthesizing very high Q parametrically well behaved two pole filters," in Proc. Stockholm Musical Acoust. Conf. (SMAC), 2003.
26. J. Micoulaud-Franchi, M. Aramaki, A. Merer, M. Cermolacce, S. Ystad, R. Kronland-Martinet, and J. Vion-Dury, "Categorization and timbre perception of environmental sounds in schizophrenia," Psychiatry Res., vol. 189, no. 1, pp. 149-152, 2011.
27. C. Stoelinga and A. Chaigne, "Time-domain modeling and simulation of rolling objects," Acta Acust. United Acust., vol. 93, no. 2, pp. 290-304, 2007.
28. A. Chaigne and C. Lambourg, "Time-domain simulation of damped impacted plates. I. Theory and experiments," J. Acoust. Soc. Amer., vol. 109, pp. 1422-1432, 2001.
29. C. Lambourg, A. Chaigne, and D. Matignon, "Time-domain simulation of damped impacted plates. II. Numericalmodel and results," J. Acoust. Soc. Amer., vol. 109, pp. 1433-1447, 2001.
30. P. Morse and K. Ingard, Theoretical acoustics. NewYork,NY,USA: McGraw-Hill, 1968.
31. E. Falcon, C. Laroche, S. Fauve, and C. Coste, "Behavior of one inelastic ball bouncing repeatedly off the ground," Eur. Phys. J. B, vol. 3, no. 1, pp. 45-57, 1998.
32. K. Hunt and F. Crossley, "Coefficient of restitution interpreted as damping in vibroimpact," J. Appl. Mech., pp. 440-445, 1975.
33. F. Avanzini and D. Rocchesso, "Modeling collision sounds: Non-linear contact force," in Proc. Int. Conf. Digital Audio Effects (DAFx), 2001.
34. F. Avanzini, M. Rath, and D. Rocchesso, "Physically-based audio rendering of contact," in Proc. IEEE Int. Conf. Multimedia Expo, 2002, vol. 2.0.4, pp. 445-448.
35. R. Sayles and T. Thomas, "Surface topography as a nonstationary random process," Nature, vol. 271, pp. 431-434, 1978.
36. M. Houben, "The sound of rolling objects: Perception of size and speed," Ph.D. dissertation, Technische Univ. Eindhoven, Eindhoven, The Netherlands, 2002.
37. R. Roy and T. Kailath, "ESPRIT-estimation of signal parameters via rotational invariance techniques," IEEE Trans. Acoust., Speech, Signal Process., vol. 37, no. 7, pp. 984-995, Jul. 1989.
38. R. Badeau, R. Boyer, and B. David, "EDS parametric modeling and tracking of audio signals," in Proc. Int. Conf. Digital Audio Effects (DAFx), 2002.
39. E. Schuijers,W. Oomen, B. Den Brinker, and J. Breebaart, "Advances in parametric coding for high-quality audio," in Proc. 114th Conv. Audio Eng. Soc., 2003.
40. M. Rath, "Interactive realtime sound models for human-computer interaction: A sound design concept and applications," Ph.D. dissertation, Univ. degli Studi di Verona, Verona, Italy, 2004.
41. U. M. Ascher and L. R. Petzold, Computer Methods for Ordinary Differential Equations and Differential-Algebraic Equations. Philadelphia, PA, USA: SIAM, 1998.
42. S. Papetti, F. Avanzini, and D. Rocchesso, "Numerical methods for a nonlinear impact model: A comparative study with closed-form corrections," IEEE Trans. Audio, Speech, Lang. Process., vol. 19, no. 7, pp. 2146-2158, Sep. 2011.
43. E. Murphy, M. Lagrange, G. Scavone, P. Depalle, and C. Guastavino, "Perceptual evaluation of rolling sound synthesis," Acta Acust. United Acust., vol. 97, no. 5, pp. 840-851, 2011.
44. F. Avanzini and D. Rocchesso, "Physical modeling of impacts: Theory and experiments on contact time and spectral centroid," in Proc. Conf. Sound, Music Comput., 2004.
45. W. Theron, "Analysis of the rolling motion of loaded hoops," Ph.D. dissertation, Univ. of Stellenbosch, Stellenbosch, South Africa, 2008.
46. A. Chaigne and V. Doutaut, "Numerical simulations of xylophones. II. Time-domain modeling of the vibrating bars," J. Acoust. Soc. Amer., vol. 101, no. 1, pp. 539-557, 1997.
47. B. Ninness, A. Wills, and S. Gibson, "The University of Newcastle identification toolbox (unit)," in Proc.World Congr. Int. Fed. Automat. Control, 2005.
48. M. Houben, A. Kohlrausch, and D. Hermes, "Perception of the size and speed of rolling balls by sound," Speech Commun., vol. 43, no. 4, pp. 331-345, 2004.
49. H. A. David, The method of paired comparisons. Oxford, U.K.: Oxford Univ. Press, 1988.
50. C. Stoelinga, D. Hermes, A. Hirschberg, and A. Houtsma, "Temporal aspects of rolling sounds: A smooth ball approaching the edge of a plate," Acta Acust. United Acust., vol. 89, no. 5, pp. 809-817, 2003.
51. K. van den Doel, "Physically based models for liquid sounds," in Proc. Int. Conf. Auditory Display, 2004.
52. C. Verron, M. Aramaki, R. Kronland-Martinet, and G. Pallone, "A 3-D immersive synthesizer for environmental sounds," IEEE Trans. Audio, Speech, Lang. Process., vol. 18, no. 6, pp. 1550-1561, Aug. 2010.