Integrating physically based sound models in a multimodal rendering architecture

Computer Animation and Virtual Worlds

Volumn 17, Issue 3-4, 2006, Pages 411-419

  Avanzini, Federico ^a   Crosato, Paolo ^a  

^a UNIVERSITY OF PADOVA   (Italy)

Author keywords

Multimodal interaction; Sound rendering; Stiffness

Indexed keywords

AUDITORY FEEDBACK; MULTIMODAL INTERACTION; SOUND RENDERING; STIFFNESS;

AUDITION; COMPUTER SIMULATION; GESTURE RECOGNITION; MATHEMATICAL MODELS; SENSORY PERCEPTION;

HAPTIC INTERFACES;

EID: 33745863845     PISSN: 15464261     EISSN: 1546427X     Source Type: Journal    
DOI: 10.1002/cav.144     Document Type: Conference Paper

References (32)

1. Welch RB, Warren DH. Intersensory interactions. In Handbook of Perception and Human Performance: Sensory processes and perception. Vol. 1. Boff KR, Kaufman L, Thomas JP (eds). John Wiley & Sons: New York, 1986; 1-36.
2. Hahn JK, Fouad H, Gritz L, Lee JW. Integrating sounds in virtual environments. Presence: Teleoperators and Virtual Environment 1998; 7(1): 67-77.
3. van den Doel K, Pai DK. The sounds of physical shapes. Presence: Teleoperators and Virtual Environment 1998; 7(4): 382-395.
4. Avanzini F, Rath M, Rocchesso D, Ottaviani L. Low-level sound models: resonators, interactions, surface textures. In The Sounding Object, Rocchesso D, Fontana F (eds). Mondo Estremo: Firenze, 2003; 137-172.
5. DiFilippo D, Pai DK. The AHI: An audio and haptic interface for contact interactions. In Proceedings of ACM Symposium on User Interface Software and Technology (UIST'00), San Diego, CA, November 2000.
6. Lederman SJ. Auditory texture perception. Perception 1979; 8(1): 93-103.
7. Lederman SJ, Klatzky RL, Morgan T, Hamilton C. Integrating multimodal information about surface texture via a probe: Relative contribution of haptic and touch-produced sound sources. In Proceedings of IEEE Symposium Haptic Interfaces for Virtual Environment and Teleoperator Systems (HAPTICS 2002), Orlando, FL, 2002, pp. 97-104.
8. Guest S, Catmur C, Lloyd D, Spence C. Audiotactile interactions in roughness perception. Experimental Brain Research 2002; 146(2): 161-171.
9. McGee MR, Gray P, Brewster S. Mixed feelings: Multimodal perception of virtual roughness. In Proceedings of International Conference on EuroHaptics, Edinburgh, July 2002, pp. 47-52.
10. DiFranco DE, Beauregard GL, Srinivasan MA. The effect of auditory cues on the haptic perception of stiffness in virtual environments. In Proceedings of the ASME Dynamic Systems and Control Division, (DSC-Vol.61), 1997.
11. Freed DJ. Auditory correlates of perceived mallet hardness for a set of recorded percussive events. Journal of the Acoustical Society of America 1990; 87(1): 311-322.
12. Giordano B. Sound source perception in impact sounds. PhD thesis, Department of General Psychology, University of Padova, Italy, 2006.
13. Zölzer U (ed.). DAFX - Digital Audio Effects. John Wiley & Sons: Chichester Sussex, UK, 2002.
14. Cook PR. Real sound synthesis for interactive applications. A. K. Peters, Ltd: Natick, MA, 2002.
15. Gaver WW. What in the world do we hear? An ecological approach to auditory event perception. Ecological Psychology 1993; 5(1): 1-29.
16. Gaver WW. How do we hear in the world? Explorations of ecological acoustics. Ecological Psychology 1993; 5(4): 285-313.
17. Novint Tech. The interchange of haptic information. In Proceedings of Seventh Phantom Users Group Workshop (PUG02), Santa Fe, October 2002.
18. Sensegraphics. Website. http://www.sensegraphics.se.
19. van den Doel K. Physically based models for liquid sounds. ACM Transactions on Applied Perception 2005; 2(4): 534-546.
20. Dobashi Y, Yamamoto T, Nishita T. Real-time rendering of aerodynamic sound using sound textures based on computational fluid dynamics. In Proceedings of ACM SIGGRAPH 2003, San Diego, CA, July 2003, pp. 732-740.
21. Adrien J-M. The missing link: Modal synthesis. In Representations of Musical Signals, De Poli G, Piccialli A, Roads C (eds). MIT Press: Cambridge, MA, 1991; 269-297.
22. Klatzky RL, Pai DK, Krotkov EP. Perception of material from contact sounds. Presence: Teleoperators and Virtual Environment 2000; 9(4): 399-410.
23. O'Brien JF, Shen C, Gatchalian CM. Synthesizing sounds from rigid-body simulations. In Proceedings of ACM SIGGRAPH 2002, San Antonio, TX, July 2002, pp. 175-181.
24. Avanzini F, Serafin S, Rocchesso D. Interactive simulation of rigid body interaction with friction-induced sound generation. IEEE Transactions of Speech Audio Process 2005; 13(6): 1073-1081.
25. Salisbury K, Conti F, Barbagli F. Haptic Rendering: introductory concepts. IEEE Computer Graphics and Applications 2004; 24(2): 24-32.
26. Wu W-C, Basdogan C, Srinivasan MA. Visual, haptic, and bimodal perception of size and stiffness in virtual environments. In Proceedings of the ASME Dynamic Systems and Control Division, (DSC-Vol.67), 1999.
27. Kuchenbecker KJ, Fiene J, Niemeyer G. Improving contact realism through event-based haptic feedback. IEEE Transactions on Visualization and Computer Graphics 2006; 13(2): 219-230.
28. Colgate JE, Brown JM. Factors affecting the Z-width of a haptic display, hi Proceedings of IEEE International Conference on Robotics & Automation, San Diego, May 1994, pp. 3205-3210.
29. Hunt KH, Crossley FRE. Coefficient of restitution interpreted as damping in vibroimpact. ASME Journal of Applied Mechanics 1975; 42: 440-445.
30. Avanzini F, Rocchesso D. Physical modeling of impacts: theory and experiments on contact time and spectral centroid. In Proceedings of International Conference Sound and Music Computing (SMC06), Paris, October 2004, pp. 287-293.
31. Bresciani J-P, Ernst MO, Drewing K, Bouyer G, Maury V, Kheddar A. Feeling what you hear: auditory signals can modulate tactile tap perception. Experimental Brain Research 2005; 162(2): 172-180.
32. Hötting K, Röder B. Hearing cheats touch, but less in congenitally blind than in sighted individuals. Psychological Science 2004; 15(1): 60-64.