Efficient and practical audio-visual rendering for games using crossmodal perception

Proceedings of I3D 2009: The 2009 ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games

Volumn , Issue , 2009, Pages 177-182

  Grelaud, David ^a   Bonneel, Nicolas ^a   Wimmer, Michael ^b   Asselot, Manuel ^a   Drettakis, George ^a  

^a INRIA   (France)

^b VUT ^*

Author keywords

Audio visual rendering; Crossmodal perception

Indexed keywords

3D AUDIO; AUDIO RENDERING; AUDIO-VISUAL; COMPUTER GAME; CROSS-MODAL; GAME ENGINE; GRAPHICS RENDERING; HIGH QUALITY; IMPACT SOUND; INTERACTIVE APPLICATIONS; IS IMPACTS; LEVEL-OF-DETAIL; PHYSICS ENGINE; POTENTIAL UTILITY; QUALITY LEVELS; RENDERING PIPELINES; SELECTION ALGORITHM; SOUNDSCAPES;

ACOUSTIC WAVES; AUDIO ACOUSTICS; COMPUTER APPLICATIONS; INTERACTIVE COMPUTER GRAPHICS; THREE DIMENSIONAL;

THREE DIMENSIONAL COMPUTER GRAPHICS;

EID: 77950413374     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1507149.1507178     Document Type: Conference Paper

References (24)

1. AGARWAL, S., RAMAMOORTHI, R., BELONGIE, S., AND JENSEN, H. W. 2003. Structured importance sampling of environment maps. In ACM Trans. on Graphics (Proc. of SIGGRAPH), vol.22, 605-612.
2. BONNEEL, N., DRETTAKIS, G., TSINGOS, N., VIAUD-DELMON, I., AND JAMES, D. 2008. Fast modal sounds with scalable frequency-domain synthesis. ACM Trans. on Graphics (Proc. of SIGGRAPH) 27, 3 (August), 1-9.
3. BONNEEL, N., SUIED, C., VIAUD-DELMON, I., AND DRETTAKIS, G. 2009. Bimodal perception of audio-visual material properties for virtual environments. ACM Transactions on Applied Perception (Accepted with minor revisions).
4. CHIU, D.-F. 2008. Penta G - A Game Engine for Real-Time Rendering Research. Master's thesis, Institute of Computer Graphics and Algorithms, Vienna University of Technology.
5. FLEMING, R. W., DROR, R. O., AND ADELSON, E. H. 2003. Real-world illumination and the perception of surface reflectance properties. Journal of Vision 3, 5 (July), 347-368.
6. FUNKHOUSER, T., MIN, P., AND CARLBOM, I. 1999. Real-time acoustic modeling for distributed virtual environments. In Proc. of ACM SIGGRAPH 99, 365-374.
7. FUNKHOUSER, T., TSINGOS, N., CARLBOM, I., ELKO, G., SONDHI, M., WEST, J., PINGALI, G., MIN, P., AND NGAN, A. 2004. A beam tracing method for interactive architectural acoustics. The Journal of the Acoustical Society of America (JASA), 2003. 115, 2 (February), 739-756.
8. LOKKI, T., SAVIOJA, L., VÄÄNÄNEN, R., HUOPANIEMI, J., AND TAKALA, T. 2002. Creating interactive virtual auditory environments. IEEE Comput. Graph. Appl. 22, 4, 49-57.
9. LUEBKE, D., AND HALLEN, B. 2001. Perceptually driven simplification for interactive rendering. In Proc. of EG Workshop on Rendering 2001, 223-234.
10. LUEBKE, D., WATSON, B., COHEN, J. D., REDDY, M., AND VARSHNEY, A. 2002. Level of Detail for 3D Graphics. Elsevier Science Inc., New York, NY, USA.
11. MOECK, T., BONNEEL, N., TSINGOS, N., DRETTAKIS, G., VIAUD-DELMON, I., AND ALLOZA, D. 2007. Progressive perceptual audio rendering of complex scenes. In ACM SIGGRAPH Symp. on Interactive 3D Graphics and Games (I3D), 189-196.
12. MYSZKOWSKI, K. 1998. The Visible Differences Predictor: applications to global illumination problems. In Proc. of EG Workshop on Rendering 1998, 223-236.
13. PELLACINI, F., FERWERDA, J. A., AND GREENBERG, D. P. 2000. Toward a psychophysically-based light reflection model for image synthesis. In Proc. of ACM SIGGRAPH 00, 55-64.
14. RAGHUVANSHI, N., AND LIN, M. C. 2006. Interactive sound synthesis for large scale environments. In ACM SIGGRAPH Symp. on Interactive 3D Graphics and Games (I3D), 101-108.
15. RAGHUVANSHI, N., AND LIN, M. C. 2007. Physically based sound synthesis for large-scale virtual environments. IEEE Comput. Graph. Appl. 27, 1, 14-18.
16. RAMANARAYANAN, G., FERWERDA, J., WALTER, B., AND BALA, K. 2007. Visual equivalence: Towards a new standard for image fidelity. ACM Trans. on Graphics (Proc. of SIGGRAPH) (August), 76.
17. RAMASUBRAMANIAN, M., PATTANAIK, S. N., AND GREENBERG, D. P. 1999. A perceptually based physical error metric for realistic image synthesis. In Proc. of ACM SIGGRAPH 99, 73-82.
18. SLOAN, P.-P., LUNA, B., AND SNYDER, J. 2005. Local, deformable precomputed radiance transfer. In ACM Trans. on Graphics (Proc. of SIGGRAPH), vol.24, 1216-1224.
19. SPENCE, C., AND DRIVER, J. 2004. Crossmodal Space and Crossmodal Attention. Oxford University Press, USA, June.
20. TSINGOS, N., GALLO, E., AND DRETTAKIS, G. 2004. Perceptual audio rendering of complex virtual environments. ACM Trans. on Graphics (Proc. of SIGGRAPH) 23, 3 (July), 249-258.
21. VAN DEN DOEL, K., AND PAI, D. K. 1998. The sounds of physical shapes. Presence 7, 4, 382-395.
22. VAN DEN DOEL, K., AND PAI, D. K. 2003. Modal synthesis for vibrating objects. Audio Anecdotes.
23. VANGORP, P., LAURIJSSEN, J., AND DUTRÉ, P. 2007. The influence of shape on the perception of material reflectance. ACM Trans. on Graphics (Proc. of SIGGRAPH) 26, 3 (August), 77.
24. WILLIAMS, N., LUEBKE, D., COHEN, J. D., KELLEY, M., AND SCHUBERT, B. 2003. Perceptually guided simplification of lit, textured meshes. In ACM SIGGRAPH Symp. on Interactive 3D Graphics and Games (I3D), 113-121.