Progressive perceptual audio rendering of complex scenes

Proceedings - I3D 2007, ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games

Volumn , Issue , 2007, Pages 189-196

  Moeck, Thomas ^a,b   Bonneel, Nicolas ^a   Tsingos, Nicolas ^a   Drettakis, George ^a   Viaud Delmon, Isabelle ^c   Alloza, David ^c  

^a INRIA   (France)

^b UNIVERSITY OF ERLANGEN NUREMBERG   (Germany)

^c CNRS UMR 7593 Vulnerabilite Adaptation et Psychopathologie   (France)

Author keywords

Audio rendering; Auditory masking; Clustering; Ventriloquism

Indexed keywords

AUDIO RENDERING; AUDIO SIGNAL; AUDIO-VISUAL; AUDITORY MASKING; COMPLEX SCENES; COMPUTING BUDGET; HIERARCHICAL CLUSTERING ALGORITHMS; HIGH QUALITY; PILOT STUDIES; PRE-MIXING METHOD; PROGRESSIVE REFINEMENT; QUALITY EVALUATION; SALIENCY MAP; SCENE COMPLEXITY; SOUND SOURCE; SOURCE SIGNALS; THREE SOLUTIONS; USER TESTS; VIRTUAL SCENES;

ACOUSTIC GENERATORS; CLUSTERING ALGORITHMS; INTERACTIVE COMPUTER GRAPHICS; SOUND REPRODUCTION; THREE DIMENSIONAL; THREE DIMENSIONAL COMPUTER GRAPHICS;

AUDIO ACOUSTICS;

EID: 77950585363     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1230100.1230133     Document Type: Conference Paper

References (36)

1. ALAIS, D., AND BURR, D. 2004. The ventriloquism effect results from near-optimal bimodal integration. Current Biology 14, 257-262.
2. AND, C. G. 1993. Methods for quality assessment of low bit-rate audio codecs, proceedings of the 12th aes conference. 97-107.
3. BERKHOUT, A., DE VRIES, D., AND VOGEL, P. 1993. Acoustic control by wave field synthesis. J. of the Acoustical Society of America 93, 5 (may), 2764-2778.
4. BLAUERT, J. 1997. Spatial Hearing : The Psychophysics of Human Sound Localization. M.I.T. Press, Cambridge, MA.
5. CHEN, J., VEEN, B. V., AND HECOX, K. 1995. A spatial feature extraction and regularization model for the head-related transfer function. J. of the Acoustical Society of America 97 (Jan.), 439-452.
6. DARLINGTON, D., DAUDET, L., AND SANDLER, M. 2002. Digital audio effects in the wavelet domain. In Proceedings of COST-G6 Conference on Digital Audio Effects, DAFX2002, Hamburg, Germany.
7. 2003. EBU subjective listening tests on low-bitrate audio codecs. Technical report 3296, European Broadcast Union (EBU), Projet Group B/AIM (june).
8. FOUAD, H., HAHN, J., AND BALLAS, J. 1997. Perceptually based scheduling algorithms for real-time synthesis of complex sonic environments. proceedings of the 1997 International Conference on Auditory Display (ICAD'97),.
9. GALLO, E., LEMAITRE, G., AND TSINGOS, N. 2005. Prioritizing signals for selective real-time audio processing. In Proc. of ICAD 2005.
10. HAIRSTON, W., WALLACE, M., AMD B.E. STEIN, J. V., NORRIS, J., AND SCHIRILLO, J. 2003. Visual localization ability influences cross-modal bias. J. Cogn. Neuroscience 15, 20-29.
11. HERDER, J. 1999. Optimization of sound spatialization resource management through clustering. The Journal of Three Dimensional Images, 3D-Forum Society 13, 3 (Sept.), 59-65.
12. HOCHBAUM, D. S., AND SCHMOYS, D. B. 1985. A best possible heuristic for the 1k-center problem. Mathematics of Operations Research 10, 2 (May), 180-184.
13. HOWELL, D. C. 1992. Statistical methods for psychology. PWS-Kent.
14. INTERNATIONAL TELECOM. UNION. 2001-2003. Method for the subjective assessment of intermediate quality level of coding systems. Recommendation ITU-R BS.1534-1.
15. ITTI, L., KOCH, C., AND NIEBUR, E. 1998. A model of saliency-based visual attention for rapid scene analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence 20, 11 (Nov.), 1254-1259.
16. ITU-R. 1994. Methods for subjective assessment of small impairments in audio systems including multichannel sound systems. itu-r bs 1116. Tech. rep.
17. JOT, J.-M., AND WALSH, M. 2006. Binaural simulation of complex acoustic scenes for interactive audio. In 121th AES Convention, San Francisco, USA. Preprint 6950.
18. JOT, J.-M., LARCHER, V., AND PERNAUX, J.-M. 1999. A comparative study of 3D audio encoding and rendering techniques. Proceedings of the AES 16th international conference, Spatial sound reproduction, Rovaniemi, Finland (April).
19. KAYSER, C., PETKOV, C., LIPPERT, M., AND LOGOTHETIS, N. 2005. Mechanisms for allocating auditory attention: An auditory saliency map. Current Biology 15 (Nov.), 1943-1947.
20. KELLY, M., AND TEW, A. 2002. The continuity illusion in virtual auditory space. proc. of the 112th AES Conv., Munich, Germany (May).
21. KURNIAWATI, E., ABSAR, J., GEORGE, S., LAU, C. T., AND PREMKUMAR, B. 2002. The significance of tonality index and nonlinear psychoacoustics models for masking threshold estimation. In Proceedings of the International Conference on Virtual, Synthetic and Entertainment Audio AES22.
22. LANCIANI, C. A., AND SCHAFER, R. W. 1997. Psychoacoustically-based processing of MPEG-I layer 1-2 encoded signals. In Proc. IEEE Signal Processing Society 1997 Workshop on Multimedia Signal Processing, 53-58.
23. LANCIANI, C. A., AND SCHAFER, R. W. 1999. Subband-domain filtering of MPEG audio signals. In Proceedings of Intl. Conf. on Acoustics, Speech and Signal Processing, 917-920.
24. LARCHER, V., JOT, J., GUYARD, G., AND WARUSFEL, O. 2000. Study and comparison of efficient methods for 3d audio spatialization based on linear decomposition of HRTF data. Proc. 108th Audio Engineering Society Convention.
25. LEWALD, J., EHRENSTEIN, W. H., AND GUSKI, R. 2001. Spatio-temporal constraints for auditory-visual integration. Beh. Brain Research 121, 1-2, 69-79.
26. MALHAM, D., AND MYATT, A. 1995. 3D sound spatialization using ambisonic techniques. Computer Music Journal 19, 4, 58-70.
27. MØLLER, H. 1992. Fundamentals of binaural technology. Applied Acoustics 36, 171-218.
28. PAINTER, E. M., AND SPANIAS, A. S. 2000. Perceptual coding of digital audio. Proceedings of the IEEE 88, 4 (Apr.).
29. SARLAT, L., WARUSFEL, O., AND VIAUD-DELMON, I. 2006. Ventriloquism aftereffects occur in the rear hemisphere. Neuroscience Letters 404, 324-329.
30. STOLL, G., AND KOZAMERNIK, F. 2000. EBU subjective listening tests on internet audio codecs. EBU TECHNICAL REVIEW, (June).
31. TOUIMI, A. B., EMERIT, M., AND PERNAUX, J.-M. 2004. Efficient method for multiple compressed audio streams spatialization. In In Proceeding of ACM 3rd Intl. Conf. on Mobile and Ubiquitous multimedia.
32. TOUIMI, A. B. 2000. A generic framework for filtering in subband domain. In In Proc. of IEEE 9th Wkshp. on Digital Signal Processing, Hunt, Texas, USA.
33. TSINGOS, N., GALLO, E., AND DRETTAKIS, G. 2004. Perceptual audio rendering of complex virtual environments. Proc. SIGGRAPH'04 (August).
34. TSINGOS, N. 2005. Scalable perceptual mixing and filtering of audio signals using an augmented spectral representation. Proc. of 8th Intl. Conf. on Digital Audio Effects (DAFX'05), Madrid, Spain (Sept.).
35. WAND, M., AND STRASSER, W. 2004. Multi-resolution sound rendering. In Symp. Point-Based Graphics.
36. ZÖLZER, U., Ed. 2002. DAFX - Digital Audio Effects. Wiley.