Parametric time-frequency representation of spatial sound in virtual worlds

ACM Transactions on Applied Perception

Volumn 9, Issue 2, 2012, Pages

  Laitinen, Mikko Ville ^a   Pihlajamäki, Tapani ^a   Erkut, Cumhur ^a   Pulkki, Ville ^a  

^a AALTO UNIVERSITY   (Finland)

Author keywords

Spatial sound; Time frequency processing

Indexed keywords

AUDIO CODING; AUDIO QUALITY; ENERGETIC ANALYSIS; LISTENING TESTS; N-CHANNEL; PSYCHOPHYSICAL; SPATIAL AUDIO; SPATIAL EXTENT; SPATIAL SOUND; TIME FREQUENCY DOMAIN; TIME-FREQUENCY PROCESSING; TIME-FREQUENCY REPRESENTATIONS; VIRTUAL SOUND SOURCES; VIRTUAL WORLDS;

ACOUSTIC FIELDS; FREQUENCY DOMAIN ANALYSIS; SOUND REPRODUCTION; VIRTUAL REALITY;

QUALITY CONTROL;

EID: 84863688923     PISSN: 15443558     EISSN: 15443965     Source Type: Journal    
DOI: 10.1145/2207216.2207219     Document Type: Article

References (38)

1. ALLEN, J. B. AND BERKLEY, D. A. 1979. Image method for efficiently simulating small-room acoustic. J. Acoust. Soc. Amer. 65, 4, 943-950.
2. BAUMGARTE, F. AND FALLER, C. 2003. Binaural cue coding. Part I: Psychoacoustic fundamentals and design principles. IEEE Trans. Speech Audio Process. 11, 6, 509-519.
3. BEGAULT, D. R., WENZEL, E. M., AND ANDERSON, M. R. 2001. Direct comparison of the impact of head-tracking, reverberation, and individualized head-related transfer functions on the spatial perception of a virtual speech source. J. Audio Eng. Soc. 49, 10,904-916. (Pubitemid 33090695)
4. BENNETT, J. C., BARKER, K., AND EDEKO, F. O. 1985. A new approach to the assessment of stereophonic sound system performance.J. Audio Eng. Soc. 33, 5, 314-321. (Pubitemid 15600435)
5. BERKHOUT, A. J., DE VRIES, D., AND VOGEL, P. 1993. Acoustics control by wave field synthesis. J. Acoust. Soc. Amer. 93, 5, 2764-2778. (Pubitemid 23143504)
6. BLAUERT, J. 1997. Spatial Hearing. The MIT Press, Cambridge, MA.
7. BLUMLEIN, A. D. 1958. British patent specification 394,325, 1931. J. Audio Eng. Soc. 6, 2.
8. DEL GALDO, G., PULKKI, V., KUECH, F., LAITINEN, M.-V., SCHULTZ-AMLING, R., AND KALLINGER, M. 2009. Efficient methods for highquality merging of spatial audio streams in directional audio coding. In Proceedings of the AES 126th Convention.
9. FURNESS, R. K. 1990. Ambisonics - An overview. In Proceedings of the AES 8th International Conference.
10. GOODWIN, M. M. AND JOT, J.-M. 2006. A frequency-domain framework for spatial audio coding based on universal spatial cues. In Proceedings of the 120th AES Convention. Paper 6751.
11. HERRE, J., KJÖRLING, K., BREEBAART, J., FALLER, C., DISCH, S., PURNHAGEN, H., KOPPENS, J., HILPERT, J., RODEN, J., OOMEN, W., ET AL. 2008. MPEG surround-the ISO/MPEG standard for efficient and compatible multichannel audio coding. J. Audio Eng. Soc. 56, 932-955.
12. HIRVONEN, T. 2007. Perceptual and modeling studies on spatial sound. Ph.D. dissertation, Helsinki University of Technology.
13. HIRVONEN, T., AHONEN, J., AND PULKKI, V. 2009. Perceptual compression methods for metadata in directional audio coding appliedto audiovisual teleconference. In Proceedings of the AES 126th Convention.
14. ITU-R BS.1116-1. 1997. Methods for the subjective assessment of small impairments in audio systems including multichannelsound systems. ITU.
15. ITU.ITU-R BS.1534-1. 2003. Method for the subjective assessment of intermediate quality level of coding systems. ITU.
16. JOT, J.-M., WALSH, M., AND PHILP, A. 2006. Binaural simulation of complex acoustic scenes for interactive audio. In Proceedingsof the AES 121st Convention.
17. KIRSZENSTEIN, J. 1984. An image source computer model for room acoustics analysis and electroacoustic simulation. Appl. Acoust.17, 4, 275-290. (Pubitemid 14601745)
18. LAITINEN, M.-V. AND PULKKI, V. 2009. Binaural reproduction for directional audio coding. In Proceedings of the IEEE Workshopon Applications of Signal Processing to Audio and Acoustics, IEEE, Los Alamitos, CA.
19. LAITINEN, M.-V. AND PULKKI, V. 2011. Converting 5.1 audio recordings to B-format for directional audio coding reproduction. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing.
20. LENTZ, T., SCHRÖDER, D., VORLANDER, M., AND ASSENMACHER, I. 2007. Virtual reality system with integrated sound field simulationand reproduction. EURASIP J. Appl. Signal Process. 1, 187-187.
21. MANOCHA, D., CALAMIA, P., LIN, M. C., SAVIOJA, L., AND TSINGOS, N. 2009. Interactive sound rendering. In ACM SIGGRAPH'09Courses. ACM, New York.
22. MOLLER, H., SORENSEN, M. F., HAMMERSHOI, D., AND JENSEN, C. B. 1995. Head-related transfer functions of human subjects. J. Audio Eng. Soc. 43, 5 (May), 300-321.
23. MOORE, B. C. J. 1982. An Introduction to the Psychology of Hearing. Academic Press.
24. MOORE, B. C. J. 1995. Hearing. Academic Press.
25. OPENAL. 2000. OpenAL: An open source 3D sound library. http://www.openal.org.
26. POTARD, G. AND BURNETT, I. 2004. Decorrelation techniques for the rendering of apparent sound source width in 3D audio displays. In Proceedings of the 7th International Conference on Digital Audio Effects.
27. PULKKI, V. 1997. Virtual source positioning using vector base amplitude panning. J. Audio Eng. Soc. 45, 6, 456-466.
28. PULKKI, V. 2001. Spatial sound generation and perception by amplitude panning techniques. Ph.D. dissertation, Helsinki Universityof Technology.PULKKI, V. 2007. Spatial sound reproduction with directional audio coding. J. Audio Eng. Soc. 55, 6, 503-516.
29. PULKKI, V. 2007. Spatial sound reproduction with directional audio coding. J. Audio Eng. Soc. 55, 6, 503-516. (Pubitemid 47039715)
30. PULKKI, V., LAITINEN, M.-V., AND ERKUT, C. 2009. Efficient spatial sound synthesis for virtual worlds. In Proceedings of the AES35th International Conference.
31. PULKKI, V., LOKKI, T., AND ROCCHESSO, D. 2011. Spatial effects. In DAFX: Digital Audio Effects 2nd Ed., U. Zoelzer Ed., Wiley.
32. RIECKE, B. E., VALJAMAE, A., AND SCHULTE-PELKUM, J. 2009. Moving sounds enhance the visually-induced self-motion illusion(circular vection) in virtual reality. ACM Trans. Appl. Percept. 6, 2, 7-27.
33. SANTALA, O. AND PULKKI, V. 2011. Directional perception of distributed sound sources. J. Acoust. Soc. Am. 129, 3, 1522-1530.
34. SAVIOJA, L., HUOPANIEMI, J., LOKKI, T., AND VAANANEN, R. 1999. Creating interactive virtual acoustic environments. J. Audio Eng. Soc. 47, 9, 675-705.
35. SEEBER, B., KERBER, S., AND HAFTER, E. 2010. A system to simulate and reproduce audio-visual environments for spatial hearingresearch. Hearing Res. 260, 1-2, 1-10.
36. TSINGOS, N., GALLO, E., AND DRETTAKIS, G. 2004. Perceptual audio rendering of complex virtual environments. In Proceedings ofthe SIGGRAPH 31st International Conference on Computer Graphics and Interactive Techniques.
37. VERRON, C., ARAMAKI, M., KRONLAND-MARTINET, R., AND PALLONE, G. 2010. A 3-D immersive synthesizer for environmental sounds.IEEE Trans. Audio, Speech, Lang. Process. 18, 6, 1550-1561.
38. VILKAMO, J., LOKKI, T., AND PULKKI, V. 2009. Directional audio coding: Virtual microphone based synthesis and subjective evaluation.J. Audio Eng. Soc. 57, 9, 709-724.