An interactive 3-D audio system with loudspeakers

IEEE Transactions on Multimedia

Volumn 13, Issue 5, 2011, Pages 844-855

  Song, Myung Suk ^a   Zhang, Cha ^b   Florencio, D ^b   Kang, Hong Goo ^a  

^a Yonsei University   (South Korea)

^b MICROSOFT RESEARCH   (United States)

Author keywords

3 D audio; Head tracking; loudspeaker; room modeling; spatial audio

Indexed keywords

3-D AUDIO; AUDIO SYNTHESIS; BINAURAL SYNTHESIS; CROSS-TALK CANCELLATION; HEAD MOVEMENTS; HEAD POSITION; HEAD TRACKERS; HEAD TRACKING; MODELING ERRORS; POOR PERFORMANCE; REVERBERANT ENVIRONMENT; SPATIAL AUDIO; SUBJECTIVE LISTENING TEST; SWEET SPOT; USERS' PERCEPTION;

AUDIO SYSTEMS; LOUDSPEAKERS; SENSITIVITY ANALYSIS; USER INTERFACES;

THREE DIMENSIONAL;

EID: 80052931795     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2011.2162581     Document Type: Article

References (35)

1. A. Kubota, A. Smolic, M. Magnor, M. Tanimoto, T. Chen, and C. Zhang, "Multi-view imaging and 3DTV, " Signal Process. Mag., special issue on Multi-View Imaging and 3DTV, vol. 24, no. 6, pp. 10-21, Nov. 2007.
2. D. Cooper and J. Bauck, "Prospects for transaural recording, " J. Audio Eng. Soc., vol. 37, pp. 3-19, 1989. (Pubitemid 20686220)
3. C. Kyriakakis, "Fundamental and technological limitations of immersive audio systems, " Proc. IEEE, vol. 86, no. 5, pp. 941-951, May 1998. (Pubitemid 128720233)
4. A. Berkhout, D. de Vries, and P. Vogel, "Acoustic control by wave field synthesis, " J. Acoust. Soc. Amer., vol. 93, pp. 2764-2778, 1993. (Pubitemid 23143504)
5. V. Pullki, "Spatial sound generation and perception by amplitude panning techniques, " Ph.D. dissertation, Helsinki Univ. Technol., Helsinki, Finland, 2001.
6. D. Malham and A. Myatt, "3-D sound spatialization using ambisonic techniques, " J. Comput. Music, vol. 19, no. 4, pp. 58-70, 1995.
7. V. Pullki, "Virtual sound source positioning using vector base amplitude panning, " J. Audio Eng. Soc., vol. 45, pp. 456-466, 1997.
8. A. Mouchtaris, J. Lim, T. Holman, and C. Kyriakakis, "Head-related transfer function synthesis for immersive audio, " in Proc. IEEE 2nd Workshop Multimedia Signal Processing, 1998, pp. 155-160.
9. J. Bauck and D. Cooper, "Generalized transaural stereo and applications, " J. Audio Eng. Soc., vol. 44, pp. 683-705, 1996.
10. P. Nelson, H. Hamada, and S. Elliott, "Adaptive inverse filters for stereophonic sound reproduction, " IEEE Trans. Signal Process., vol. 40, no. 7, pp. 1621-1632, Jul. 1992.
11. A. Mouchtaris, P. Reveliotis, and C. Kyriakakis, "Inverse filter design for immersive audio rendering over loudspeakers, " IEEE Trans. Multimedia, vol. 2, no. 2, pp. 77-87, Jun. 2000.
12. W. Gardner, "3-D audio using loudspeakers, " Ph.D. dissertation, Massachusetts Inst. Technol., Cambridge, 1997.
13. J. Lopez and A. Gonzalez, "3-D audio with dynamic tracking for multimedia environments, " in Proc. 2nd COST-G6 Workshop Digital Audio Effects, 1999.
14. S. Kim, D. Kong, and S. Jang, "Adaptive virtual surround sound rendering system for an arbitrary listening position, " J. Audio Eng. Soc., vol. 56, no. 4, pp. 243-254, 2008.
15. T. Lentz and G. Behler, "Dynamic crosstalk cancellation for binaural synthesis in virtual reality environments, " J. Audio Eng. Soc., vol. 54, no. 4, pp. 283-294, 2006. (Pubitemid 43732741)
16. P. Georgiou, A. Mouchtaris, I. Roumeliotis, and C. Kyriakakis, "Immersive sound rendering using laser-based tracking, " in Proc. 109th Conv. Audio Engineering Society, 2000.
17. T. Lentz and O. Schmitz, "Realisation of an adaptive cross-talk cancellation system for a moving listener, " in Proc. 21st Audio Engineering Society Conf. Architectural Acoustics and Sound Reinforcement, 2002.
18. C. Kyriakakis and T. Holman, "Immersive audio for the desktop, " in Proc. IEEE Int. Conf. Acoustics Speech and Signal Processing, 1998, vol. 6, pp. 3753-3756.
19. C.Kyriakakis and T. Holman, "Video-based head tracking for improvements in multichannel loudspeaker audio, " in Proc. 105th Conv. Audio Engineering Society, San Francisco, CA, 1998.
20. J. J. Lopez, A. Gonzalez, and F. O. Bustamante, "Measurement of cross-talk cancellation and equalization zones in 3-D sound reproduction under real listening conditions, " in Proc. Audio Engineering Society 16th Int. Conf., 1999.
21. Q. Cai, A. Sankaranarayanan, Q. Zhang, Z. Zhang, and Z. Liu, "Real time head pose tracking from multiple cameras with a generic model, " in Proc. IEEEWorkshop Analysis and Modeling of Faces and Gestures, 2010.
22. C. Zhang and P.Viola, "Multiple-instance pruning for learning efficient cascade detectors, " Proc. Neural Inf. Process. Syst., 2007.
23. Y. Zhou, L. Gu, and H. J. Zhang, "Bayesian tangent shape model: Estimating shape and pose parameters via Bayesian inference, " in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2003.
24. M. Song, C. Zhang, D. Florencio, and H.-G. Kang, "Personal 3D audio system with loudspeakers, " in Proc. IEEE Int. Workshop Hot Topics in 3D in Conjunction With the IEEE International Conference on Multimedia & Expo, 2010.
25. B. Gardner and K. Martin, HRTF Measurements of a KEMAR Dummy-Head Microphone, MIT Media Lab Perceptual Computing, Tech. Rep. 280, 1994. [Online]. Available: http://sound.media.mit. edu/KEMAR.html.
26. M. Song, C. Zhang, D. Florencio, and H.-G. Kang, "Enhancing loudspeaker- based 3D audio with room modeling, " in Proc. IEEE Int.Workshop Multimedia Signal Processing, 2010.
27. D. Ba, F. Ribeiro, C. Zhang, and D. Florencio, "L1 regularized room modeling with compact microphone arrays, " in Proc. Int. Conf. Acoustics Speech and Signal Processing, 2010.
28. D. Kimber, C. Chen, E. Rieffel, J. Shingu, and J. Vaughan, "Marking up a world: Visual markup for creating and manipulating virtual models, " in Proc. Int. Conf. Immersive Telecommunications, 2009.
29. F. Ribeiro, C. Zhang, D. Florencio, and D. Ba, "Using reverberation to improve range and elevation discrimination for small array sound source localization, " IEEE Trans. Audio, Speech, Lang. Process., vol. 18, no. 7, pp. 1781-1792, Sep. 2010.
30. F. Ribeiro, D. Ba, C. Zhang, and D. Florencio, "Turning enemies into friends: Using reflections to improve sound source localization, " in Proc. IEEE Int. Conf. Multimedia & Expo, 2010.
31. J. Lim and C. Kyriakakis, "Multirate adaptive filtering for immersive audio, " in Proc. Int. Conf. Acoustics Speech and Signal Processing, 2001.
32. F. E. Toole, "Loudspeaker measurements and their relationship to listener preferences, " J. Audio Eng. Soc., vol. 34, pp. 227-235, 1986.
33. J. Allen and D. Berkley, "Image method for efficiently simulating small-room acoustics, " J. Acoust. Soc. Amer., vol. 65, no. 4, pp. 943-950, 1979. (Pubitemid 9450497)
34. L. Beranek, "Concert and opera halls. How they sound, " J. Acoust. Soc. Amer., pp. 436-437, 1996.
35. K. Foo, M. Hawksford, and M. Hollier, "Three dimensional sound localisation with multiple loudspeakers using a pair-wise association paradigm with embedded HRTFs, " in Proc. 104th Conv. Audio Engineering Society, 1998.