Spatial sound for video games and virtual environments utilizing real-time gpu-based convolution

ACM Future Play 2008 International Academic Conference on the Future of Game Design and Technology, Future Play: Research, Play, Share

Volumn , Issue , 2008, Pages 166-172

  Cowan, Brent ^a   Kapralos, Bill ^a  

^a UNIVERSITY OF ONTARIO INSTITUTE OF TECHNOLOGY   (Canada)

Author keywords

3D sound; Convolution; Game audio; GPU; Real time

Indexed keywords

3D SOUND; COMPUTATIONAL CAPACITY; COMPUTATIONALLY EFFICIENT; COMPUTER GRAPHICS HARDWARE; GAME AUDIO; GPU; GRAPHICS PROCESSING UNIT; IMAGE SYNTHESIS; INTERACTIVE GAMES; REAL-TIME; SOFTWARE-BASED; SPATIAL AUDIO; SPATIAL SOUND; TIME-DOMAIN CONVOLUTION; VIDEO GAME; VIRTUAL ENVIRONMENTS; VISUAL CUES;

AUDIO ACOUSTICS; COMPUTER GRAPHICS EQUIPMENT; CONVOLUTION; GAME THEORY; IMAGE CODING; INTERACTIVE COMPUTER GRAPHICS; METHOD OF MOMENTS; PROGRAM PROCESSORS; THREE DIMENSIONAL; THREE DIMENSIONAL COMPUTER GRAPHICS; TIME DOMAIN ANALYSIS; VIRTUAL REALITY;

COMPUTER HARDWARE;

EID: 70349324241     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1496984.1497012     Document Type: Conference Paper

References (32)

1. V. R. Algazi, R. O. Duda, D. M. Thompson, and C. Avendano. The CIPIC HRTF database. In 2001 IEEE Workshop on Applications of Signal Processing to Acoustics, pages 111{123, New Paltz, NY. USA, October 21-24 2001.
2. D. B. Anderson and M. A. Casey. The sound dimension. IEEE Spectrum, pages 46{50, March 1997.
3. R. Begault. 3-D Sound for Virtual Reality and Multimedia. Academic Press, MA. USA, 1994.
4. I. Buck, T. Foley, D. Horn, J. Sugerman, K. Fatahalian, M. Houston, and P. Hanrahan. Brook for GPUs: Stream computing on graphics hardware. ACM Transactions on Graphics, 23(3):777{786, 2004.
5. S. Carlile. Virtual Auditory Space: Generation and Application. R. G. Landes Company, Austin, TX. USA, 1996.
6. M. Cohen and E. Wenzel. The design of multidimensional sound interfaces. In W. Barfield and T. Furness, editors, Virtual Environments and Advanced Interface Design, chapter 8, pages 291{346. Oxford University Press Inc., New York, NY. USA, 1995.
7. B. Cowan and B. Kapralos. 1D GPU Convolution Code. http://faculty.uoit. ca/kapralos/gpuConv.html.
8. M. Ekman, F. Warg, and J. Nilsson. An in-depth look at computer perfromance growth. Computer Architecture News, 33(1):144{147, 1994.
9. O. Fialka and M. Cadik. FFT and convolution performance in image filtering on gpu. In Proceedings of the Conference on Information Visualization, pages 609{614, Washington, DC. USA, June 15-17 2006.
10. th IEEE International Symposium on Wearable Computers, 2002 (ISWC 2002), pages 83{89, Seattle, WA. USA, October 7-10 2002.
11. E. Gallos and N. Tsingos. Efficient 3D-audio processing with the GPU. In Proceedings of the ACM Workshop on General Purpose Computing on Graphics Processors, Los Angeles, CA. USA, August 7-8 2004.
12. W. G. Gardner. Efficient convolution without input-output delay. Journal of the Audio Engineering Scoiety, 43(3):127{136, 1995.
13. D. Geer. Taking the graphics processor beyond graphics. IEEE Compuer, pages 14{16, September 2005.
14. M Jedrzejewski. Computation of room acoustics on programmable video hardware. Master's thesis, Polish-Japanese Institute of Information Technology, Warsaw, Poland, 2004.
15. B. Kapralos, M. Jenkin, and E. Milios. Virtual audio systems. Presence: Teleoperators and Virtual Environments, 2008. To appear.
16. B. Kapralos and N. Mekuz. Application of dimensionality reduction techniques to HRTFs for interactive virtual environments. In Proceedings of the ACM Advancements in Computer Entertainment (ACE 2007), Salzburg, Austria, June 13-15 2007.
17. B. Kapralos and N. Mekuz. Dimensionality reduced HRTFs: A comparative study. In Proceedings of the ACM Advancements in Computer Entertainment (ACE 2008), Yokohama, Japan, December 3-5 2008.
18. D. J. Kistler and F. L. Wightman. A model of head-related transfer functions based on principle components analysis and minimum phase reconstruction. Journal of the Acoustical Society of America, 91(3):1637{1647, 1992.
19. M. Kleiner, D. I. Dalenback, and P. Svensson. Auralization - an overview. Journal of the Audio Engineering Society, 41(11):861{875, 1993.
20. D. Luebke and G. Humphreys. How GPUs work. IEEE Computer, pages 96{100, February 2007.
21. W. R. Mark, P. S. Glanville, K. Akeley, and M. J. Kilgard. Cg: a system for programming graphics hardware in a C-like language. In Proceedings of the ACM International Conference on Computer Graphics and Interactive Techniques SIGGRAPH 2003, pages 896{907, San Diego, CA. USA, July 27{31 2003.
22. K. Moreland and E. Angel. The FFT on the gpu. In Proceedings of the ACM SIGGRAPH / EUROGRAPHICS Conference on Graphics Hardware, pages 112 { 119, San Diego, CA. USA, July 26 - 27 2003.
23. J. D. Owens, D. Luebke, N. Govindaraju, M. Harris, J. Krüger, A. E. Lefohn, and T. J. Purcell. A survey of general-purpose computation on graphics hardware. Computer Graphics Forum, 26(1):80{113, 2007.
24. th International Conference on Digital Audio Effects, Bordeaux, France, September 10-15 2007.
25. N. Rober, M. Spindler, and M. Masuch. Waveguide-based room acoustics through graphics hardware. In Proceedings of the International Computer Music Conference 2006, New Orleans, LA. USA, November 6-11 2006.
26. R. Rost. OpenGL Shading Language. Addison-Wesley Professional, Boston, MA. USA, second edition, 2006.
27. S. T. Roweis and L. K. Saul. Nonlinear dimensionality reduction by locally linear embedding. Science, 290(5500):2323{2326, 2000.
28. R. D. Shilling and B. Shinn-Cunningham. Virtual auditory displays. In K. Stanney, editor, Handbook of Virtual Environment Technology, pages 65{92. Lawrence Erlbaum Associates, Mahwah, NJ. USA, 2002.
29. U. P. Svensson and U. R. Kristiansen. Computational modeling and simulation of acoustic spaces. In Proceedings of the 22nd International Conference on Virtual, Synthetic and Entertainment Audio, pages 11{30, Espoo, Finland, 2002.
30. J. B. Tenenbaum, V. de Silva, and J. C. Langford. A global geometric framework for nonlinear dimensionality reduction. Science, 290(5500):2319{2323, 2000.
31. N. Tsingos and J. D. Gascuel. Soundtracks for computer animation: Sound rendering in dynamic environments with occlusion. In Proceedings of Graphics Interface '97, pages 9{16, Kelowna, BC. Canada., May 21-23, 1997.
32. R. Yang and G. Welch. Fast image segmentation and smoothing using commodity graphics hardware. Journal of Graphics Tools, 7(4):91{100, 2003.