Using programmable graphics hardware for acoustics and audio rendering

127th Audio Engineering Society Convention 2009

Volumn 1, Issue , 2009, Pages 658-673

  Tsingos, Nicolas ^a  

^a DOLBY LABORATORIES   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

3D AUDIO; AUDIO RENDERING; AURALIZATIONS; GENERAL PURPOSE PROCESSORS; GRAPHICS ACCELERATORS; MASSIVE PARALLELISM; MULTI-CORE PROCESSOR; NUMERICAL ACOUSTICS; PERFORMANCE IMPROVEMENTS; PROCESSING CAPABILITY; PROGRAMMABILITY; PROGRAMMABLE GRAPHICS HARDWARES; SOUND SCATTERING; SOUND SYNTHESIS;

AUDIO SIGNAL PROCESSING; SOUND REPRODUCTION; VIRTUAL REALITY;

PROGRAM PROCESSORS;

EID: 84866030020     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (83)

1. Magnus Ekman, Fredrik Warg, and Jim Nilsson, "An in-depth look at computer performance growth," SIGARCH Comput. Archit. News, vol. 33, no. 1, pp. 144-147, 2005.
2. D. Geer, "Taking the graphics processor beyond graphics," Computer, vol. 38, no. 9, pp. 14-16, Sept. 2005.
3. Avi Bleiweiss, "GPU accelerated pathfinding," in GH '08: Proceedings of the 23rd ACM SIGGRAPH/EUROGRAPHICS symposium on Graphics hardware, Aire-la-Ville, Switzerland, Switzerland, 2008, pp. 65-74, Eurographics Association.
4. "GPGPU - General-Purpose Computation on Graphics Hardware," Available at http://www.gpgpu.org, accessed May 15, 2009.
5. "GPGPU - Tutorial and Courses.," Available at http://gpgpu.org/tag/tutorials-courses, Accessed May 15, 2009.
6. John D. Owens, David Luebke, Naga Govin-daraju, Mark Harris, Jens Krger, Aaron E. Lefohn, and Timothy J. Purcell, "A survey of general-purpose computation on graphics hardware," Computer Graphics Forum, vol. 26, no. 1, pp. 80-113, 2007.
7. M. Pharr, Ed., GPU Gems 2: Programming Techniques, Tips and Tricks for Real-Time Graphics, Part IV: General-Purpose Computation on GPUS: A Primer, Addison-Wesley Professional, 2005, Available at http://http.developer.nvidia. com/GPUGems2/gpugems2part04.html.
8. P. Lapsley, J. Bier, A. Shoham, and E.A. Lee, DSP Processor Fundamentals, IEEE Press, 1997.
9. J. Eyre and J. Bier, "The evolution of DSP processors," IEEE Signal Processing Magazine, 2000, See also http://www.bdti.com/.
10. Durand R. Begault, 3D Sound for Virtual Reality and Multimedia, Academic Press Professional, 1994.
11. L. Savioja, J. Huopaniemi, T. Lokki, and R. Väanänen, "Creating interactive virtual acoustic environments," J. Audio Eng. Soc., vol. 47, no. 9, pp. 675-705, Sept. 1999.
12. D. Shreiner, M. Woo, J. Neider, and T. Davis, OpenGL Programming Guide: The Official Guide to Learning OpenGL, Version 2.1 (6th Edition), Addison-Wesley, 2007.
13. David Luebke and Greg Humphreys, "How GPUs Work," Computer, vol. 40, no. 2, pp. 96-100, Feb. 2007.
14. R. Rost, OpenGL(R) Shading Language (2nd Edition), Addison-Wesley, 2006.
15. William R. Mark, R. Steven Glanville, Kurt Akeley, and Mark J. Kilgard, "Cg: a system for programming graphics hardware in a C-like language," in SIGGRAPH '03: ACM SIGGRAPH 2003 Papers, New York, NY, USA, 2003, pp. 896-907, ACM.
16. Randima Fernando and Mark J. Kilgard, The Cg Tutorial: The Definitive Guide to Programmable Real-Time Graphics, Addison-Wesley Professional, 2003.
17. "Nvidia CUDA," Available at http://www.nvidia.com/cuda, accessed May 15, 2009.
18. I. Buck and T. Purcell, GPU Gems: Programming Techniques, Tips and Tricks for Real-Time Graphics. Chapter 37: A Toolkit for Computation on GPUs, Addison-Wesley Professional, 2004, Available at http://http.developer.nvidia. com/GPUGems/gpugemsch37.html.
19. Ian Buck, Tim Foley, Daniel Horn, Jeremy Sugerman, Kayvon Fatahalian, Mike Houston, and Pat Hanrahan, "Brook for GPUs: stream computing on graphics hardware," ACM Trans. Graph., vol. 23, no. 3, pp. 777-786, 2004.
20. John Owens, GPU Gems 2: Programming Techniques, Tips and Tricks for RealTime Graphics. Chapter 29: Streaming Architectures and Technology Trends, Addison-Wesley Professional, 2005, Available at http://developer.nvidia.com/ object/gpugems-2-home.html.
21. Kenneth Moreland and Edward Angel, "The FFT on a GPU," in HWWS '03: Proceedings of the ACM SIGGRAPH/EUROGRAPHICS conference on Graphics hardware, Aire-la-Ville, Switzerland, Switzerland, 2003, pp. 112-119, Eurographics Association.
22. Jens Krüger and Rüdiger Westermann, "Linear algebra operators for gpu implementation of numerical algorithms," in SIGGRAPH '03: ACM SIGGRAPH 2003 Papers, New York, NY, USA, 2003, pp. 908-916, ACM.
23. "GPUmat: A GPU toolbox for MATLAB," Available at http://gp-you.org/, accessed May 15, 2009.
24. "GPUFFTW: High Performance Power-of-two FFT library using graphics processors," Available at http://gamma.cs.unc.edu/GPUFFTW/, accessed May 15, 2009.
25. Naga K. Govindaraju and Dinesh Manocha, "Cache-efficient numerical algorithms using graphics hardware," Parallel Comput., vol. 33, no. 10-11, pp. 663-684, 2007.
26. Naga K. Govindaraju, Scott Larsen, Jim Gray, and Dinesh Manocha, "A memory model for scientific algorithms on graphics processors," in SC '06: Proceedings of the 2006 ACM/IEEE conference on Supercomputing, New York, NY, USA, 2006, p. 89, ACM.
27. S. Whalen, "Audio and the Graphics Processing Unit," Available at http://www.node99.org/papers/gpuaudio.pdf, accessed May 15, 2009.
28. E. Gallo and N. Tsingos, "Efficient 3D audio processing with the GPU," in Proc. ACM Workshop on General Purpose Computing on Graphics Processors (poster), Los Angeles, Aug. 2004, http://www-sop.inria.fr/reves/ projects/GPUAudio/.
29. LiquidSonics, "Reverberate LE GPU Edition," Available at http://www.liquidsonics.com/software.htm, accessed May 15, 2009.
30. Nils Schneider, "VST Plugin: Convolution Reverb on NVidia GPUs," Available at http://www.nilsschneider.de, accessed May 15, 2009.
31. Acustica Audio, "Nebula 3 VST Plugin," Available at http://www.acusticaudio.net/, accessed May 15, 2009.
32. "Adobe PixelBender API," Available at http://labs.adobe.com/ technologies/pixelbender, accessed May 15, 2009.
33. J. Blauert, Spatial Hearing: The Psychophysics of Human Sound Localization, M.I.T. Press, Cambridge, MA, 1997.
34. A. Smirnov and T. Chiueh, "An Implementation of a FIR Filter on a GPU," Available at http://research.alexeysmirnov.name/index.php?area= gr&proj=fog, accessed May 15, 2009.
35. B. Cowan and B. Kapralos, "Real-time GPU-base convolution: A follow-up," in Proc. of the FuturePlay @ GDC Canada Intl. Conf. on the Future of Game Design and Technology, May 12-13 2009.
36. Brent Cowan and Bill Kapralos, "Spatial sound for video games and virtual environments utilizing real-time GPU-based convolution," in Future Play '08: Proceedings of the 2008 Conference on Future Play, New York, NY, USA, 2008, pp. 166-172, ACM.
37. F. Trebien and M.M. Oliveira, "Realistic realtime sound re-synthesis and processing for interactive virtual worlds," The Visual Computer, vol. 25, no. 5-7, pp. 469-477, May 2009.
38. F. Trebien and M.M. Oliveira, Real-time Audio Processing on the GPU, pp. 583-604, Charles River Media, 2008.
39. Q. Zhang, L. Ye, and Z. Pan, "Physically-based sound synthesis on GPUs," in Proc. of the 4th Intl. Conf. on Entertainment Computing, Sept. 19-21 2007.
40. Christoph von Tycowicz and Jörn Loviscach, "A malleable drum," in SIGGRAPH '08: ACM SIGGRAPH 2008 posters, New York, NY, USA, 2008, pp. 1-1, ACM.
41. N. Röber, M. Spindler, and M. Masuch, "Waveguide-based Room Acoustics through Graphics Hardware," in Proc. Intl. Computer Music Conf. (ICMC), Nov. 6-11, 2006.
42. N. Raghuvanshi, B. Lloyd, and M.C. Lin, "Efficient Numerical Acoustic Simulation on Graphics Processors Using Adaptive Rectangular Decomposition," in Proc. EAA Symp. on Aural-ization, June 15-17, 2009.
43. Nikunj Raghuvanshi, Rahul Narain, and Ming C. Lin, "Efficient and accurate sound propagation using adaptive rectangular decomposition," IEEE Transactions on Visualization and Computer Graphics, vol. 99, no. 2, 5555.
44. Paulius Micikevicius, "3D finite difference computation on GPUs using CUDA," in GPGPU-2: Proceedings of 2nd Workshop on General Purpose Processing on Graphics Processing Units, New York, NY, USA, 2009, pp. 79-84, ACM.
45. Samuel Siltanen, Tapio Lokki, and Lauri Savioja, "Frequency domain acoustic radiance transfer for real-time auralization," Acta Acustica united with Acustica, vol. 95, pp. 106-117(12), January/February 2009.
46. Nathan A. Carr, Jesse D. Hall, and John C. Hart, "GPU algorithms for radiosity and subsurface scattering," in HWWS '03: Proceedings of the ACM SIGGRAPH/EUROGRAPHICS conference on Graphics hardware, Aire-la-Ville, Switzerland, Switzerland, 2003, pp. 51-59, Eurographics Association.
47. Carsten Dachsbacher, Marc Stamminger, George Drettakis, and Frédo Durand, "Implicit visibility and antiradiance for interactive global illumination," in SIGGRAPH '07: ACM SIGGRAPH 2007 papers, New York, NY, USA, 2007, p. 61, ACM.
48. Jaakko Lehtinen, Matthias Zwicker, Emmanuel Turquin, Janne Kontkanen, Frédo Durand, François Sillion, and Timo Aila, "A meshless hierarchical representation for light transport," ACM Trans. Graph., vol. 27, no. 3, 2008.
49. Timothy J. Purcell, Ian Buck, William R. Mark, and Pat Hanrahan, "Ray tracing on programmable graphics hardware," ACM Transactions on Graphics, vol. 21, no. 3, pp. 703-712, July 2002, ISSN 0730-0301 (Proceedings of ACM SIGGRAPH 2002).
50. N. Röber, U. Kaminski, and M. Masuch, "Rayacoustics using Computer Graphics Technology," in Proc. 10th Intl. Conf. on Digital Audio Effects (DAFx), Sep. 10-15, 2007.
51. M. Jedrzejewski and K. Marasek, "Computation of room acoustics using programmable video hardware," in Proc. Computer Vision and Graphics International Conference, IC-CVG 2004, Warsaw, Poland, September 2004.
52. A. Chandak, C. Lauterbach, M. Taylor, Z. Ren, and D. Manocha, "AD-Frustum: Adaptive Frustum Tracing for Interactive Sound Propagation," Visualization and Computer Graphics, IEEE Transactions on, vol. 14, no. 6, pp. 1707-1722, Nov.-Dec. 2008.
53. Nicolas Tsingos and Jean-Dominique Gascuel, "Soundtracks for computer animation: sound rendering in dynamic environments with occlusions," in Proc. of Graphics Interface'97, May 1997, pp. 9-16.
54. B. Cowan and B. Kapralos, "Real-time acoustical diffraction modeling using the GPU," in Proc. of the 10th Western Pacific Acoustics Conf., Sept. 21-23 2009.
55. Nicolas Tsingos and Jean-Dominique Gascuel, "Fast rendering of sound occlusion and diffraction effects for virtual acoustic environments," in Proc. 104th Audio Engineering Society Convention, preprint 4699, Amsterdam, Netherlands, May 1998.
56. Nicolas Tsingos, Carsten Dachsbacher, Sylvain Lefebvre, and Matteo Dellepiane, "Instant sound scattering," in Rendering Techniques (Proc. of the Eurographics Symposium on Rendering), 2007.
57. C. Dachsbacher and M. Stamminger, "Reflective shadow map," Proceedings of I3D'05, 2005.
58. S. Siltanen, "Geometry reduction in room acoustics modeling," Master Thesis, Helsinki University Of Technology, Department of Computer Science Telecommunications Software and Multimedia Laboratory, September 2005.
59. L.M. Wang, J. Rathsam, and S.R. Ryherd, "Interactions of model detail level and scattering coefficients in room acoustic computer simulation," Intl. Symp. on Room Acoustics, a satelite symposium of ICA, Kyoto, Japan, 2004.
60. C. Joslin and N. Magnenat-Thalmann, "Significant facet retreival for real-time 3D sound rendering in complex virtual environments," Proc. of VRTST 2003, October 2003.
61. Robert L. Cook, Loren Carpenter, and Edwin Catmull, "The Reyes image rendering architecture," SIGGRAPH Comput. Graph., vol. 21, no. 4, pp. 95-102, 1987.
62. Jonathan Cohen, Marc Olano, and Dinesh Manocha, "Appearance- preserving simplification," in SIGGRAPH '98: Proceedings of the 25th annual conference on Computer graphics and interactive techniques, New York, NY, USA, 1998, pp. 115-122, ACM Press.
63. Nicolas Tsingos, Carsten Dachsbacher, Sylvain Lefebvre, and Matteo Dellepiane, "Extending geometrical acoustics to highly detailed architectural environments," in 19th Intl. Congress on Acoustics, sep 2007.
64. J. Hirche, A. Ehlert, S. Guthe, and M. Doggett, "Hardware accelerated per-pixel displacement mapping," Proc. of Graphics Interface'04. Canadian Human-Computer Communications Society, pp. 153-158, 2004.
65. Lionel Baboud and Xavier Décoret, "Rendering geometry with relief textures," in Graphics Interface '06, 2006.
66. U. P. Svensson, R. I. Fred, and J. Vanderkooy, "An analytic secondary source model of edge diffraction impulse responses," J. Acoust. Soc. Am., vol. 106, pp. 2331-2344, 1999.
67. U. P. Svensson, P. Calamia, and S. Nakanishi, "Frequency-domain edge diffraction for finite and infinite edges," Acta Acustica united with Acustica, vol. 95, no. 3, 2009.
68. E. Wenzel, M. Arruda, D. Kistler, and F. Wightman, "Localization using non-individualized head-related transfer functions," J. Acoustical Soc. Am., vol. 94, no. 1, pp. 111-123, July 1993.
69. D. Begault, E. Wenzel, and M. Anderson, "Direct comparison of the impact of head-tracking, reverberation, and individualized head-related transfer functions on the spatial perception of a virtual speech source," J. Audio Eng. Soc., vol. 49, no. 10, pp. 904-916, 2001.
70. J.C. Middlebrooks, E.A. Macpherson, and Z.A. Onsan, "Psychophysical customization of directional transfer functions for virtual sound localization," Journal Acoustical Soc. Am., vol. 108, no. 6, pp. 3088-3091, 2000.
71. Y. Kahana and P.A. Nelson, "Numerical modelling of the spatial acoustic response of the human pinna," Journal of Sound and Vibration, vol. 292, no. 1-2, pp. 148-178, Apr. 2006.
72. B. Katz, "Boundary element method calculation of individual head-related transfer function. part I: Rigid model calculation," Journal Acoustical Soc. Am., vol. 110, no. 5, pp. 2440-2448, 2001.
73. Matteo Dellepiane, Nico Pietroni, Nicolas Tsingos, Manuel Asselot, and Roberto Scopigno, "Reconstructing head models from photographs for individualized 3D-audio processing," in Computer Graphics Forum (Special Issue -Proc. Pacific Graphics) 27(7), 2008.
74. Jörn Loviscach, "GPU-based audio via the VGA port," in SIGGRAPH '08: ACM SIG-GRAPH 2008 posters, New York, NY, USA, 2008, pp. 1-1, ACM.
75. Brian Santo and Sally Adee, "Multi-core made simpler," IEEE Spectrum, Jan. 2009, Available at http://www.spectrum.ieee.org/jan09/7129.
76. Larry Seiler, Doug Carmean, Eric Sprangle, Tom Forsyth, Michael Abrash, Pradeep Dubey, Stephen Junkins, Adam Lake, Jeremy Sugerman, Robert Cavin, Roger Espasa, Ed Grochowski, Toni Juan, and Pat Hanrahan, "Larrabee: a many-core x86 architecture for visual computing," ACM Trans. Graph., vol. 27, no. 3, pp. 1-15, 2008.
77. M. Pharr, A. Lefohn, C. Kolb, P. Lalonde, T. Foley, and G. Berry, "Programmable Graphics - The Future of Interactive Rendering," Available at http://www.cerlsoundgroup.org/RealTimeMorph/, accessed March 08, 2006.
78. A.J. Berkhout, D. de Vries, and P. Vogel, "Acoustic control by wave field synthesis," vol. 93, no. 5, pp. 2764-2778, may 1993.
79. Adam O'Donovan, Ramani Duraiswami, and Nail A. Gumerov, "Real time capture of audio images and their use with video," Oct. 2007, pp. 10-13.
80. M. Monks, B.M. Oh, and J. Dorsey, "Audioptimization: Goal based acoustic design," IEEE Computer Graphics & Applications, pp. 76-91, May 2000.
81. Patrick Cardinal, Pierre Dumouchel, Gilles Boulianne, and Michel Comeau, "GPU Accelerated Acoustic Likelihood Computations," in Proc. of INTERSPEECH, 2008.
82. Paul R. Dixon and Tasuku Oonishia and Sadaoki Furuia, "Harnessing graphics processors for the fast computation of acoustic likelihoods in speech recognition," Computer Speech & Language, vol. 23, no. 4, pp. 510-526, Oct. 2009.
83. Jike Chong, Youngmin Yi, Arlo Faria, Nadathur Rajagopalan Satish, and Kurt Keutzer, "Data-parallel large vocabulary continuous speech recognition on graphics processors," Tech. Rep. UCB/EECS-2008-69, EECS Department, University of California, Berkeley, May 2008.