Audio signal processing using graphics processing units

AES: Journal of the Audio Engineering Society

Volumn 59, Issue 1-2, 2011, Pages 3-19

  Savioja, Lauri ^a   Välimäki, Vesa ^a   Smith, Julius O ^b  

^a AALTO UNIVERSITY   (Finland)

^b STANFORD UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

GPU IMPLEMENTATION; GPU PROCESSING; GRAPHICS PROCESSING UNIT; GRAPHICS PROCESSING UNITS; INPUT AND OUTPUTS; INPUT BUFFERS; MASSIVELY PARALLEL COMPUTING; PERFORMANCE GAIN; POTENTIAL APPLICATIONS; REAL TIME; SAMPLE BUFFER; SAMPLING RATES; SINE-WAVE; TIME-DOMAIN CONVOLUTION;

COMPUTER GRAPHICS EQUIPMENT; FAST FOURIER TRANSFORMS; FIR FILTERS; PARALLEL ARCHITECTURES; PROGRAM PROCESSORS; SIGNAL PROCESSING;

AUDIO SIGNAL PROCESSING;

EID: 79952796265     PISSN: 15494950     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (76)

1. G. Moore, "Cramming More Components onto Integrated Circuits," Electronics, vol. 38, pp. 114-117 (1965).
2. G. Blake, R. Dreslinski, and T. Mudge, "A Survey of Multicore Processors," IEEE Signal Process. Mag., vol. 26, no. 6, pp. 26-37 (2009).
3. "From Voodoo to GeForce: The Awesome History of 3D Graphics," http://www.maximumpc.com/article/features/graphics-extravaganza-ultimate-gpu- retrospective (accessed 2010 Nov. 18, 2009).
4. E. Lindholm, M. Kilgard, and H. Moreton, "A User-Programmable Vertex Engine," in Proc. 28th Ann. Conf. on Computer Graphics and Interactive Techniques (SIGGRAPH '01) (Los Angeles, CA, 2001 Aug.).
5. "International Technology Roadmap for Semiconductors- System Drivers," http://www.itrs.net/Links/2007ITRS/2007-Chapters/2007- SystemDrivers.pdf (accessed 2010 Nov. 18, 2007).
6. NVIDIA Corp., "The Next Generation CUDA Architecture," http://www.nvidia.com/object/fermi- architecture.html (accessed 2010 Nov. 18).
7. N. Carr, J. Hall, and J. Hart, "The Ray Engine," in Proc. ACM SIGGRAPH/EUROGRAPHICS Conf. on Graphics Hardware, Eurographics Association (2002 Sept.), pp. 36-46.
8. V. Ma and M. McCool, "Low Latency Photon Mapping Using Block Hashing," in Proc. ACM SIGGRAPH/EUROGRAPHICS Conf. on Graphics Hardware, Eurographics Association (2002 Sept.), pp. 89-99.
9. E. Larsen and D. McAllister, "Fast Matrix Multiplies Using Graphics Hardware," in Proc. ACM/IEEE Conf. on Supercomputing (SC'01), (2001).
10. M. Rumpf and R. Strzodka, "Using Graphics Cards for Quantized FEM Computations," in Proc. IASTED Visualization Imaging and Image Processing Conf. (VIIP'01), (2001), pp. 193-202.
11. J. Owens, D. Luebke, N. Govindaraju, and M. Harris, "A Survey of General-Purpose Computation on Graphics Hardware," in Eurographics 2005, State of the Art Reports (2005 Sept.), pp. 21-51.
12. "GPGPU-General-Purpose Computation on Graphics Hardware," http://gpgpu.org (accessed 2010 Nov. 18).
13. NVIDIA Corp., "GPU Technology Conference," http://www.nvidia. com/object/gpu-technology- conference.html (accessed 2010 Nov. 18).
14. N. Tsingos., "Using Programmable Graphics Hardware for Auralization," in Proc. EAA Symp. on Auralization (Espoo, Finland, 2009 June).
15. N. Tsingos, "Using Programmable Graphics Hardware for Acoustics and Audio Rendering," presented at the 127th Convention of the Audio Engineering Society, (Abstracts), www.aes.org/events/127/127thWrapUp.pdf, (2009 Oct.), convention paper 7850.
16. S. Siltanen, T. Lokki, S. Kiminki, and L. Savioja, "The Room Acoustic Rendering Equation," J. Acoust. Soc. Am., vol. 122, pp. 1624-1635 (2007). (Pubitemid 47560524)
17. M. Jedrzejewski and K. Marasek, "Computation of Room Acoustics Using Programmable Video Hardware," in Proc. Int. Conf. on Computer Vision and Graphics (ICCVG2004) (Warsaw, Poland, 2004 Sept.), pp. 587-592.
18. N. Röber, U. Kaminski, and M. Masuch, "Ray Acoustics Using Computer Graphics Technology," in Proc. 10th Int. Conf. on Digital Audio Effects (DAFx-07) (Bordeaux, France, 2007 Sept.).
19. A. Chandak, C. Lauterbach, M. Taylor, Z. Ren, and D. Manocha, "AD-Frustum: Adaptive Frustum Tracing for Interactive Sound Propagation," IEEE Trans. Visualiz. Comput. Graph., vol. 14, pp. 1707-1722 (2008).
20. M. Taylor, A. Chandak, Z. Ren, C. Lauterbach, and D. Manocha, "Fast Edge-Diffraction for Sound Propagation in Complex Virtual Environments," in Proc. EAA Sympo. on Auralization. (Espoo, Finland, 2009 June).
21. M. Taylor, A. Chandak, L. Antani, and D. Manocha, "RESound: Interactive Sound Rendering for Dynamic Virtual Environments," in Proc. 17th Int. ACM Conf. on Multimedia (2009 July), pp. 1-10.
22. S. Van Duyne and J. Smith III, "The 2-D Digital Waveguide Mesh," in Proc. IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (New Paltz, NY, 1993 Oct.).
23. L. Savioja, T. Rinne, and T. Takala, "Simulation of Room Acoustics with a 3-D Finite Difference Mesh," in Proc. Int. Computer Music Conf. (Aarhus, Denmark, 1994 Sept.), pp. 463-466.
24. U. P. Svensson and U. Kristiansen, "Computational Modelling and Simulation of Acoustic Spaces," in Proc. AES 22nd Int. Conf. on Virtual, Synthetic and Entertainment Audio (Espoo, Finland, 2002 June 15-17), pp. 11-30.
25. N. Röber, M. Spindler, and M. Masuch, "Waveguide- Based Room Acoustics through Graphics Hardware," in Proc. Int. Computer Music Conf. (New Orleans, LA, 2006 Nov.).
26. L. Savioja, "Real-Time 3D Finite-Difference Time-Domain Simulation of Low- and Mid-Frequency Room Acoustics," in Proc. Int. Conf. on Digital Audio Effects (DAFx-10), (Graz, Austria, 2010).
27. T. Takahashi and T. Hamada, "GPU-Accelerated Boundary Element Method for Helmholtz' Equation in Three Dimensions," Int. J. Numer. Meth. in Eng., vol. 80, pp. 1295-1321 (2009).
28. N. Raghuvanshi, B. Lloyd, N. Govindaraju, and M. Lin, "Efficient Numerical Acoustic Simulation on Graphics Processors Using Adaptive Rectangular Decomposition," in Proc. EAA Symp. on Auralization (Espoo, Finland, 2009 June).
29. N. Raghuvanshi, R. Narain, and M. Lin, "Efficient and Accurate Sound Propagation Using Adaptive Rectangular Decomposition," IEEE Trans. Visualiz. and Comput. Graph., vol. 15, pp. 789-801 (2009).
30. N. Tsingos, C. Dachsbacher, and S. Lefebvre, "Instant Sound Scattering," in Proc. 18th Eurographics Symp. on Rendering (2007 June).
31. M. Rumpf and R. Strzodka, "Level Set Segmentation in Graphics Hardware," in Proc. IEEE Int. Conf. of Image Processing (ICIP'01), vol. 3 (2001), pp. 1103-1106. (Pubitemid 33067717)
32. F. Franchetti, M. Püschel, Y. Voronenko, S. Chellappa, and J. Moura, "Discrete Fourier Transform on Multicore," IEEE Signal Process. Mag., vol. 26, pp. 90- 102 (2009).
33. N. Govindaraju, B. Lloyd, Y. Dotsenko, B. Smith, and J. Manferdelli, "High Performance Discrete Fourier Transforms on Graphics Processors," in Proc. ACM/IEEE Conf. on Supercomputing (SC '08), (2008 Nov.).
34. GPUFFTW, "High Performance Power-of-Two FFT Library Using Graphics Processors," http://www.cs. unc.edu/;geom/GPUFFTW/(accessed 2010 Nov. 18).
35. S. Whalen, "Audio and the Graphics Processing Unit," http://www.node99.org/papers/gpuaudio.pdf (accessed 2010 Nov. 18, 2005).
36. F. Trebien and M. Oliveira, "Real-Time Audio Processing on the GPU," in ShaderX6-Advanced Rendering Techniques, Charles River Media (2008), pp. 583-604.
37. A. Smirnov and T. Chiueh, "Implementation of a FIR Filter on a GPU," Tech. Rep., Experimental Computer Systems Lab., Stony Brook University (2005).
38. J. Robelly, G. Cichon, H. Seidel, and G. Fettweis, "Implementation of Recursive Digital Filters into Vector SIMD DSP Architectures," in Proc. IEEE Int. Conf. on Acoustics, Speech, and Signal Processing (ICASSP '04), vol. 5 (2004 May), pp. 165-168.
39. F. Trebien and M. Oliveira, "Realistic Real-Time Sound Re-synthesis and Processing for Interactive Virtual Worlds," Visual Comput., no. 25, pp. 469-477 (2009).
40. E. Gallo and N. Tsingos, "Efficient 3D Audio Processing with the GPU," in Proc. ACM Workshop on General Purpose Computing on Graphics Processors (2004 Aug.).
41. B. Cowan and B. Kapralos, "Spatial Sound for Video Games and Virtual Environments Utilizing Real- Time GPU-Based Convolution," in Proc. 2008 Conf. on Future Play: Research, Play, Share (2008 Nov.).
42. B. Cowan and B. Kapralos, "Real-Time GPUBased Convolution: A Follow-Up," in Proc. ACM FuturePlay @ GDC Canada, Int. Conf. on the Future of Game Design and Technology (2009).
43. S. Siltanen, T. Lokki, and L. Savioja, "Frequency Domain Acoustic Radiance Transfer for Real-Time Auralization," Acta Acustica/Acustica, vol. 95, pp. 106- 117 (2009).
44. AcusticaAudio, "Nebula 3 VST Plugin," http://www.acustica- audio.com/(accessed 2010 Nov. 18).
45. LiquidSonics, "Reverberate LE and Filtrate LE," http://www.liquidsonics.com/home.htm (accessed 2010 Nov. 18).
46. Adobe Labs, "Pixel Bender," http://labs.adobe. com/technologies/pixelbenderplugin/(accessed 2010 Nov. 18).
47. K. Doel, D. Knott, and D. Pai, "Interactive Simulation of Complex Audiovisual Scenes," Presence: Teleoperators & Virtual Environm., vol. 13, pp. 99-111 (2004 Jan.). (Pubitemid 38604260)
48. C. Zheng and D. James, "Harmonic Fluids," ACM Trans. Graph., vol. 28 (Proc. of Siggraph 2009), (2009 Aug.).
49. W. Moss, H. Yeh, J. Hong, M. C Lin, and D. Manocha, "Sounding Liquids: Automatic Sound Synthesis from Fluid Simulation," Tech. Rep. TR09-012:1-7, University of North Carolina, (2009 Aug.).
50. Q. Zhang, L. Ye, and Z. Pan, "Physically-Based Sound Synthesis on GPUs," in Lecture Notes in Computer Science (Proc. 4th Int. Conf. on Entertainment Computing, ICEC 2005), LNCS 3711, pp. 328-333 (2005).
51. L. Seiler, D. Carmean, E. Sprangle, T. Forsyth, M. Abrash, P. Dubey, S. Junkins, A. Lake, J. Sugerman, R. Cavin, R. Espasa, E. Grochowski, T. Juan, and P. Hanrahan, "Larrabee: A Many-Core x86 Architecture for Visual Computing," ACM Trans. Graph., vol. 27 (Proc. of Siggraph 2008), (2008 Aug.).
52. I. Buck, T. Foley, D. Horn, J. Sugerman, K. Fatahalian, M. Houston, and P. Hanrahan, "Brook for GPUs: Stream Computing on Graphics Hardware," ACM Trans. Graph., vol. 23, no. 3 (2004).
53. Nvidia Corp., "NVIDIA CUDA C Programming Best Practices Guide," http://www.nvidia.com/object/cuda-develop.html (accessed 2010 Nov. 18).
54. Khronos Group, "OpenCL Overview," http://www.khronos.org/ opencl/(accessed 2010 Nov. 18).
55. Microsoft Corp., "Direct3D 11 Compute Shader- More Generality for Advanced Techniques," presented at GameFest, Microsoft Game Technology Conf., available at http://www.microsoft.com/(2008).
56. J. Loviscach, "GPU-Based Audio via the VGA Port," in Proc. SIGGRAPH '08, (Los Angeles, CA, 2008 Aug.).
57. T. Aila and S. Laine, "Understanding the Efficiency of Ray Traversal on GPUs," in Proc. High Performance Graphics (HPG'09), (New Orleans, LA, 2009 July).
58. G. Amdahl, "Validity of the Single Processor Approach to Achieving Large Scale Computing Capabilities," in Proc. AFIPS Spring Joint Computer Conf. (1967), pp. 483-485.
59. NVIDIA Corp., "CUFFT Library and User Guide," http://www.nvidia.com/object/cuda-develop. html (accessed 2010 Nov. 18).
60. NVIDIA Corp., "NVIDIA CUDA Programming Guide," (2009), pp. 1-147.
61. J. C. Risset, "Computer Music Experiments 1964-⋯," Computer Music J., vol. 9, pp. 11-18 (1985).
62. J. A. Moorer, "Signal Processing Aspects of Computer Music-A Survey," Computer Music J., vol. 1, pp. 4-37 (1977).
63. X. Serra, "Musical Sound Modeling with Sinusoids plus Noise," in, C. Roads, S. Pope, A. Picialli, and G. De Poli, Eds., Musical Signal Processing, (Swets & Zeitlinger, Lisse, The Netherlands, 1997 June), pp. 91- 122.
64. T. F. Quatieri and R. J. McAulay, "Audio Signal Processing Based on Sinusoidal Analysis/Synthesis," in Applications of DSP to Audio & Acoustics, M. Kahrs and K. Brandenburg, Eds. (Kluwer Academic, Boston/Dordrecht/London, 1998), pp. 343-416.
65. M. Bosi and R. E. Goldberg, Introduction to Digital Audio Coding and Standards (Kluwer Academic, Boston, MA, 2003).
66. S. Levine, "Audio Representations for Data Compression and Compressed Domain Processing," Ph.D. thesis, Electrical Engineering Dept. (CCRMA) Stanford University, Stanford, CA (1998 Dec.), http://ccrma.stanford. edu/;scottl/thesis.html.
67. J. Moorer, A. Chauveau, C. Abbott, P. Eastty, and J. Lawson, "The 4C Machine," Computer Music J., vol. 3, no. 3, pp. 16-24 (1979).
68. J. Snell, "Design of a Digital Oscillator which will Generate up to 256 Low-Distortion Sine Waves in Real Time," Computer Music J., vol. 1, no. 2, pp. 4-25 (1977).
69. F. De Bernardinis, R. Roncella, R. Saletti, P. Terreni, and G. Bertini, "An Efficient VLSI Architecture for Real-Time Additive Synthesis of Musical Signals," IEEE Trans. Very Large Scale Integration (VLSI) Sys., vol. 7, pp. 105-110 (1999 Mar.).
70. J. O. Smith III, "Viewpoints on the History of Digital Synthesis," in Proc. 1991 Int. Computer Music Conf. (Montreal, Canada, 1991), pp. 1-10, http://ccrma. stanford.edu/;jos/kna/.
71. L. Savioja, V. Välimäki, and J. O. Smith, "Real- Time Additive Synthesis with One Million Sinusoids Using a GPU," presented at the 128th Convention of the Audio Engineering Society, (Abstracts) www.aes.org/events/128/128thWrapUp.pdf, (May 2010), convention paper 7962.
72. F. R. Moore, "Table Lookup Noise for Sinusoidal Digital Oscillators," Computer Music J., vol. 1, no. 2, pp. 26-29 (1977).
73. J. Merimaa, T. Peltonen, and T. Lokki, "Concert Hall Impulse Responses-Pori, Finland," http://www. acoustics.hut.fi/projects/poririrs/ (accessed 2010 Nov. 18, 2005).
74. J. Pätynen, V. Pulkki, and T. Lokki, "Anechoic Recording System for Symphony Orchestra," Acta Acustica/Acustica, vol. 94, pp. 856-865 (2008 Jan.).
75. M. Frigo and S. Johnson, "FFTW," http://www. fftw.org/(accessed 2010 Nov. 18).
76. T. Ilmonen and T. Lokki, "Extreme Filters-Cache- Efficient Implementation of Long IIR and FIR Filters," IEEE Signal Process. Lett., vol. 13, pp. 401-404 (2006). (Pubitemid 43997197)