Efficient utilization of SIMD extensions

Proceedings of the IEEE

Volumn 93, Issue 2, 2005, Pages 409-424

  Franchetti, Franz ^a   Kral, Stefan ^a   Lorenz, Juergen ^a   Ueberhuber, Christoph W ^a  

^a VIENNA UNIVERSITY OF TECHNOLOGY   (Austria)

Author keywords

Automatic vectorization; Digital signal processing (DSP); Fast fourier transform (FFT); Multiple data (SIMD); Short vector single instruction; Symbolic vectorization

Indexed keywords

COMPUTER OPERATING SYSTEMS; DATA STORAGE EQUIPMENT; DIGITAL SIGNAL PROCESSING; FAST FOURIER TRANSFORMS; PERFORMANCE; PROGRAM PROCESSORS; VECTORS;

AUTOMATIC VECTORIZATION; MULTIPLE DATA; SHORT VECTOR SINGLE INSTRUCTION; SYMBOLIC VECTORIZATION;

PROGRAM COMPILERS;

EID: 19344363982     PISSN: 00189219     EISSN: None     Source Type: Journal    
DOI: 10.1109/JPROC.2004.840491     Document Type: Conference Paper

References (54)

1. D. Aberdeen and J. Baxter, "EMMERALD: a fast matrix-matrix multiply using Intel's SSE instructions," Concurrency Comput. Practice Exper., vol. 13, no. 2, pp. 103-119, 2001.
2. A. V. Aho, R. Sethi, and J. D. Ullman, Compilers: Principles, Techniques, and Tools. Reading, MA: Addison-Wesley, 1986.
3. G. Almasi et al., "An overview of the BlueGene/L system software organization," in Proc. Euro-Par'03 Conf. Parallel and Distributed Computing, pp. 147-159.
4. AMD Core Math Library (ACML) Manual, Advanced Micro Devices Corp., Sunnyvale, CA, 2000.
5. ANSI, "ISO/IEC 9899:1999(E), Programming Languages - C," American National Standard Institute (ANSI), New York, 1999.
6. Apple Computer Inc. (2001) vDSP Library. [Online]. Available: http://developer.apple.com/tml
7. D. F. Bacon, S. L. Graham, and O. J. Sharp, "Compiler transformations for high-performance computing," ACM Comput. Surv., vol. 26, pp. 345-420, 1994.
8. L. A. Belady, "A study of replacement algorithms for virtual storage computers," IBM Syst. J., vol. 5, no. 2, pp. 78-101, July 1966.
9. J. Bilmes, K. Asanovic, C. W. Chin, and J. Demmel, "Optimizing matrix multiply using PHIPAC: A portable, high-performance, ANSI C coding methodology," in Proc. Int. Conf. Supercomputing, 1997, pp. 340-347.
10. Codeplay Corp. (2002) VECTOR C. [Online]. Available: http://www.codeplay. com
11. D. Chaver, C. Tenllado, L. Pinjuel, M. Prieto, and F. Tirado et al., "Wavelet transform for large scale image processing on modern microprocessors," in Lecture Notes in Computer Science, VECPAR 2002, J. M. L. M. Palma et al., Eds. Heidelberg, Germany: Springer-Verlag, 2003, vol. 2565, pp. 549-562.
12. R. Crandall and J. Klivington, "Supercomputer-Style FFT Library for the Apple G4," Advanced Comput. Group, Apple Computer Inc., 2002.
13. J. Demmel, J. Dongarra, V. Eijkhout, and K. Yelick, "Automatic performance tuning for large scale scientific applications," Proc. IEEE, vol. 93, no. 2, pp. 293-312, Feb. 2005.
14. R. J. Fisher and H. G. Dietz, "The SCC compiler: SWARing at MMX and 3DNow," in Proc. 12th Annu. Workshop Languages and Compilers for Parallel Computing, L. Carter and J. Ferrante, Eds., 2000, pp. 399-414.
15. _, "Compiling for SIMD within a register," in Proc. 11th Annu. Workshop Languages and Compilers for Parallel Computing, S. Chatterjee, Ed., 1999, pp. 290-304.
16. F. Franchetti, "A portable short vector version of FFTW," in Proc. 4th IMACS Symp. Mathematical Modeling (MATHMOD 2003), vol. 2, pp. 1539-1548.
17. _, "Performance portable short vector transforms," Ph.D. dissertation, Inst. Appl. Math. Numer. Anal., Vienna Univ. Technol., Vienna, Austria, 2003.
18. F. Franchetti, H. Karner, S. Kral, and C. W. Ueberhuber, "Architecture independent short vector FFTs," in Proc. Int. Conf. Acoustics, Speech, and Signal Processing, vol. 2, 2001, pp. 1109-1112.
19. F. Franchetti and M. Püschel, "A SIMD vectorizing compiler for digital signal processing algorithms," in Proc. Int. Parallel and Distributed Processing Symp., 2002, pp. 20-26.
20. _, "Short vector code generation and adaptation for DSP algorithms," in Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing (ICASSP'03), vol. 2, pp. 537-540.
21. _, "Short vector code generation for the discrete Fourier transform," in Proc. 17th Int. Parallel and Distributed Processing Symp. (IPDPS'03), pp. 22-26.
22. M. Frigo, "A fast Fourier transform compiler," in Proc. ACM SIGPLAN '99 Conf. Programming Language Design and Implementation, pp. 169-180.
23. M. Frigo and S. G. Johnson, "FFTW: An adaptive software architecture for the FFT," in Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing (ICASSP '98), vol. 3, pp. 1381-1384.
24. _, "The design and implementation of FFTW3," Proc. IEEE, vol. 93, no. 2, pp. 216-231, Feb. 2005.
25. J. Guo, M. Garzarán, and D. Padua, "The power of Belady's algorithm in register allocation for long basic blocks," in Lecture Notes in Computer Science, Languages and Compilers for Parallel Computing. Heidelberg, Germany: Springer-Verlag, 2004, vol. 2958, pp. 374-390.
26. Intel Corp. (1999) Split radix fast Fourier transform using streaming SIMD extensions (AP-808). [Online]. Available: http://developer.intel.com/ software/products/itc/strmsimd/808down.htm
27. _, (2002) Intel C/C++ compiler user's guide. [Online], Available: http://www.ncsa.uiuc.edu/UserInfo/Resources/Software/Intel/Compilers/8.0/c_ug/ index.htm
28. _, (2002) Math kernel library. [Online]. Available: http://www.intel.com/ software/products/mkl
29. J. Johnson, R. W. Johnson, D. Rodriguez, and R. Tolimieri, "A methodology for designing, modifying, and implementing Fourier transform algorithms on various architectures," Circuits Syst. Signal Process., vol. 9, no. 4, pp. 449-500, 1990.
30. N. P. Jouppi and D. W. Wall, "Available instruction-level parallelism for superscalar and superpipelined machines," Digital Western Res. Lab., Palo Alto, CA, WRL Res. Rep. 7, 1989.
31. S. Kral. (2003) The FFTW-GEL Web Page. [Online]. Available: http://www.complang.tuwien.ac.at/skral/fftwgel
32. S. Kral, F. Franchetti, J. Lorenz, and C. Ueberhuber, "SIMD vectorization of straight line FFT code," in Proc. Euro-Par'03 Conf. Parallel and Distributed Computing, pp. 251-260.
33. _, "FFT compiler techniques," in Proc. 13th Int. Conf. Compiler Construction, 2004, pp. 217-231.
34. S. Lamson. (1995) SCIPORT. [Online]. Available: http://www.netlib.org/ scilib/
35. S. Larsen and S. Amarasinghe, "Exploiting supenvord level parallelism with multimedia instruction sets," ACM SIGPLAN Notices, vol. 35, no. 5, pp. 145-156, 2000.
36. R. Leupers and S. Bashford, "Graph-based code selection techniques for embedded processors," ACM Trans. Design Autom. Electron. Syst., vol. 5, no. 4, pp. 794-814, 2000.
37. J. Lorenz, "Automatic SIMD vectorization," Ph. D. dissertation, Inst. Appl. Math. Numer. Anal., Vienna Univ. Technol., Vienna, Austria, 2004.
38. M. Lorenz, L. Wehmeyer, and T. Draeger, "Energy aware compilation for DSP's with SIMD instructions," in Proc. 2002 Joint Conf. Languages, Compilers, and Tools for Embedded Systems and Software and Compilers for Embedded Systems (LCTES'02-SCOPES'02), pp. 94-101.
39. M. Püschel, J. M. F. Moura, J. Johnson, D. Padua, M. Veloso, B. Singer, J. Xiong, F. Franchetti, A. Gacic, Y. Voronenko, K. Chen, R. W. Johnson, and N. Rizzolo, "SPIRAL: code generation for DSP transforms," Proc. IEEE, vol. 93, no. 2, pp. 232-275, Feb. 2005.
40. S. S. Muchniek, Advanced Compiler Design and Implementation. San Francisco, CA: Morgan Kaufmann, 1997.
41. K. Nadehara, T. Miyazaki, and I. Kuroda, "Radix-4 FFT implementation using SIMD multi-media instructions," in Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing (ICASSP '99), pp. 2131-2135.
42. I. Nicholson. (2002) libSIMD. [Online]. Available: http://libsimd. sourceforge.net
43. M. Püschel, B. Singer, J. Xiong, J. M. F. Moura, J. Johnson, D. Padua, M. Veloso, and R. W. Johnson, "SPIRAL: A generator for platform - adapted libraries of signal processing algorithms," J. High Perform. Comput. Appl. (Special Issue on Automatic Performance Tuning), vol. 18, pp. 21-45, 2004.
44. G. Ren, P. Wu, and D. A. Padua, "A preliminary study on the vectorization of multimedia applications for multimedia extensions," in Proc. Int. Workshop Languages and Compilers for Parallel Computing, 2003, pp. 420-435.
45. P. Rodriguez, "A radix-2 FFT algorithm for modern single instruction multiple data (SIMD) architectures," in Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing (ICASSP '02), vol. 3, 2002, pp. III-3220-III-3223.
46. N. Sreraman and R. Govindarajan, "A vectorizing compiler for multimedia extensions," Int. J. Parallel Program., vol. 28, no. 4, pp. 363-400, 2000.
47. Y. Srikant and P. Shankar, The Compiler Design Handbook. Boca Raton, FL: CRC, 2003.
48. P. N. Swarztrauber, "FFT algorithms for vector computers," Parallel Comput., vol. 1, pp. 45-63, 1984.
49. C. F. Van Loan, Computational Frameworks for the Fast Fourier Transform, ser. Frontiers in Applied Mathematics. Philadelphia, PA: Soc. Ind. Appl. Math., 1992, vol. 10.
50. R. C. Whaley and J. J. Dongarra, "Automatically Tuned Linear Algebra Software," presented at the 9th SIAM Conf. Parallel Processing for Scientific Computing, San Antonio, TX, 1999.
51. R. C. Whaley, A. Petitet, and J. J. Dongarra, "Automated empirical optimizations of software and the ATLAS project," Parallel Comput., vol. 27, pp. 3-35, 2001.
52. R. C. Whaley. User contribution to ATLAS. [Online]. Available: http://www.cs.utk.edu/~rwhaley/papers/atlascontrib.ps
53. J. Xiong, J. Johnson, R. Johnson, and D. Padua, "SPL: A language and compiler for DSP algorithms," in Proc. Conf. Programming Languages Design and Implementation (PLDI), 2001, pp. 298-308.
54. H. Zima and B. Chapman, Supercompilers for Parallel and Vector Computers. New York: ACM, 1991.