Architecture of an automatically tuned linear algebra library

Parallel Computing

Volumn 30, Issue 2, 2004, Pages 187-210

  Cuenca, Javier ^a   Giménez, Domingo ^a   González, José ^b  

^a UNIVERSITY OF MURCIA   (Spain)

^b INTEL RESEARCH   (United States)

Author keywords

Automatic tuning; Block methods; High performance computing; Linear algebra; Polylibraries

Indexed keywords

ALGORITHMS; COMPUTER SOFTWARE; EIGENVALUES AND EIGENFUNCTIONS; OPTIMIZATION; PARALLEL PROCESSING SYSTEMS; TUNING;

AUTOMATIC TUNING; BLOCK METHOD; HIGH PERFORMANCE COMPUTING; MESSAGE PASSING; POLYLIBRARIES;

LINEAR ALGEBRA;

EID: 1342306684     PISSN: 01678191     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.parco.2003.11.002     Document Type: Article

References (35)

1. P. Alberti, Solución Paralela de Mínimos Cuadrados para el Problema Inverso Aditivo de Valores Propios, Master's Thesis, Universidad Politécnica de Valencia, 2002.
2. Andersen B.S., Gustavson F., Karaivanov A., Wasniewski J., Yalamov P.Y. LAWRA, Linear algebra with recursive algorithms. Proceedings of the PARA 2000, Bergen, Norway, Lecture Note in Computer Science. vol. 1947:1985;38-50 Springer, Berlin.
3. Berman F., Chien A., Cooper K., Dongarra J., Foster I., Gannon D., Johnsson L., Kennedy K., Kesselman C., Mellor-Crummey J., Reed D., Torczon L., Wolski R. The GrADS project: software for high-level grid application development. International Journal of High Performance Computing Applications, SAGE Publications. 15(4):2001;327-344.
4. Bilmes J., Asanovic K., Chin C.W., Demmel J. Optimizing matrix multiply using PHiPAC: a portable, high-performance, ansi C coding methodology. International Conference on Supercomputing. 3:1997;340-347.
5. L.S. Blackford, J. Choi, A. Clearly, E. D'Azavedo, J. Demmel, I. Dhillon, J. Dongarra, S. Hammarling, G. Henry, A. Petitet, K. Stanley, D. Walker, R.C. Whaley, ScaLAPACK Users' Guide, Society for Industrial and Applied Mathematics, Philadelphia, PA, USA, 1997.
6. Boudet V., Petitet A., Rastello F., Robert Y. Data allocation strategies for dense linear algebra kernels on heterogeneous two-dimensional grids. Proceedings of the Parallel and Distributed Computing and Systems Conference (PDCS'99). 1999;561-569 IASTED Press.
7. Boulet P., Dongarra J., Rastello F., Robert Y., Vivien, F. Algorithmic issues on heterogeneous computing platforms. Parallel Processing Letters, World Scientific Publishing. 9(2):1999;197-213.
8. Brewer E.A. High-level optimization via automated statistical modeling. Proceedings of the of Fifth ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming. 1995;80-91 ACM Press.
9. Chen Z., Dongarra J., Luszczek P., Roche K. Self adapting software for numerical linear algebra and LAPACK for clusters. Parallel Computing. 29(11/12):2003;1723-1743.
10. Choi J., Dongarra J., Ostrouchov L.S., Petitet A.P., Walker D.W., Whaley R.C. The design and implementation of the ScaLAPACK LU, QR and Cholesky factorization routines. Scientific Programming. 5(3):1996;173-184.
11. Cuenca J., Giménez D., González J. Modeling the behaviour of linear algebra algorithms with message-passing. Proceedings of the Euromicro Workshop on Parallel and Distributed Processing. 2001;282-289 IEEE Press, Mantova, Italy.
12. Cuenca J., Giménez D., González J. Towards the design of an automatically tuned linear algebra library. Proceedings of the Euromicro Workshop on Parallel and Distributed Processing. 2002;201-208 IEEE Press, Gran Canaria Island, Spain.
13. Cuenca J., Giménez D., González J., Dongarra J., Roche K. Automatic optimisation of parallel linear algebra routines in systems with variable load. Proceedings of the Euromicro Workshop on Parallel and Distributed Processing. 2003;409-416 IEEE Press, Genove, Italy.
14. Dackland K., Kågström B. An hierarchical approach for performance analysis of ScaLAPACK-based routines using the distributed linear algebra machine. Wasniewski J., et al. Proceedings of Workshop on Applied Parallel Computing in Industrial Computation and Optimization (PARA96), Lyngby, Denmark, Lecture Notes in Computer Science. vol. 1184:1996;187-195 Springer, Berlin.
15. Dongarra J., Du Croz J., Duff I.S., Hammarling S. A set of Level3 basic linear algebra subprogram. ACM Transactions of Mathematical Software, ACM Press. 14:1988;1-17.
16. Dongarra J., Eijkhout V. Self-adapting numerical software for next generation applications. International Journal of High Performance Computing Applications, SAGE Publications. 17(2):2003;125-132.
17. Frigo M. FFTW: an adaptive software architecture for the FFT. Proceedings of the ICASSP Conference. vol. 3:1998;1381-1384 IEEE Press.
18. A. Geist, A. Beguelin, J. Dongarra, W. Jiang, R. Manchek, V. Sunderam, PVM: parallel virtual machine. A users' guide and tutorial for networked parallel computing, MIT Press, Cambridge, Massachusetts, 1994.
19. Golub G., VanLoan C. Matrix Computations. 2nd edition:1989;John Hopkins Press.
20. Gunnels J., Henry G., van de Geijn R. A family of high-performance matrix multiplications algorithms. Proceedings of International Conference on Computational Science (ICCS). vol. 1:2001;51-60 ACM Press.
21. Kalinov A., Lastovetsky A. Heterogeneous distribution of computations while solving linear algebra problems on networks of heterogeneous computers. Journal of Parallel and Distributed Computing, Academic Press. 61(4):2001;520-535.
22. T. Katagiri, A study on large scale eigensolvers for distributed memory parallel machines, Ph.D. Thesis, Graduate School, University of Tokyo, Japan, 2000.
23. Kuroda H., Katagiri T., Kanada Y. Performance of automatically tuned parallel GMRES(m) method on distributed memory machines. Proceedings of Hakken Kagaku Team. 1999;11-19 University of Tokyo, Japan.
24. J. Ostergaard, OptimQR, a software-package to create near-optimal solvers for sparse systems of linear equations, Web page: www.ostenfeld.dk/̃jakob/OptimQR/.
25. Petitet A., Blackford S., Dongarra J., Ellis B., Fagg G., Roche K., Vadhiyar S. Numerical libraries and the grid. International Journal of High Performance Computing Applications, SAGE Publications. 15:2001;359-374.
26. Roche K.J., Dongarra J.J. Deploying parallel numerical library routines to cluster computing in a self adapting fashion. Murli J., Vanneschi P. Proceedings of ParCo2001, Parallel Computing: Advances and Current Issues. 2002;Imperial College Press, London.
27. Whaley R.C., Petitet A., Dongarra J.J. Automated empirical optimizations of software and the ATLAS project. Parallel Computing, Elsevier Science. 27(1-2):2001;3-35.
28. Zhang Y. Block size selection of parallel LU factorization. Proceedings of HPC-ASIA2000. vol. 1:2000;247-249 IEEE Computer Society.
29. Y. Zhang, Block size selection in ScaLAPACK, in: Proceedings of the Fourth International Conference on High-Performance Computing in the Asia-Pacific Region, Beijing, China, 2000.
30. The BLACS Home Page, www.netlib.org/blacs/.
31. The LAPACK Home Page, www.netlib.org/lapack/.
32. The Message Passing Interface Forum Home Page: www.mpi-forum.org.
33. The Network Weather Service Home page: nws.npaci.edu/NWS.
34. The PBLAS Home Page, www.netlib.org/scalapack/pblas_qref.html.
35. The ScaLAPACK Home Page, www.netlib.org/scalapack/.